Breakthrough in Real-Time Multimodal Tactile Technology

Breakthrough in Real-Time Multimodal Tactile Technology

Breakthrough in Real-Time Multimodal Tactile Technology

A tactile perception system capable of providing human-like multimodal tactile information to objects like robots and wearable devices that require tactile data in real time has been developed.

The research team led by Research Director Hyuneui Lim of the Nano-Convergence Manufacturing Systems Research Division and Principle Researcher Youngdo Jung of the Department of Nature-Inspired System and Application of the Korea Institute of Machinery and Materials (Chairman Seog-hyeon Ryu, hereinafter referred to as the “KIMM”), an institute under the jurisdiction of the Ministry of Science and ICT, developed a real-time and multimodal tactile perception system capable of providing multi-tactile information in real time inspired by human tactile perception, and announced the outcome of the research in the renowned journal “Soft Robotics.” (IF: 7.9)

Schematics of the tactile systems. (A) Schematics of the human and artificial tactile systems. (B) Examples of the functions of tactile systems.
Schematics of the tactile systems. (A) Schematics of the human and artificial tactile systems. (B) Examples of the functions of tactile systems. Credit: Korea Institute of Machinery and Materials (KIMM).

The research team developed a real-time and multimodal tactile detection system, by mimicking the principle by which various types of tactile information is perceived by a variety of sensory receptors in the human skin and is transmitted to the brain in real time. This system consists of four three-dimensionally stacked tactile sensors, a signal processing/transmission module, and an analysis module. The system has successfully distinguished various types of tactile stimuli and surface textures and furthermore differentiated complex motion in real time.

Four types of tactile sensors, each of which detects temperature, vibration, shear force, and vertical pressure, are laminated in a three-dimensional structure based on three-dimensional (3D) flexible electrode printing process technology. At the same time, these sensors are connected to the FPCB (Flexible Printed Circuit Board) of the electronic module for signal processing and transmission, thereby easily transmitting signal-processed tactile information through the corresponding FPCB connection terminal.

Credit: Korea Institute of Machinery and Materials (KIMM) Cutaneous receptors-mimicking sensors. (A) Schematics of the cutaneous receptors and proposed multimodal sensors. (B) Photographs of the 3D integrated sensors connected to the flexible 3D interconnection system. (C) Photograph of the 3D integrated sensors mounted on a robotic finger. The scale bars show 1 cm.
Cutaneous receptors-mimicking sensors. (A) Schematics of the cutaneous receptors and proposed multimodal sensors. (B) Photographs of the 3D integrated sensors connected to the flexible 3D interconnection system. (C) Photograph of the 3D integrated sensors mounted on a robotic finger. The scale bars show 1 cm. Credit: Korea Institute of Machinery and Materials (KIMM).

In previous studies, complex external measuring devices and analysis equipment were needed in order to detect the signals generated from the corresponding device so that various forms of tactile stimuli could be detected. Therefore, it was difficult to apply these devices to wearable devices or robots in the form of a simple stand-alone system.

On the other hand, in the newly developed multimodal tactile perception system, multiple types of tactile sensors are arranged vertically in a three-dimensional structure. Additionally, a module capable of converting, transmitting, and analysing the signals has also been developed, which allows for the system to be implemented in a compact and simple form and makes it applicable to actual robots and wearable devices.

Perception of complex tactile motion. (A) Illustrated images for eight kinds of consecutive operations. (B) Photograph and image of the experimental setup for complex motion test. (C) The transformed signals for the complex tactile motion using a real-time, simultaneous and continuous sensing system.
Perception of complex tactile motion. (A) Illustrated images for eight kinds of consecutive operations. (B) Photograph and image of the experimental setup for complex motion test. (C) The transformed signals for the complex tactile motion using a real-time, simultaneous and continuous sensing system. Credit: Korea Institute of Machinery and Materials (KIMM).

Research Director Hyuneui Lim of the KIMM was quoted as saying: “By mimicking the sensory system of humans, the real-time multimodal tactile perception system is capable of perceiving multiple senses simultaneously. Moreover, it is a technology that has solved the problems that may be caused by complex and large signal processing and detection systems when using conventional sensors.” She added: “By applying this system to robots or wearable devices, we will be able to obtain a large volume of diverse and complex tactile signal information, which will hopefully contribute to the improvement of public welfare and security.”

Meanwhile, this research was supported by the Convergence Technology Development Program for Bionic Arm through the National Research Foundation(NRF) of Korea funded by the Ministry of Science &ICT(2014M3C1B2048177), and the Basic Research Program of KIMM (No. NK242C), Republic of Korea.

Real-time and simultaneous monitoring for various tactile stimuli. (A) Illustrations for the four kinds of physical stimuli applied. The colored squares next to the stimuli in the graph indicate the region where the stimuli occurred. (B) Electrical responses for various physical stimuli.
Real-time and simultaneous monitoring for various tactile stimuli. (A) Illustrations for the four kinds of physical stimuli applied. The colored squares next to the stimuli in the graph indicate the region where the stimuli occurred. (B) Electrical responses for various physical stimuli. Credit: Korea Institute of Machinery and Materials (KIMM).

Post source : National Research Council of Science and Technology

About The Author

Anthony brings a wealth of global experience to his role as Managing Editor of Highways.Today. With an extensive career spanning several decades in the construction industry, Anthony has worked on diverse projects across continents, gaining valuable insights and expertise in highway construction, infrastructure development, and innovative engineering solutions. His international experience equips him with a unique perspective on the challenges and opportunities within the highways industry.

Related posts