Development of an Integrated Haptic Sensor System for Multimodal Human–Computer Interaction Using Ultrasonic Array and Cable Robot

This paper presents the design and development of a novel haptic sensor system. It integrates cable-driven force and ultrasonic tactile feedback, which can produce multimodal haptic stimuli. The sensing element includes a Leapmotion, an ultrasonic transducer array, tension sensors, and rotary encoders, which are used to capture hand posture, project tactile points, measure cable force and length, respectively. Firstly, a 6-DOF cable-driven force feedback apparatus based on parallel mechanism is designed and ultrasonic phased array is combined to form a multimodal haptic feedback system. Secondly, a multimodal haptic fusion method for cable-driven force and ultrasonic tactile is firstly proposed to invoke realistic compound haptic sensations. To enhance the rendering effects of each subsystem, admittance control is developed for a cable robot, and a new perceived magnitude model is established for ultrasound tactile rendering. A psychophysical experiment is conducted to study the perceived characteristics of multimodal haptic stimuli. To verify the proposed system, a series of experiments were carried out, whose results indicated that the system performs well at multi-property haptic rendering and confirm the accuracy and sensitive advantage of our system in virtual reality applications. The results of our study indicate that this device has great application potential in human-computer interaction.