Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications

  • Minglu Zhu
  • , Zhongda Sun
  • , Zixuan Zhang
  • , Qiongfeng Shi
  • , Tianyiyi He
  • , Huicong Liu
  • , Tao Chen*
  • , Chengkuo Lee
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Human-machine interfaces (HMIs) experience increasing requirements for intuitive and effective manipulation. Current commercialized solutions of glove-based HMI are limited by either detectable motions or the huge cost on fabrication, energy, and computing power. We propose the haptic-feedback smart glove with triboelectric-based finger bending sensors, palm sliding sensor, and piezoelectric mechanical stimulators. The detection of multidirectional bending and sliding events is demonstrated in virtual space using the self-generated triboelectric signals for various degrees of freedom on human hand. We also perform haptic mechanical stimulation via piezoelectric chips to realize the augmented HMI. The smart glove achieves object recognition using machine learning technique, with an accuracy of 96%. Through the integrated demonstration of multidimensional manipulation, haptic feedback, and AI-based object recognition, our glove reveals its potential as a promising solution for low-cost and advanced human-machine interaction, which can benefit diversified areas, including entertainment, home healthcare, sports training, and medical industry.

Original languageEnglish
Article numbereaaz8693
JournalScience Advances
Volume6
Issue number19
DOIs
StatePublished - May 2020
Externally publishedYes

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being

Fingerprint

Dive into the research topics of 'Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications'. Together they form a unique fingerprint.

Cite this