TY - GEN
T1 - Real-Time 3d hand gesture based mobile interaction interface
AU - Che, Yunlong
AU - Qi, Yue
AU - Song, Yuxiang
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/10
Y1 - 2019/10
N2 - Hand gesture recognition is a challenging problem for natural human-computer interaction(HCI). We address this problem by introducing a real-Time human-mobile interaction interface with a depth sensor. Our interface consists of two components, 3D hand pose estimation and hand skeleton state based gesture description. Firstly, we propose a 3D hand pose estimation method that combines learning based pose initialization and physical based model fitting, which can estimate the per-frame's hand pose that appears in the depth camera's field of view. Afterwards, we map the estimated pose to gesture, e.g. open or close, through a hand skeleton state based method. With the tracked hand gesture, we can stably and smoothly implement common operations such as 'Touch', 'Grasp' and 'Hold' with mid-Air interface. Our main contribution is combine 3D hand pose estimation and hand gesture tracking, and implementing an interaction application system with the details.
AB - Hand gesture recognition is a challenging problem for natural human-computer interaction(HCI). We address this problem by introducing a real-Time human-mobile interaction interface with a depth sensor. Our interface consists of two components, 3D hand pose estimation and hand skeleton state based gesture description. Firstly, we propose a 3D hand pose estimation method that combines learning based pose initialization and physical based model fitting, which can estimate the per-frame's hand pose that appears in the depth camera's field of view. Afterwards, we map the estimated pose to gesture, e.g. open or close, through a hand skeleton state based method. With the tracked hand gesture, we can stably and smoothly implement common operations such as 'Touch', 'Grasp' and 'Hold' with mid-Air interface. Our main contribution is combine 3D hand pose estimation and hand gesture tracking, and implementing an interaction application system with the details.
KW - 3D Hand pose estimation
KW - Augmented Reality
KW - Hand gesture recognition
KW - Human-mobile interaction
KW - Interaction interface
UR - https://www.scopus.com/pages/publications/85078727175
U2 - 10.1109/ISMAR-Adjunct.2019.00-41
DO - 10.1109/ISMAR-Adjunct.2019.00-41
M3 - 会议稿件
AN - SCOPUS:85078727175
T3 - Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
SP - 228
EP - 232
BT - Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
Y2 - 14 October 2019 through 18 October 2019
ER -