FastHand: Fast monocular hand pose estimation on embedded systems

  • Shan An
  • , Xiajie Zhang
  • , Dong Wei
  • , Haogang Zhu*
  • , Jianyu Yang
  • , Konstantinos A. Tsintotas
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Hand pose estimation is a fundamental task in many human–robot interaction-related applications. However, previous approaches suffer from unsatisfying hand landmark predictions in real-world scenes and high computation burden. This paper proposes a fast and accurate framework for hand pose estimation, dubbed as “FastHand”. Using a lightweight encoder–decoder network architecture, FastHand fulfills the requirements of practical applications running on embedded devices. The encoder consists of deep layers with a small number of parameters, while the decoder uses spatial location information to obtain more accurate results. The evaluation took place on two publicly available datasets demonstrating the improved performance of the proposed pipeline compared to other state-of-the-art approaches. FastHand offers high accuracy scores while reaching a speed of 25 frames per second on an NVIDIA Jetson TX2 graphics processing unit.

Original languageEnglish
Article number102361
JournalJournal of Systems Architecture
Volume122
DOIs
StatePublished - Jan 2022

Keywords

  • Encoder–decoder network
  • Hand detection
  • Hand pose estimation
  • Heatmap regression
  • Landmark localization

Fingerprint

Dive into the research topics of 'FastHand: Fast monocular hand pose estimation on embedded systems'. Together they form a unique fingerprint.

Cite this