JGHand: Joint-Driven Animatable Hand Avater via 3D Gaussian Splatting

  • Zhoutao Sun
  • , Xukun Shen
  • , Yong Hu*
  • , Yuyou Zhong
  • , Xueyang Zhou
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Hands are a primary interface in daily interactions, making high-quality, controllable hand modeling and realistic real-time rendering crucial. Thus, we propose JGHand (Joint-driven 3D Gaussian Hand), a novel 3D Gaussian Splatting (3DGS)-based hand representation that renders high-fidelity hand images in real time across diverse poses and characters. Unlike existing articulated neural rendering techniques, we introduce a differentiable spatial transformation process based on 3D key points, enabling flexible deformations for varying bone lengths and poses. Additionally, we propose a real-time shadow simulation method based on per-pixel depth to simulate self-occlusion shadows from finger movements. Finally, we incorporate hand priors to develop an animatable 3DGS hand representation driven solely by 3D key points. We validate the effectiveness of each component through comprehensive ablation studies. Experimental results on public datasets demonstrate that JGHand achieves real-time rendering speeds with enhanced quality, surpassing state-of-the-art methods.

Original languageEnglish
Title of host publication2025 IEEE International Conference on Multimedia and Expo
Subtitle of host publicationJourney to the Center of Machine Imagination, ICME 2025 - Conference Proceedings
PublisherIEEE Computer Society
ISBN (Electronic)9798331594954
DOIs
StatePublished - 2025
Event2025 IEEE International Conference on Multimedia and Expo, ICME 2025 - Nantes, France
Duration: 30 Jun 20254 Jul 2025

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Conference

Conference2025 IEEE International Conference on Multimedia and Expo, ICME 2025
Country/TerritoryFrance
CityNantes
Period30/06/254/07/25

Keywords

  • 3D Gaussian Splatting
  • 3D hand animation
  • computer vision

Fingerprint

Dive into the research topics of 'JGHand: Joint-Driven Animatable Hand Avater via 3D Gaussian Splatting'. Together they form a unique fingerprint.

Cite this