TY - GEN
T1 - JGHand
T2 - 2025 IEEE International Conference on Multimedia and Expo, ICME 2025
AU - Sun, Zhoutao
AU - Shen, Xukun
AU - Hu, Yong
AU - Zhong, Yuyou
AU - Zhou, Xueyang
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - Hands are a primary interface in daily interactions, making high-quality, controllable hand modeling and realistic real-time rendering crucial. Thus, we propose JGHand (Joint-driven 3D Gaussian Hand), a novel 3D Gaussian Splatting (3DGS)-based hand representation that renders high-fidelity hand images in real time across diverse poses and characters. Unlike existing articulated neural rendering techniques, we introduce a differentiable spatial transformation process based on 3D key points, enabling flexible deformations for varying bone lengths and poses. Additionally, we propose a real-time shadow simulation method based on per-pixel depth to simulate self-occlusion shadows from finger movements. Finally, we incorporate hand priors to develop an animatable 3DGS hand representation driven solely by 3D key points. We validate the effectiveness of each component through comprehensive ablation studies. Experimental results on public datasets demonstrate that JGHand achieves real-time rendering speeds with enhanced quality, surpassing state-of-the-art methods.
AB - Hands are a primary interface in daily interactions, making high-quality, controllable hand modeling and realistic real-time rendering crucial. Thus, we propose JGHand (Joint-driven 3D Gaussian Hand), a novel 3D Gaussian Splatting (3DGS)-based hand representation that renders high-fidelity hand images in real time across diverse poses and characters. Unlike existing articulated neural rendering techniques, we introduce a differentiable spatial transformation process based on 3D key points, enabling flexible deformations for varying bone lengths and poses. Additionally, we propose a real-time shadow simulation method based on per-pixel depth to simulate self-occlusion shadows from finger movements. Finally, we incorporate hand priors to develop an animatable 3DGS hand representation driven solely by 3D key points. We validate the effectiveness of each component through comprehensive ablation studies. Experimental results on public datasets demonstrate that JGHand achieves real-time rendering speeds with enhanced quality, surpassing state-of-the-art methods.
KW - 3D Gaussian Splatting
KW - 3D hand animation
KW - computer vision
UR - https://www.scopus.com/pages/publications/105022646162
U2 - 10.1109/ICME59968.2025.11209512
DO - 10.1109/ICME59968.2025.11209512
M3 - 会议稿件
AN - SCOPUS:105022646162
T3 - Proceedings - IEEE International Conference on Multimedia and Expo
BT - 2025 IEEE International Conference on Multimedia and Expo
PB - IEEE Computer Society
Y2 - 30 June 2025 through 4 July 2025
ER -