Skip to main navigation Skip to search Skip to main content

DENOISING DIFFUSION PROBABILISTIC MODELS FOR ACTION-CONDITIONED 3D MOTION GENERATION

  • Mengyi Zhao
  • , Mengyuan Liu
  • , Bin Ren
  • , Shuling Dai
  • , Nicu Sebe
  • Beihang University
  • Peking University
  • University of Pisa
  • University of Trento

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Diffusion-based generative models have proven to be highly effective in various domains of synthesis. In this work, we propose a conditional paradigm utilizing the denoising diffusion probabilistic model (DDPM) to address the challenge of realistic and diverse action-conditioned 3D skeleton-based motion generation. The proposed method leverages bidirectional Markov chains to generate samples by inferring the reversed Markov chain based on the learned distribution mapping during the forward diffusion process. To the best of our knowledge, our work is the first to employ DDPM to synthesize a variable number of motion sequences conditioned on a categorical action. The proposed method is evaluated on the NTU RGB+D dataset and the NTU RGB+D two-person dataset, showing significant improvements over state-of-the-art motion generation methods.

Original languageEnglish
Title of host publication2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages4225-4229
Number of pages5
ISBN (Electronic)9798350344851
DOIs
StatePublished - 2024
Event2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024 - Seoul, Korea, Republic of
Duration: 14 Apr 202419 Apr 2024

Publication series

NameICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
ISSN (Print)1520-6149

Conference

Conference2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024
Country/TerritoryKorea, Republic of
CitySeoul
Period14/04/2419/04/24

Keywords

  • Conditional Motion Generation
  • Diffusion Model
  • Motion Generation
  • Skeleton Data

Fingerprint

Dive into the research topics of 'DENOISING DIFFUSION PROBABILISTIC MODELS FOR ACTION-CONDITIONED 3D MOTION GENERATION'. Together they form a unique fingerprint.

Cite this