Skip to main navigation Skip to search Skip to main content

Gaze Pattern Genius: Gaze-Driven VR Interaction Using Unsupervised Domain Adaption

  • Kexin Wang
  • , Yang Gao
  • , Wenfeng Song*
  • , Yuecheng Li
  • , Aimin Hao
  • *Corresponding author for this work
  • Beihang University
  • Beijing Information Science & Technology University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This research advocates shifting VR interaction to gaze-driven interaction, a more intuitive alternative to traditional controls like VR controllers or gestures. Our focus is on enhancing neural network recognition accuracy, especially with limited user-specific gaze data. We introduce a novel framework for capturing gaze gesture patterns and propose a template dataset concept to boost neural training. Our unsupervised domain adaptation model, blending template depth and sparse user data authenticity, consistently excels in recognizing gaze patterns across diverse users. Rigorous benchmarking against leading architectures consistently shows our method outperforming. Empirical user studies confirm: gaze-driven interactions not only elevate VR experiences but also redefine immersive VR control dynamics.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages937-938
Number of pages2
ISBN (Electronic)9798350374490
DOIs
StatePublished - 2024
Event2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024 - Orlando, United States
Duration: 16 Mar 202421 Mar 2024

Publication series

NameProceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024

Conference

Conference2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024
Country/TerritoryUnited States
CityOrlando
Period16/03/2421/03/24

Keywords

  • Domain adaption
  • Gaze gesture
  • Gaze-driven interaction
  • VR interaction

Fingerprint

Dive into the research topics of 'Gaze Pattern Genius: Gaze-Driven VR Interaction Using Unsupervised Domain Adaption'. Together they form a unique fingerprint.

Cite this