Skip to main navigation Skip to search Skip to main content

A multimodal reference resolution approach in virtual environment

  • Xiaowu Chen*
  • , Nan Xu
  • *Corresponding author for this work
  • Beihang University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper presents a multimodal reference resolution approach in virtual environment, which is called RRVE. Based on the relationship between cognitive status and reference, RRVE divides the objects into four status hierarchies including pointing, in focus, activated, extinct, and step by step it processes multi-modal reference resolution according to current status hierarchy. Also it defines a match function to compute the match probability of referring expression and potential referent, and describes the semantic signification and temporal constraints. Finally, sense shape is used to deal with the pointing ambiguity, which helps the user to interact precisely in immersive virtual environment.

Original languageEnglish
Title of host publicationInteractive Technologies and Sociotechnical Systems - 12th International Conference, VSMM 2006, Proceedings
PublisherSpringer Verlag
Pages11-20
Number of pages10
ISBN (Print)3540463046, 9783540463047
DOIs
StatePublished - 2006
Event12th International Conference on Virtual Systems and Multimedia, VSMM 2006 - Xi'an, China
Duration: 18 Oct 200620 Oct 2006

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4270 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference12th International Conference on Virtual Systems and Multimedia, VSMM 2006
Country/TerritoryChina
CityXi'an
Period18/10/0620/10/06

Fingerprint

Dive into the research topics of 'A multimodal reference resolution approach in virtual environment'. Together they form a unique fingerprint.

Cite this