Skip to main navigation Skip to search Skip to main content

Virtual-Real Fusion with Dynamic Scene from Videos

  • Peking University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In this paper, we introduce a method to augment virtual environment with multiple videos. Our goal is to make a virtual-real fusion system that fuses dynamic imagery with 3D models in a real-time display, so as to help observers visualize dynamic videos simultaneously in the context of 3D models. 3D models in virtual environment are reconstructed using multiple view vision methods. Based on this, images can be registered through feature matching among images. Foreground objects in videos lead to distortions when video images are simply projected to static models. Detection and tracking of those objects are needed, and then several ordinary 3D models are used to represent those objects. Both geometry and appearance are taken into account to recover characteristic of different objects. This paper focuses on the integration of these components into a prototype system and the presentation of results shows the benefits of an virtualreal fusion system.

Original languageEnglish
Title of host publicationProceedings - 2016 International Conference on Cyberworlds, CW 2016
EditorsAlexei Sourin
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages65-72
Number of pages8
ISBN (Electronic)9781509023035
DOIs
StatePublished - 23 Nov 2016
Externally publishedYes
Event2016 International Conference on Cyberworlds, CW 2016 - Chongqing, China
Duration: 28 Sep 201630 Sep 2016

Publication series

NameProceedings - 2016 International Conference on Cyberworlds, CW 2016

Conference

Conference2016 International Conference on Cyberworlds, CW 2016
Country/TerritoryChina
CityChongqing
Period28/09/1630/09/16

Keywords

  • 3D Reconstruction
  • Augmented Virtual Reality
  • Background Modeling
  • Motion Tracking
  • Projective Texture mapping

Fingerprint

Dive into the research topics of 'Virtual-Real Fusion with Dynamic Scene from Videos'. Together they form a unique fingerprint.

Cite this