Labor für Virtuelles Studio / Virtuelle Realität

Abstract: Virtual Set Adjustment in Augmented Reality [DE]

This paper examines the benefits of Augmented Reality (AR) integration in virtual studios, which are widely used in the media and entertainment industry as a flexible and cost-effective alternative to traditional studios. However, conventional virtual studios offer limited interaction possibilities between producers and the virtual environment. Mixed reality elements such as Augmented Reality (AR) and Augmented Virtuality (AV) can solve this problem and significantly expand the potential of virtual studios. The paper addresses the fundamental technologies and workflows of virtual studios, including chroma keying, camera tracking, Vizrt, NDI, and furthermore the definition of mixed reality. It explores the possibilities of interaction in the virtual space and the interfaces provided by Unity3D. Subsequently, a concrete concept for integrating augmented reality into a virtual studio is presented to optimize the workflow and enable customizable and immersive virtual sets. An experiment is conducted to identify requirements, benefits, challenges, and potential limitations associated with mixed reality integration in virtual studios. The results include surveys and statistics, demonstrating that augmented reality set customization is faster, more precise, and more intuitive than traditional systems. Finally, the key findings are summarized, and an outlook on future developments in the implementation of virtual studios is provided.

Keywords:

Virtual Studio, Augmented Reality, Mixed Reality, Augmented Virtuality, Interaction, Camera Tracking, Passthrough, RESTful API

Supervisor:

Prof. Jens Herder, Dr. Eng./Univ. of Tsukuba
Prof. Dr.-Ing. Thomas Bonse

Location:

The research took place at the Virtual Sets and Virtual Environments Laboratory.