 |
Abstract: The Mobile Virtual Studio [DE]
Tobias Schmidt, The Mobile Virtual Studio, Hochschule Düsseldorf, Bachelor Thesis, 17.03.2020.
This thesis examines the usage of mobile devices such as tablets and smartphones in its
functionality as a mobile virtual studio. The Mobile Virtual Studio applies all the principles
and functions of the (big) virtual studio to a smaller less costly application. The
required functions include camera and people tracking, segmentation and interaction. These
functions are provided by version 3 of Apple's ARKIT in combination with the iPad
Pro (2018). ARKIT by Apple is a framework for Augmented Reality development that
includes the necessary features for the Mobile Virtual Studio. Comparable Frameworks
for Augmented Reality development are Vufora from ptc and ARCore from Google. The
iPad Pro will be used as hardware since it comes with a capable camera, the necessary
sensors for tracking and other than its predecessors it has the powerful A12 processor,
which allows the usage of the Mobile Virtuel Studio's most important feature which is
People Occlusion.
People Occlusion is a technology that allows for the lmed person to be separated from
the image without the need for a special background. This technology also enables the
system to determine, whether a virtual object is in front or behind the person. In order
to place 3D objects in the scene the application is able to detect planes in the 3D space
and thus creates virtual image of the room in 3D. It utilzes a combination of optical and
inertial tracking for camera tracking and to place objects in the 3D space.
While the hardware is not powerful enough to display the virtual world in a quality tting
for movies there are a number of possible applications. These applications include
pre visualization and business TV.
Keywords:
Virtual Reality, Augmented Reality, Augmented Virtuality, Virtual Studio,
People Occlusion, Tracking
Supervisor:
Prof. Jens Herder, Dr. Eng./Univ. of Tsukuba
Prof. Dr.-Ing. Thomas Bonse
Location:
The research took place at the Virtual Sets and Virtual Environments Laboratory.
|
|
