 |
Abstract: Development of an AR Interface for Live Video Switching using Contextual Information to Aid Decision-Making [DE]
Nico Balthazar, Development of an AR Interface for Live Video Switching using Contextual Information to Aid Decision-Making, Hochschule Düsseldorf - University of Applied Sciences, Bachelor thesis, 11.02.2026.
This thesis examines the use of a multiviewer developed in augmented reality (AR)
with integrated editing functions on a head-mounted display (HMD) for live video switching, aiming
to analyze its impact on clarity and decision-making compared to established workflows. To
this end, various context-related information is utilized to unify and optimize the workflows
of the director and the video switcher within a single system. The immersive control of the
multiviewer on the HMD – in this case, the Apple Vision Pro – is achieved via intuitive
eye- and hand-tracking through gesture-based interaction. This is intended to simplify the
workflow of the director / video switcher and make it more efficient.
For this purpose, a prototype AR interface was developed and evaluated in a practical scenario
as part of a user study. The study was based on a comparison with the established workflow
in the Virtual Studio of the Hochschule Düsseldorf using a physical video switcher and
multiviewer. In addition, expert interviews were conducted to evaluate the current benefits of
the AR interface from a technical perspective. The results indicate that the developed system
can enhance the overview of live productions and support decision-making processes in live
video switching. Moreover, the system is flexible across various live production scenarios
and portable due to the compact design of the HMD, which in the future also enables work
in remote setups. However, in professional environments, control via the AR interface is
currently suitable only for selected live productions, as the workflow with a video switcher,
based on established use of physical buttons, cannot yet be fully replaced. Nevertheless, the
AR interface already provides supporting functions in professional live productions. At the
same time, due to its weight and the associated limitations regarding wearing comfort and
production safety, the system’s use is currently limited to short, small-scale productions and
should be evaluated more comprehensively in future studies, particularly in terms of the
latter.
Keywords:
augmented reality, AR interface, head-mounted display, live video switching,
multiviewer, eye-tracking, gesture control, live production, user study, expert interviews
Supervisor:
Prof. Jens Herder, Dr. Eng./Univ. of Tsukuba
Prof. Dr.-Ing. Thomas Bonse
Location:
The research took place at the Virtual Sets and Virtual Environments Laboratory.
Video
Tools and Credits
- Viz Artist 5, NDI und Tracking Hub Software von Vizrt
- Unity - Unity Technologies
- Virtual Studio at the Hochschule Düsseldorf
|
|
