 |
Abstract: Remote AR Production -
Implementation of an Augmented Reality TV Production using a professional Virtual Studio combined with a Remote Camera of a Mobile Device [DE]
Kevin Klever, Remote AR Production -
Implementation of an Augmented Reality TV Production using a professional Virtual Studio combined with a Remote Camera of a Mobile Device, Hochschule Düsseldorf, Master Thesis, 19.6.2019.
In this thesis, Remote Augmented Reality (AR) production is thematised. The aim of work is to indicate how audio, video and metadata (including tracking data) of mobile devices (smartphone/tablets) can be broadcast to a remote virtual studio. Within the virtual studio, the data is received via various interfaces. Video data are expanded with virtual content to produce AR by using metadata (including tracking data) via a renderer integrated into the studio production. Fundamentals of AR, Virtual Studio and the possibilities of transmitting audio, video and metadata via SDI as well as network/IP via RTSP, RTMP, HTTP, NDI and WebRTC are described. AR productions that were done outside of virtual studios are shown. A remote AR production is designed, planned and transposed. For that it will be using a developed application for mobile devices. This application is based on the NDI protocol for transmitting the video image of the camera, the X-cito protocol for transmitting the tracking data and WebRTC for bidirectional communication as well as for transmitting a preview of the rendered video image from the studio to the mobile device. Within the studio, the virtual studio software from Vizrt (Tracking Hub and Viz Artist) is used. During the entire phase, criteria for this type of production are collected and summarised and using by an online survey to proven experts in mixed reality (especially AR) as well as studio productions in research, development and production. The aim of this is to find out which of the criteria mentioned in the survey have significant relevance for experts for this type of production. Furthermore, the latency of the transmission of the video image to the renderer in the studio is measured. The results will be discussed and an outlook given.
Keywords:
Augmented Reality, Virtual Studio, SDI, Video over IP, Streaming, NDI, WebRTC, Vizrt
Supervisor:
Prof. Jens Herder, Dr. Eng./Univ. of Tsukuba
Prof. Dr.-Ing. Thomas Bonse
Location:
The research took place at the Virtual Sets and Virtual Environments Laboratory.
Video
The media player is loading...
Download
| Description | Time | mp4 |
| Remote AR Production 720p | 04:15 Min | 325,7 MB >> |
|
|
