HS Düsseldorf >> 
Fachbereiche >> 
Institute >> 
Organe und Gremien >> 
Verwaltung >> 
Hochschulbibliothek >> 
Campus IT >> 
Suche & Hilfe >> 

FB 1 Architektur >> 
FB 2 Design >> 
FB 3 Elektro- & Informationstechnik >> 
FB 4 Maschinenbau >> 
FB 5 Medien >> 
FB 6 Sozial/Kulturwiss. >> 
FB 7 Wirtschaft >> 

Aktuelles >> 
Studium >> 
Personen >> 
Showroom >> 
Studienbüro >> 
Dekanat >> 
Internationales >> 
Forschung & Entwicklung  >> 

Projekte >> 
Labore, Pools & Studios  >> 

HSD

Hochschule Düsseldorf
University of Applied Sciences


FB5

Fachbereich Medien
Faculty of Media

Labor für Virtuelles Studio / Virtuelle Realität



Publikationen >>
Presentationen >>
Forschung >>
Technologie >>
Kooperationen >>
Galerie >>
Abschlussarbeiten >>
Events >>
Lehre >>
Anfahrt >>
Labor Suche >>
Aktuelles >>

Interactive Virtual Studio - Relighting [DE]

 

Avatar (spirit based on leafs) moves into the body of the actor. Both actors with distance appart but visualy together Spirit passes into the actor, who is controlled by a second actor at a distance. Markerless tracking of the actors with visualization (and recognition) through coloured blobs.
Actor lies on the floor Different views Last words Credits
Facial animation using blend shapes Jibarm and two actors Virtual camera flight over the forest Smartphone for face tracking
Avatar Avatar based on leafs Companion for controlling the graphics and camera robotics movements Camera robotic

 

The production was carried out in 2020 as part of the Interactive Virtual Studio course at the Hochschule Düsseldorf, University of Applied Sciences. This production was born with the idea to let light work in virtual domains for the actor as well as using an avatar in the virtual studio. The graphic was rendered live with the Unity game engine. The actor is a video texture in the scene, so that obscuration and lighting work by computer graphics. The avatar, who also illuminates the actor, is controlled by markerless person tracking. The actor moves about 6 meters from the other actor away, but both are visibly together. This also allows the fusion of avatar and actor. In the second production, the second actor controls another avatar. Here blend shapes are used for the face animation, which is controlled by a smartphone on a holder on the chest via optical tracking. The camera robotics are moved automatically, whereby markerless person tracking is also used here. This enables one or two actors or virtual objects to be tracked and the framing is controlled variably.

 

Video

 

The media player is loading...

 

Download

 

Description Time mp4
1. Production Relighting 1080p503:25 Min462 MB >> 
2. Production Avatar Automatic Camera 720p503:15 Min252 MB >> 
Sub titles 2. Production with comments about the automatic camera in German3:25 MinVTT >> 
Sub titles 2. Production with comments about the automatic camera in English3:25 MinVTT >> 

 

Production team

 

Actors: Stefan Goldberg, Michele Schröder


Team: Till Davin, Manuel Garni, Jens Herder, Dennis Hergert, Vitalii Kens, Antje Müller (alphabetic order)

 

Keywords

 

Virtual Studio, Relighting, Captury Live, Interaction, Unity, Vizrt Tracking Hub

 

Credits

Tracking Hub Software von Vizrt

Camera tracking and robotics - Egripment/Trackmen

Markerless body tracking - Captury Live

Virtuak Studio at Hochschule Düsseldorf, University of Applied Sciences

Unity

 

Productions

Interaktives Virtuelles Studio - Markerlose Erfassung einer Person für Steuerung eines Moving Heads
Produktionen der HS Düsseldorf mit der Gameengine Unreal, 2019.
Interaktives Virtuelles Studio - Indiana Jones im Land der Studenten
Produktionen der HS Düsseldorf mit der Gameengine Unreal, 2018.
Mixed Reality Experience - Ein Einblick in die Virtuelle Realität unter Nutzung eines Virtuellen Studios
Produktionen der HS Düsseldorf mit einem HMD, 2017.
Praktikum Virtuelles Studio [2016] mit dem Thema VR
Der Studiobetrieb wird im Praktikum Virtuelles Studio im Studiengang Medientechnik unterrichtet.
Subtle Animations using Talent Tracking in a Virtual (TV) Studio
Produktion im Virtuellen Studio der FH Düsseldorf, 2014.
SpiderFeedback - seilwindengebundenes, visuelles Feedback im Virtuellen Studio
Produktion im Virtuellen Studio der FH Düsseldorf, 2014.
VRON: Virtual Reality over Networks - Die vier Stadien in einer digitalen Welt im Virtuellen Studio: Mensch, Cyborg, Avatar, Bot - Eine Virtuelle Studio-Produktion des Fachbereich Medien
Produktion im Virtuellen Studio der FH Düsseldorf, 2013.
Markerloses Darsteller Tracking für Anwendungen im Virtuellen Studio
Produktion im Virtuellen Studio der FH Düsseldorf, 2013.

Publications

A Lighthouse-based Camera Tracking System for Professional Virtual Studios
Kai Vermeegen and Jens Herder, GI-VRAR, Workshop Proceedings / Tagungsband: Virtuelle und Erweiterte Realität – 15. Workshop der GI-Fachgruppe VR/AR, ISBN 978-3-8440-6215-1, Düsseldorf, pp. 19-26, Oktober, 2018.
Mixed Reality Experience - How to Use a Virtual (TV) Studio for Demonstration of Virtual Reality Applications
Jens Herder, Philipp Ladwig, Kai Vermeegen, Dennis Hergert, Florian Busch, Kevin Klever, Sebastian Holthausen, and Bektur Ryskeldiev, Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, Santa Cruz, Portugal, INSTICC, DOI=10.5220/0006637502810287, Januar 27-29, 2018.
Four Metamorphosis States in a Distributed Virtual (TV) Studio: Human, Cyborg, Avatar, and Bot - Markerless Tracking and Feedback for Realtime Animation Control
Jens Herder, Jeff Daemen, Peter Haufs-Brusberg, Isis Abdel Aziz. Four Metamorphosis States in a Distributed Virtual (TV) Studio: Human, Cyborg, Avatar, and Bot - Markerless Tracking and Feedback for Realtime Animation Control, In Virtual Realities, pp 16-32, Springer International Publishing, DOI=10.1007/978-3-319-17043-5_2, ISBN 978-3-319-17042-8, April 1st, 2015.
SpiderFeedback - Visual feedback for Orientation in Virtual TV Studios
Jonathan Simsch and Jens Herder, 11th International Conference on Advances in Computer Entertainment, ACE 2014, Funchal, Portugal, November 11-14, 2014.
Four Metamorphosis States in a Distributed Virtual (TV) Studio: Human, Cyborg, Avatar, and Bot
Jose Burga, Jeff Daemen, Sascha Charlie Djuderija, Maren Gnehr, Lars Goossens, Sven Hartz, Peter Haufs-Brusberg, Jens Herder, Mohammed Ibrahim, Nikolas Koop, Christophe Leske, Laurid Meyer, Antje Müller, Björn Salgert, Richard Schroeder, and Simon Thiele, 10th International Conference on Visual Media Production (CVMP 2013), short paper, London, November, 2013.
Markerless Actor Tracking for Virtual (TV) Studio Applications
Jeff Daemen, Peter Haufs-Brusberg, and Jens Herder, International Joint Conference on Awareness Science and Technology & Ubi-Media Computing (iCAST 2013 & UMEDIA 2013), HC-2013 Track, Hamamatsu/Aizu-Wakamatsu/Duesseldorf, November, 2013.

Bachelor and Master theses

Virtual avatars in the virtual studio using markerless tracking for body and face
Raoul Gödel, Bachelor thesis, 2020
Virtuelles Studio

HSD FB 5 VSVR

12.01.2021

Seitenanfang ^^ 

Kontakt >> 
Suche >> 
Impressum >>