 |
Interactive Virtual Studio - Dance on the roof [DE]
The production was started in 2021 as part of the Interactive Virtual Studio course of the
Düsseldorf University of Applied Sciences in cooperation with the Nicole Schoenewolf ballet school.
Due to the restrictions imposed by Corona, the rendering and composition was not carried out on the day of the recording,
as it is otherwise a requirement for this course. The rendering was created with the game engine Unity under live conditions.
This production shows the change from a dancer to an avatar and back and plays on the roofs of the Derendorf campus of the Düsseldorf University of Applied Sciences.
Based on Virtual Youtuber, the avatar was created with the VRoid Studio software.
The graphics were rendered live with the Unity game engine. The dancer is a video texture in the scene,
so that occlusion and lighting work by computer graphics. The dancer has an avatar in the same place to create a shadow.
The avatar is controlled by a markerless talent tracking. The face of the avatar is animated via blend shapes and which is controlled via face tracking.
Video
The media player is loading...
Download
| Description | Time | mp4 |
|---|
| Production Dance on the roof 2160p50 | 4:01 Min | 439 MB >> |
| Production Dance on the roof 1080p50 | 4:01 Min | 343 MB >> |
Production team
Dancer: Greta Müller
Choreography: Nicole Schoenewolf
Director: Helmut Sieber
Team:
Till Davin, Zina Ghannadan, Danny-Brandon Günther, Jens Herder, Christian Kükenshöner, Michael Michel, Antje Müller, Erik Schüler, Christin Willscheid, Felix Winkels, Bernhard Wohlmacher (in alphabetic order)
Keywords
Virtual Studio, Motion Capturing, Face Tracking, Interaction, Unity HDRP
Credits
- Set was created with assets from the Project „Virtual Campus“ at HSD under supervision of professors Bonse and Mostafawy
- Tracking Hub Software from Vizrt
- Camera tracking system - Egripment/Trackmen
- Markerless person tracking - Captury Live
- Face tracking - Face Cap App on an iPhone with Face ID
- Avatar - VRoid Studio
- Virtual Studio at Hochschule Düsseldorf - University of Applied Sciences
- Unity HDRP
- Music - Musicfox
Productions
- Interaktives Virtuelles Studio - Relighting
- Produktionen der HS Düsseldorf mit der Gameengine Unity, 2020.
- Interaktives Virtuelles Studio - Markerlose Erfassung einer Person für Steuerung eines Moving Heads
- Produktionen der HS Düsseldorf mit der Gameengine Unreal, 2019.
- Interaktives Virtuelles Studio - Indiana Jones im Land der Studenten
- Produktionen der HS Düsseldorf mit der Gameengine Unreal, 2018.
- Mixed Reality Experience - Ein Einblick in die Virtuelle Realität unter Nutzung eines Virtuellen Studios
- Produktionen der HS Düsseldorf mit einem HMD, 2017.
- Praktikum Virtuelles Studio [2016] mit dem Thema VR
- Der Studiobetrieb wird im Praktikum Virtuelles Studio im Studiengang Medientechnik unterrichtet.
- Subtle Animations using Talent Tracking in a Virtual (TV) Studio
- Produktion im Virtuellen Studio der FH Düsseldorf, 2014.
- SpiderFeedback - seilwindengebundenes, visuelles Feedback im Virtuellen Studio
- Produktion im Virtuellen Studio der FH Düsseldorf, 2014.
- VRON: Virtual Reality over Networks - Die vier Stadien in einer digitalen Welt im Virtuellen Studio: Mensch, Cyborg, Avatar, Bot - Eine Virtuelle Studio-Produktion des Fachbereich Medien
- Produktion im Virtuellen Studio der FH Düsseldorf, 2013.
- Markerloses Darsteller Tracking für Anwendungen im Virtuellen Studio
- Produktion im Virtuellen Studio der FH Düsseldorf, 2013.
Publications
- A Lighthouse-based Camera Tracking System for Professional Virtual Studios
- Kai Vermeegen and Jens Herder, GI-VRAR, Workshop Proceedings / Tagungsband: Virtuelle und Erweiterte Realität – 15. Workshop der GI-Fachgruppe VR/AR, ISBN 978-3-8440-6215-1, Düsseldorf, pp. 19-26, Oktober, 2018.
- Mixed Reality Experience - How to Use a Virtual (TV) Studio for Demonstration of Virtual Reality Applications
- Jens Herder, Philipp Ladwig, Kai Vermeegen, Dennis Hergert, Florian Busch, Kevin Klever, Sebastian Holthausen, and Bektur Ryskeldiev, Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, Santa Cruz, Portugal, INSTICC, DOI=10.5220/0006637502810287, Januar 27-29, 2018.
- Four Metamorphosis States in a Distributed Virtual (TV) Studio: Human, Cyborg, Avatar, and Bot - Markerless Tracking and Feedback for Realtime Animation Control
- Jens Herder, Jeff Daemen, Peter Haufs-Brusberg, Isis Abdel Aziz. Four Metamorphosis States in a Distributed Virtual (TV) Studio: Human, Cyborg, Avatar, and Bot - Markerless Tracking and Feedback for Realtime Animation Control, In Virtual Realities, pp 16-32, Springer International Publishing, DOI=10.1007/978-3-319-17043-5_2, ISBN 978-3-319-17042-8, April 1st, 2015.
- SpiderFeedback - Visual feedback for Orientation in Virtual TV Studios
- Jonathan Simsch and Jens Herder, 11th International Conference on Advances in Computer Entertainment, ACE 2014, Funchal, Portugal, November 11-14, 2014.
- Four Metamorphosis States in a Distributed Virtual (TV) Studio: Human, Cyborg, Avatar, and Bot
- Jose Burga, Jeff Daemen, Sascha Charlie Djuderija, Maren Gnehr, Lars Goossens, Sven Hartz, Peter Haufs-Brusberg, Jens Herder, Mohammed Ibrahim, Nikolas Koop, Christophe Leske, Laurid Meyer, Antje Müller, Björn Salgert, Richard Schroeder, and Simon Thiele, 10th International Conference on Visual Media Production (CVMP 2013), short paper, London, November, 2013.
- Markerless Actor Tracking for Virtual (TV) Studio Applications
- Jeff Daemen, Peter Haufs-Brusberg, and Jens Herder, International Joint Conference on Awareness Science and Technology & Ubi-Media Computing (iCAST 2013 & UMEDIA 2013), HC-2013 Track, Hamamatsu/Aizu-Wakamatsu/Duesseldorf, November, 2013.
Thesis
- Echtzeit-Beleuchtungsanpassung einer Videoaufnahme in einer Augmented Virtuality Szene unter Verwendung eines markerlosen Personentrackings
- Till Davin, Masterarbeit, 2021
- Virtuelle Avatare im Virtuellen Studio unter Verwendung eines markerlosen Trackings für Körper und Gesicht
- Raoul Gödel, Bachelorarbeit, 2020
|
|
