Description
This topic is connected to the VRStream project: https://www.vr.tuwien.ac.at/projects/vrstream/
The goal of the topic is to develop methods for interaction of an actor performing in front of an LED wall with the 3D (stereo) digital content that is being displayed on the wall. Interaction methods should use body tracking data of the actor and no external controllers. Any types of gestures and postures can be explored. One challenge of this topic is that the actor might not see the 3D content directly; developed interaction methods should take this fact into account.
The topic is available as a project (PR) or a master thesis (MA). The amount of work will be adjusted accordingly. For a master thesis, the work will include an evaluation of the developed methods in a user study.
Tasks
- Literature research on 3D content-agnostic interaction methods
- Integration of the Moverse motion capture system into an Unreal project for virtual production (a plugin is available)
- Development of mocap-based interaction methods
Software and Hardware
Unreal Engine + Switchboard application, stereo LED wall in the Mixed Reality Lab, Moverse system for motion capture, maybe Qualisys tracking system
Requirements
- Knowledge of Unreal Engine and C++
- Knowledge of interaction techniques and gestures is advantageous
- Some knowledge of virtual production is a plus