[MR Lab] Real-time painting with LED ceiling lights

Description

The goal of this topic is to implement a system in which a user can “paint” on LED light strips in the new Mixed Reality lab by moving a hand-held controller. The position of the user/controller is tracked with the Qualysis trackig system and projected on the ceiling to determine which individual lights are controlled in every moment. The specifics of the implementation, especially the artistic interpretation, are up to the student.

In an extended version, multiple users can be included to create a shared real-time “light painting” experience. In addition, user voices can be incorporated as control mechanism: users can make sounds that are captured by the microphones of the sound system and interpreted into painting actions.

This topic is available as a project (PR) but can also be extended to a master thesis by including multiple users and sound control.

Hardware and Software

LED lights controlled by the DMX protocol, Qualisys tracking system, Unreal Engine, MR Lab sound system in the extended version of the topic

Requirements

Knowledge of Unreal Engine and C++

Contact

The topic is co-supervised by Iana Podkosova and Peter Kan:

Iana Podkosova yana.podkosova@tuwien.ac.at

Peter Kan peter.kan@tuwien.ac.at