Description

The goal of this task is to connect Construct 3D – an interactive Augmented Reality tool for learning 3D geometry – to a holographic (light field) display.

Construct 3D: https://www.vr.tuwien.ac.at/projects/construct3d-lernmodule/

The goal scenario is the following: one user is constructing geometry in Construct 3D, in AR mode running on Meta Quest 3; several spectators observe the actions  of this user on a holographic display without any mediating technology.

The Construct 3D project is re-implemented in Unreal Engine 5 and runs on Meta Quest 3 in single-user mode. Interaction is accomplished with one Meta Quest controller and a tracked stylus pen.

The topic is available as a PR (Praktikum/Project).

Tasks

  • Investigate whether Unreal Engine could be effectively used with the holographic display
  • Update Construct 3D to include synchronization of the scene to the holographic display
    • Synchronization of the scene can be one-directional: from Construct 3D to the holographic display
    • If Unity has to be used on the holographic display, develop a method for streaming content from the Unreal scene into Unity scene
  • Develop methods for plausible presentation of the scene on the holographic display

Hardware and Software

  • Unreal Engine, plus maybe Unity
    • Existing Construct 3D project in Unreal Engine
  • Looking Glass light field display
  • Logitech MX Ink Stylus
  • Meta Quest

Requirements

  • Knowledge of Unreal Engine (Unity beneficial)
  • General understanding of multi-user/streaming workflows is advantageous
  • General knowledge of 3D interaction is advantageous

Contact

Iana Podkosova yana.podkosova@tuwien.ac.at