Description

The goal of this topic is to create a multi-user VR (or AR) application in which users can write formulas with a tracked stylus pen. These formulas should be recognized in their hand-written form and transformed into a typed form. The project should be implemented in such a way that it could be incorporated as a module into a larger project. Depending on the effort involved into the implementation of writing, a small demo in which written and recognized formulas are used could be developed.

The topic is available as a PR (Praktikum/Project).

Tasks

  • Create a multi-user project in Unreal Engine or Unity
    • Users should see each other’s avatars that repeat user movements
  • Integrate Logitech MX Ink Stylus
  • Create a possibility for users to write formulas with the stylus as if on paper
    • Each user only needs to see their own hand writing
  • Develop the capability for hand-written formulas to be recognized and presented in the printed form
    • When a formula is recognized it is displayed in print to all users

Hardware and Software

  • Unreal Engine or Unity
  • Logitech MX Ink Stylus
  • Meta Quest
  • Any libraries that might be necessary for hand-writing and recognition

Requirements

  • Knowledge of Unreal Engine or Unity
  • General understanding of multi-user workflows is advantageous
  • General knowledge of 3D interaction is advantageous

Contact

Iana Podkosova yana.podkosova@tuwien.ac.at