Description

We are currently developing a custom wireless one-handed controller that will serve as the primary interface for interactive applications on the LED wall and in the CAVE. The goal of this project is to extend the controller with vibrotactile feedback, enabling applications built in Unreal Engine to trigger and design haptic responses for the user’s hand.

The project includes hardware and software development: the controller housing must be adapted to accommodate small vibration motors, the onboard ESP32 microcontroller must be programmed to drive them, and an Unreal Engine interface must be developed to allow flexible, application-level control over vibration patterns. Since the controller is intended as a long-term platform for future MR Lab projects, implementation quality and extensibility are a primary concerns.

 

Tasks

  • Research and evaluate suitable small vibration motors for integration into the controller

  • Adapt the existing controller housing (3D modeling and printing) to accommodate the selected motors

  • Implement motor control logic on the ESP32 microcontroller in C (using ESP-IDF)

  • Develop an Unreal Engine API to trigger and configure vibration patterns at the application level

 

Requirements

  • Solid programming skills

  • Knowledge of Unreal Engine

  • Experience with microcontrollers (ESP32 or similar)

  • 3D CAD modeling skills

Besides solid programming skills, you do not need extensive experience with all other requirements, as they can be learned as part of the project.

 

Scope: PR