[MRLAB] Interactive Pong Game with ARTNET-Controlled LED Ceiling

Project Overview

This project aims to develop an interactive Pong game where players’ actions directly control a 2528 (32×79) RGB pixel (LED) ceiling installation in the Mixed Reality Lab. The visual output of the game is rendered in real-time across the entire array of ceiling-mounted LEDs, offering an immersive, room-scale experience. Communication with the LED array is handled by the ARTNET protocol, a standard for transmitting DMX lighting control data over Ethernet.

Objectives

• Develop a Classic Pong Game: Implement and customize the logic of the classic Pong game in a modern programming environment (Unity or Unreal).
• Real-Time LED Visualization: Design a mapping system to translate Pong’s graphical output onto the physical pixel grid (32×79 RGB LEDs) on the ceiling, maintaining smooth and visually appealing animations.
• ARTNET Protocol Integration: Develop or adapt an ARTNET data sender that transmits the LED frame data to the ceiling controller at real-time speeds. DMX or ARTNET Plugins for Unity or Unreal can be used. In Unreal Artnet support might be integrated – needs to be checked.
• User Interaction: Implement user input, for example via keyboard, gamepad, or alternative controllers (e.g., motion sensors), to control the paddles.

Key Tasks

1. Research & Planning
   • Study existing ARTNET implementations for lighting control.
   • Review Pong game logic and LED mapping strategies.
   • Familiarize with the hardware topology and pixel layout of the Lab’s ceiling.
2. Pong Game Implementation
   • Design and develop the Pong game logic in the game engine.
   • Add scoring, ball movement, collision detection, and paddle control.
3. Graphics-to-LED Mapping
   • Design an efficient mapping algorithm to translate game coordinates to the ceiling LED layout.
   • Handle aspect ratio differences, pixel scaling, and color transitions.
4. ARTNET Integration
   • There is an Unreal Plugin that is supposed to support ARTNET – it can be used and should be tested how well it works
     https://dev.epicgames.com/documentation/en-us/unreal-engine/dmx-overview
   • Implement frame-by-frame transmission of color data via ARTNET.
   • Optimize data packets for 2528 RGB pixels
   • Test with a simulated or real-artnet setup.
5. User Testing & Demo
   • Conduct user tests in the lab environment to ensure gameplay and lighting responsiveness.
   • Prepare a final demonstration and presentation of the interactive Pong installation.

Expected Outcomes

• A fully functional Pong game projected onto the ceiling LED grid in real-time.
• Seamless ARTNET integration, allowing low-latency, flicker-free control of all 32×79 RGB pixels.
• Documentation (=thesis) covering the design, implementation, and setup instructions, as well as recommendations for future expansion (e.g., multiplayer, other games, or interactive experiences).

Prerequisites

• Basic programming knowledge (ideally with experience in graphics or interactive applications in the game engines).
• Willingness to work with hardware APIs and network protocols.
• Interest in real-time systems and interactive media.

Supervisor

Prof. Hannes Kaufmann and/or Priv. Doz. Peter Kan

Contact

If you are interested in this project or have questions, please contact Hannes Kaufmann or Peter Kan.