Type: Bachelor thesis, Master thesis, Practicum Project

Persons: 1-3



Vision is one of the most potent sources of information about the world we are interacting with. That is especially true for precise actions such as reaching for, touching, and grasping an object. Vision cues precede most of our actions and can be used for their anticipation by automated systems such as robots. In our setup, a mobile robot is used to present a haptic object to the users when they want to touch it. For a safe and realistic experience, the intention to touch should be predicted as soon and as accurately as possible.

You are expected to rely on the most relevant and cited sources, such as books and international research publications, to make a well-argued suggestion for a good/practical/optimal solution for gaze-based action prediction in our setup.

Different sub-topics are available:

  • optimization of saliency evaluation of VR environment: prediction of what objects in the environment will be most interesting for the user,
  • gaze-to-action prediction: explore the connection of the gaze behavior to the actions performed,
  • gaze manipulation: how to manipulate the user’s attention and subtly provoke the desired behavior.

The chosen algorithm(s) will then be implemented for testing in Unity3D (C#).



The student will work with a previously developed gaze feature extraction framework to develop a prediction mechanism based on the existing literature and available features.  For the saliency evaluation of a 3D scene, an optimization of the previous work is needed to run in real-time, followed by evaluation via a user study.

The master students will also be required to carry out a user study as an evaluation. They are also welcome to suggest their own methods to solve the issue or give a topic a different angle.


  • Knowledge of the English language (communication, source code comments and final report will be in English)
  • Familiarity with Unity3D is helpful
  • Programming languages: C#



For more information please contact Khrystyna VasylevskaSoroosh Mortezapoor.