Description:

  • Our encountered-type haptic platform with a robotic arm on a mobile base presents physical touchable props in VR. A high-precision force torque sensor allows to measure input force and the direction of this force on any attached surface. However, since the sensor is usually positioned in the middle of a prop, the exact interaction point is unknown. 

Tasks:

  • Employ the power of deep learning techniques, artificial neural networks and reinforcement learning to allow the robot to sense the location, direction, and magnitude of a force applied anywhere on an interactive mounted surface.
  • Example & groundwork: https://www.science.org/stoken/author-tokens/ST-2065/full

Setup/IDE: Unity 6, ROS 

Prerequisites:

  • Programming skills and ​interest in robotics,
    basic knowledge of Linux cmd