Master thesis

This thesis will focus on empowering the embodied virtual agent with conversational capabilities. The virtual agent will be situated into urban exploration scenario in virtual reality. The agent will be able to communicate with a user by voice about the buildings, environment and surrounding urban area. The existing tools for speech-to-text conversion, natural language processing and speech synthesis will be utilized to enable the agent to communicate with the user. Additionally, the AI-based chatbot system will be used to maintain meaningful conversation with the user. Lipsync animation while speaking and pointing animation of agents will be added to the system. The created intelligent agents will be integrated into an urban visualization tool in Unreal Engine. The high-quality urban visualization tool will be provided by our partner company. Finally, the human perception of the created conversational agents will be evaluated in a user study.

Responsible

For more information please contact Peter Kán.