Effects of sensory stimulation in Virtual Reality

This thesis investigates the impact of integrating multisensory feedback, particularly the combination of 3D audio and haptic elements, on the enhancement of immersion and presence in virtual reality environments. Addressing a significant gap in the existing VRresearch literature by examining the impact of synchronized sensory feedback on user experience, extending beyond the domain of visual immersion. To investigate this, the "Phantastic Sound Experience" VR system was developed. The system is implemented to combine 3D audio and tactile feedback by combining a virtual environment with a custom built physical device, that provides audio-triggered tactile vibrations. The participants were exposed to two conditions: one incorporating multisensory feedback and another comprising solely the visual environment. Quantitative and qualitative data were gathered through the administration of standardized presence and immersion questionnaires, complemented by user interviews. The findings indicate that the provision of multisensory feedback has the effect of enhancing user immersion and presence. Inparticular, those in Group B (who received tactile and audio feedback) reported increased physical involvement and a reduction in their awareness of the real world. While nostatistically significant differences were observed in some metrics, qualitative feedback indicated a stronger sense of time distortion and "being there" among those receiving multisensory cues. These findings imply that the combination of 3D audio and haptics in VR has the potential to enhance user engagement. However, further research is required to refine the techniques employed for the integration of sensory stimuli. This study provides insights into effective VR sensory synchronization and identifies areas for future work, such as the optimization of calibration methods for haptic feedback and the examination of individual sensory processing differences. These findings establish a foundation for nuanced sensory synchronization in VR, advancing design strategies that foster fully immersive user experiences.