Servicenavigation

Project Details

Back

Projekt Print View

Visual-Haptic Perceptual Illusions for Hand-based Interaction in Virtual Environments

Subject Area Human Factors, Ergonomics, Human-Machine Systems
Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing
Term from 2021 to 2024
Project identifier Deutsche Forschungsgemeinschaft (DFG) - Project number 450247716
 
Final Report Year 2024

Final Report Abstract

The VHIVE project investigated how hand-based interactions in virtual environments (VEs) can be enhanced. For this, the project focused on the development and evaluation of novel devices and interaction techniques that improve the haptic fidelity of interactions. A special focus thereby lied on solutions that make use of visual-haptic illusions and build upon perceptual phenomena like visual dominance, multisensory integration, and change blindness. For this, VHIVE was split up into three topic areas: Firstly, VHIVE investigated visually-induced perceptual illusions for virtual reality (VR) interaction with a special focus on the two enabling techniques of hand redirection (HR) and pseudohaptic feedback. HR techniques let the VR system control the user’s physical hand movement during interaction without the user noticing it. This facilitates interaction with haptic props. In this context, the VHIVE project introduced novel HR techniques that take advantage of change blindness during eye blinks and saccades to disguise manipulations. In several psychophysical experiments we investigated the detectability of such techniques and demonstrated their advantages over conventional HR. Similarly, pseudo-haptic feedback methods covertly manipulate virtual interactions to convey haptic impressions. Here, we performed perceptual experiments investigating how users perceive simulated object weight and stiffness. Secondly, the VHIVE project explored how hand-based interactions can be improved through passive and active haptic feedback. We explored how audio-based vibrotactile feedback, tapping sensations, and tendon electrical stimulation (TES) can boost the haptic fidelity of handbased interactions in VR. We also contributed to the field of prop-based haptics by reviewing the challenges inherent to this concept and by presenting a novel taxonomy classifying solutions to these challenges. We further investigated novel concepts for surfaces of haptic props based on metamaterials and explored the potential of using everyday objects as props in VR. Finally, we considered crossmodal VR interaction using multiple feedback channels. To this end, we explored the value of combining active and prop-based haptics with visual illusions like HR and pseudo-haptics. Our results highlight the benefits of combined methods for enhancing the fidelity of interactions with user interface elements in VR, and for conveying properties like weight and balance during hand-based interactions with virtual objects.

Publications

 
 

Additional Information

© 2026 DFG Disclaimer / Copyright / Privacy Policy

Textvergrößerung und Kontrastanpassung