FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined Spaces

Wen-Jie Tseng (1, 2, 3, 4) , Samuel Huron (1, 2, 5, 6) , Eric Lecolinet (1, 2, 3, 4) , Jan Gugenheimer (1, 2, 3, 4, 7)

1 Télécom Paris
2 IP Paris - Institut Polytechnique de Paris
3 DIVA - Design, Interaction, Visualization & Applications
4 INFRES - Département Informatique et Réseaux
5 INTERACT - Interaction, Technologies, Activités
6 SES - Département Sciences Economiques et Sociales
7 Department of Computer Science, TU Darmstadt

Whole-body movements enhance the presence and enjoyment of Virtual Reality (VR) experiences. However, using large gestures is often uncomfortable and impossible in confined spaces (e.g., public transport). We introduce FingerMapper, mapping small-scale finger motions onto virtual arms and hands to enable whole-body virtual movements in VR. In a first target selection study (n=13) comparing FingerMapper to hand tracking and ray-casting, we found that FingerMapper can significantly reduce physical motions and fatigue while having a similar degree of precision. In a consecutive study (n=13), we compared FingerMapper to hand tracking inside a confined space (the front passenger seat of a car). The results showed participants had significantly higher perceived safety and fewer collisions with FingerMapper while preserving a similar degree of presence and enjoyment as hand tracking. Finally, we present three example applications demonstrating how FingerMapper could be applied for locomotion and interaction for VR in confined spaces.

Keywords: FingerMapper; Confined Spaces; Body Re-Association in VR

Domains: Computer Science [cs]

Wen-Jie Tseng, Samuel Huron, Eric Lecolinet, Jan Gugenheimer. FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined Spaces. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), Apr 2023, Hamburg, Germany. ⟨10.1145/3544548.3580736⟩. ⟨hal-04001768⟩