Dr. Daniel Harley, GI faculty member and Assistant Professor at the Stratford School of Interaction Design and Business, co-authored “Playing by Ear: Designing for the Physical in a Sound-Based Virtual Reality Narrative” with Aneesh P. Tarun, Bonnie J. Stinson, Tudor Tibu, and Ali Mazalek.
Published in the Association for Computing Machinery’s Tangible and Embedded Interaction Conference proceedings, the article explores how to extend the design space for virtual reality (VR) by creating sensory experiences beyond those provided by the system. Using a research through design approach and a user study, the authors developed two narrative VR experiences to explore physical and sound-based interactions within VR.
“For us, prioritizing the physical helped to draw links between current VR design and prior work that considers physical-digital interactions and spaces,” note the authors. “Rather than ask what the physical might add to VR, we asked what VR might add to a physical interaction.”
“We propose that a focus on the actions the player is asked to perform (e.g., touch, stand, kneel, grasp, walk, listen, reach, dance) can contribute to an understanding of VR as a sensory, embodied medium that offers ways to playfully engage with physical reality rather than simulate it entirely."
- Harley, Tarun, Stinson, Tibu, and Mazalek.