Files and links (1)
PDFOpen Access (License Unspecified), Open Access
Thesis
Responsive audio feedback for hand gesture interaction to enhance immersion in audio-only games
Master of Science (M.S.), Drexel University
01 May 2015
DOI:
https://doi.org/10.17918/etd-6521
Abstract
This thesis investigates different audio feedback designs for touch-less hand gesture interaction to enhance immersion and encourage intuitive user participation in audio-only environments. In particular, we aim to assess whether replacing explicit audio instructions for hand positions and movements with responsive audio feedback using environmental story-related audio cues that are suggestive of interaction methods leads to measurably higher immersion. The potential of using audio cues as feedback to improve the responsiveness of touch-less gesture interaction has been an active topic of study. We focus on methods for effectively informing players about gesture interaction methods through audio cues without breaking game immersion. As part of our research, we developed a framework for hand gesture detection based on the Leap Motion hardware and software. We also present a design approach for audio feedback that considers three stages, before, during and after a gesture sequence, and proposes corresponding design principles. In order to test different audio designs and support our hypothesis, two game versions using non-diegetic or diegetic audio feedback were created as testbeds for a between-subjects study. The study found that the version using environmental feedback led to higher immersion in terms of story and was consistently rated higher. In particular, compared to explicit vocal instructions, environmental story-related audio cues were found to be more helpful in guiding gesture interaction and in enhancing how real the game feels.
Metrics
38 File views/ downloads
33 Record Views
Details
- Title
- Responsive audio feedback for hand gesture interaction to enhance immersion in audio-only games
- Creators
- Wenjie Wu - DU
- Contributors
- Stefan Rank (Advisor) - Drexel University (1970-)
- Awarding Institution
- Drexel University
- Degree Awarded
- Master of Science (M.S.)
- Publisher
- Drexel University; Philadelphia, Pennsylvania
- Resource Type
- Thesis
- Language
- English
- Academic Unit
- Digital Media; Drexel University; Antoinette Westphal College of Media Arts and Design
- Other Identifier
- 6521; 991014632417404721