Logo image
Interactive AR experiences as training applications: guidelines and requirements for piano pedagogy in mixed reality
Thesis   Open access

Interactive AR experiences as training applications: guidelines and requirements for piano pedagogy in mixed reality

Amare Birhanu
Master of Science (M.S.), Drexel University
Jun 2017
DOI:
https://doi.org/10.17918/etd-7417
pdf
Birhanu_Amare_201710.74 MBDownloadView

Abstract

Digital media Mixed reality Augmented Reality
In this thesis, we analyze research regarding augmented reality (AR) and its use as an educational and training tool, for piano pedagogy specifically. Several exiting systems involve the use of AR in training and educational scenarios. The effectiveness of any one system varies based on the learning environment and how the technology is being used in a given scenario. Integrating new technology with learning environ-ments is not a simple process and if the technology is used in an ineffective way it can hinder the learning experience. To prevent this, it is important to have a comprehensive understanding of the users' needs as well as an argument as to why the technology will aid in the learning process. In order to work towards such an understanding and argument with respect to piano pedagogy, focusing on notation literacy, and Augmented Reality, we designed and implemented a series of prototypes of a piano training application called KeynVision (keen-vision) for the Microsoft Hololens. The design goal was to explore the introduction of octave scales, chords, and arpeggios to beginners while also improving their note literacy. The design of the developed prototypes was evaluated by an iterative playtesting process with a panel of experts and practitioners in piano pedagogy. By utilizing the benefits of augmented contextualization that mixed reality experiences provide, we created prototypes of an application that can meet the requirements needed to effectively aid students in the process of learning with beginner's exercises. Based on our research and the results of the expert panel, we believe that AR can be an effective tool for aiding students in the process of learning new tasks such as playing piano.

Metrics

57 File views/ downloads
51 Record Views

Details

Logo image