Conference proceeding
Multidimensional Gesture Sensing at the Piano Keyboard
29TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, pp 2789-2798
01 Jan 2011
Featured in Collection : UN Sustainable Development Goals @ Drexel
Abstract
In this paper we present a new keyboard interface for computer music applications. Where traditional keyboard controllers report the velocity of each key-press, our interface senses up to five separate dimensions: velocity, percussiveness, rigidity, weight, and depth. These dimensions, which we identified based on the pedagogical piano literature and pilot studies with professional pianists, together present a rich picture of physical gestures at the keyboard, including information on the performer's motion before, during, and after a note is played. User studies confirm that the sensed dimensions are intuitive and controllable and that mappings between gesture and sound produce novel, playable musical instruments, even for users without prior keyboard experience. The multidimensional sensing capability demonstrated in this paper is also potentially applicable to button interfaces outside the musical domain.
Metrics
Details
- Title
- Multidimensional Gesture Sensing at the Piano Keyboard
- Creators
- Andrew P. McPherson - Drexel UniversityYoungmoo E. Kim - Drexel UniversityACM
- Publication Details
- 29TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, pp 2789-2798
- Conference
- 29TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 29th
- Publisher
- Assoc Computing Machinery
- Number of pages
- 10
- Grant note
- 0937060 / National Science Foundation; National Science Foundation (NSF)
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- Electrical and Computer Engineering
- Web of Science ID
- WOS:000395171602107
- Scopus ID
- 2-s2.0-79958152377
- Other Identifier
- 991019170323304721
UN Sustainable Development Goals (SDGs)
This publication has contributed to the advancement of the following goals:
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Web of Science research areas
- Computer Science, Information Systems
- Computer Science, Theory & Methods