Conference proceeding
Instructing people for training gestural interactive systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp 1737-1746
05 May 2012
Abstract
Entertainment and gaming systems such as the Wii and XBox Kinect have brought touchless, body-movement based interfaces to the masses. Systems like these enable the estimation of movements of various body parts from raw inertial motion or depth sensor data. However, the interface developer is still left with the challenging task of creating a system that recognizes these movements as embodying meaning. The machine learning approach for tackling this problem requires the collection of data sets that contain the relevant body movements and their associated semantic labels. These data sets directly impact the accuracy and performance of the gesture recognition system and should ideally contain all natural variations of the movements associated with a gesture. This paper addresses the problem of collecting such gesture datasets. In particular, we investigate the question of what is the most appropriate semiotic modality of instructions for conveying to human subjects the movements the system developer needs them to perform. The results of our qualitative and quantitative analysis indicate that the choice of modality has a significant impact on the performance of the learnt gesture recognition system; particularly in terms of correctness and coverage.
Metrics
7 Record Views
323 citations in Scopus
Details
- Title
- Instructing people for training gestural interactive systems
- Creators
- Simon Fothergill - University of CambridgeHelena Mentis - Microsoft ResearchPushmeet Kohli - Microsoft ResearchSebastian Nowozin - Microsoft Research
- Publication Details
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp 1737-1746
- Conference
- CHI '12: CHI Conference on Human Factors in Computing Systems
- Series
- ACM Conferences
- Publisher
- ACM
- Number of pages
- 10
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- Information Science (Informatics)
- Scopus ID
- 2-s2.0-84862069071
- Other Identifier
- 991021916802504721