Logo image
Differential prefrontal response during natural and synthetic speech perception: An fNIR based neuroergonomics study
Book chapter

Differential prefrontal response during natural and synthetic speech perception: An fNIR based neuroergonomics study

Hasan Ayaz, Paul Crawford, Adrian Curtin, Mashaal Syed, Banu Onaral, Willem M. Beltman and Patricia A. Shewokis
Foundations of Augmented Cognition - 7th International Conference, AC 2013, Held as Part of HCI International 2013, Proceedings, v 8027, pp 241-249
2013

Abstract

auditory processing fNIR functional near infrared spectroscopy Optical Brain Imaging perception synthetic speech
Synthetic speech has a growing role in human computer interaction and automated systems with the emergence of ubiquitous computing such as smart phones, car multimedia control and navigation systems. Cognitive processing costs associated with comprehension of synthetic speech relative to comprehension of natural speech have been demonstrated with behavioral (reaction time, accuracy, etc.) and self-reported (ratings, etc.) measures. In this neuroergonomics study, we have used optical brain imaging (fNIR: functional near infrared spectroscopy) to capture the brain activation of participants while they were listening to speech with varied quality, as well as natural speech. Results indicated a differential hemodynamic response with speech quality. As fNIR systems are safe, portable and record brain activation in real world settings, fNIR is a practical and minimally intrusive assessment tool for user experience researchers and can provide an objective metric for the design and development of next generation synthetic speech systems.

Metrics

8 Record Views
3 citations in Scopus

Details

Logo image