Logo image
Analyzing the Perceptual Salience of Audio Features for Musical Emotion Recognition
Conference proceeding   Peer reviewed

Analyzing the Perceptual Salience of Audio Features for Musical Emotion Recognition

Erik M. Schmidt, Matthew Prockup, Jeffrey Scott, Brian Dolhansky, Brandon G. Morton and Youngmoo E. Kim
FROM SOUNDS TO MUSIC AND EMOTIONS, v 7900
01 Jan 2013

Abstract

Arts & Humanities Computer Science Computer Science, Information Systems Computer Science, Interdisciplinary Applications Computer Science, Theory & Methods Music Science & Technology Technology
While the organization of music in terms of emotional affect is a natural process for humans, quantifying it empirically proves to be a very difficult task. Consequently, no acoustic feature (or combination thereof) has emerged as the optimal representation for musical emotion recognition. Due to the subjective nature of emotion, determining whether an acoustic feature domain is informative requires evaluation by human subjects. In this work, we seek to perceptually evaluate two of the most commonly used features in music information retrieval: mel-frequency cepstral coefficients and chroma. Furthermore, to identify emotion-informative feature domains, we explore which musical features are most relevant in determining emotion perceptually, and which acoustic feature domains are most variant or invariant to those changes. Finally, given our collected perceptual data, we conduct an extensive computational experiment for emotion prediction accuracy on a large number of acoustic feature domains, investigating pairwise prediction both in the context of a general corpus as well as in the context of a corpus that is constrained to contain only specific musical feature transformations.

Metrics

17 Record Views

Details

UN Sustainable Development Goals (SDGs)

This publication has contributed to the advancement of the following goals:

#4 Quality Education

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Collaboration types
Domestic collaboration
Web of Science research areas
Computer Science, Information Systems
Computer Science, Interdisciplinary Applications
Computer Science, Theory & Methods
Music
Logo image