Logo image
Decoding multiple sound categories in the human temporal cortex using high resolution fMRI
Journal article   Open access   Peer reviewed

Decoding multiple sound categories in the human temporal cortex using high resolution fMRI

Fengqing Zhang, Ji-Ping Wang, Jieun Kim, Todd Parrish and Patrick C M Wong
PloS one, v 10(2), pp e0117303-e0117303
2015
PMID: 25692885
url
https://doi.org/10.1371/journal.pone.0117303View
Published, Version of Record (VoR)CC BY V4.0 Open

Abstract

Auditory Cortex - physiology Auditory Perception - physiology Brain Mapping Female Humans Image Processing, Computer-Assisted Magnetic Resonance Imaging Male Multivariate Analysis Pattern Recognition, Automated Sound Support Vector Machine Temporal Lobe - physiology Young Adult
Perception of sound categories is an important aspect of auditory perception. The extent to which the brain's representation of sound categories is encoded in specialized subregions or distributed across the auditory cortex remains unclear. Recent studies using multivariate pattern analysis (MVPA) of brain activations have provided important insights into how the brain decodes perceptual information. In the large existing literature on brain decoding using MVPA methods, relatively few studies have been conducted on multi-class categorization in the auditory domain. Here, we investigated the representation and processing of auditory categories within the human temporal cortex using high resolution fMRI and MVPA methods. More importantly, we considered decoding multiple sound categories simultaneously through multi-class support vector machine-recursive feature elimination (MSVM-RFE) as our MVPA tool. Results show that for all classifications the model MSVM-RFE was able to learn the functional relation between the multiple sound categories and the corresponding evoked spatial patterns and classify the unlabeled sound-evoked patterns significantly above chance. This indicates the feasibility of decoding multiple sound categories not only within but across subjects. However, the across-subject variation affects classification performance more than the within-subject variation, as the across-subject analysis has significantly lower classification accuracies. Sound category-selective brain maps were identified based on multi-class classification and revealed distributed patterns of brain activity in the superior temporal gyrus and the middle temporal gyrus. This is in accordance with previous studies, indicating that information in the spatially distributed patterns may reflect a more abstract perceptual level of representation of sound categories. Further, we show that the across-subject classification performance can be significantly improved by averaging the fMRI images over items, because the irrelevant variations between different items of the same sound category are reduced and in turn the proportion of signals relevant to sound categorization increases.

Metrics

5 Record Views
19 citations in Scopus

Details

UN Sustainable Development Goals (SDGs)

This publication has contributed to the advancement of the following goals:

#3 Good Health and Well-Being

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Collaboration types
Domestic collaboration
International collaboration
Web of Science research areas
Neurosciences
Logo image