Files and links (1)
PDFOpen Access (License Unspecified), Open Access
Thesis
Acoustic Signal Classification in Underwater and Air Environments: Leveraging Transformer Architecture and Knowledge Distillation
Master of Science (M.S.), Drexel University
Jun 2023
DOI:
https://doi.org/10.17918/00001744
Abstract
Identifying various acoustic sources can be challenging in both air and underwater settings. This is largely due to the difficulties in data collection, especially in ocean environments, and the variety of background noise they pose. Transformer architecture with self-attention mechanism has proven effective across various machine learning tasks, such as Natural Language Processing (NLP) and image recognition, even in challenging environments. This thesis presents the applications of Transformer in both air and underwater domains. In the air, we developed a Hierarchical Knowledge Distillation (H-KD) framework that utilized the Audio Spectrogram Transformer (AST) [1] architecture as a teacher model. The framework was designed using a multi-stage learning approach and cross-model integration to enhance performance of a low complexity Convolutional Neural Networks (CNN) student model. We applied it to an air acoustic dataset - TAU Urban Acoustic Scenes 2023 Mobile development [2] and demonstrated that it achieved a significantly improved performance compared to the Baseline system [3]. After verifying the model on publicly available datasets, our proposed model was submitted to the 2023 IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events (DCASE2023) [3]. In the underwater acoustic signals experiment, we modified and adapted the Hierarchical Token Semantic - Audio Transformer (HTS-AT) [4] architecture to make it better suited underwater environments. We applied it to an underwater acoustic dataset - shipsEar [5] and demonstrated that our proposed method outperformed some of the latest classification methods. The promising results obtained motivate further exploration of Transformer-based approaches in future research to advance the state-of-the-art (SOTA) in Acoustic Signal Classifications (ASC).
Metrics
88 File views/ downloads
123 Record Views
Details
- Title
- Acoustic Signal Classification in Underwater and Air Environments
- Creators
- Quoc Thinh Vo
- Contributors
- David Han (Advisor)
- Awarding Institution
- Drexel University
- Degree Awarded
- Master of Science (M.S.)
- Publisher
- Drexel University; Philadelphia, Pennsylvania
- Number of pages
- ix, 36 pages
- Resource Type
- Thesis
- Language
- English
- Academic Unit
- College of Engineering (1970-2026); Electrical (and Computer) Engineering [Historical]; Drexel University
- Other Identifier
- 991021212415104721