Conference proceeding
A Differentiable Acoustic Guitar Model for String-Specific Polyphonic Synthesis
2023 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), pp 1-5
22 Oct 2023
Featured in Collection : UN Sustainable Development Goals @ Drexel
Abstract
We introduce a differentiable model for acoustic guitar synthesis. The model takes in a MIDI-like conditioning representation, in which the guitar string for each note is specified, and synthesizes polyphonic audio. We employ a Differentiable Digital Signal Processing (DDSP) -style monophonic synthesis module, in which parameters are predicted that drive inharmonic oscillator and filtered noise synthesizer modules. Our monophonic synth is conditioned on a guitar string index, so 6 individual string audio signals are produced, summed, and fed through a trainable reverb to produce the final polyphonic audio. We train our synthesizer using data from the GuitarSet dataset and observe that the output audio is expressive and reflects the timbre and recording environment of the target instrument from the dataset. We conduct a listening test and evaluate the synthesizer's ability to reconstruct unseen audio, comparing against an off-the-shelf acoustic guitar synthesizer, and a sample-bank synthesizer constructed from excerpts from GuitarSet. Additionally, we demonstrate how synthesized audio can be modified to vary parameters from the performance, including simulating use of a capo and alternate fretboard positioning.
Metrics
Details
- Title
- A Differentiable Acoustic Guitar Model for String-Specific Polyphonic Synthesis
- Creators
- Andrew Wiggins - Drexel UniversityYoungmoo Kim - Drexel University
- Publication Details
- 2023 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), pp 1-5
- Conference
- 2023 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) (New Paltz, New York United States, 22 Oct 2023–25 Oct 2023)
- Publisher
- IEEE
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- Electrical and Computer Engineering
- Web of Science ID
- WOS:001073615200062
- Scopus ID
- 2-s2.0-85173042345
- Other Identifier
- 991021227641304721
UN Sustainable Development Goals (SDGs)
This publication has contributed to the advancement of the following goals:
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Web of Science research areas
- Acoustics
- Engineering, Electrical & Electronic