English
Related papers

Related papers: A Semantic Timbre Dataset for the Electric Guitar

200 papers

We propose an audio effects processing framework that learns to emulate a target electric guitar tone from a recording. We train a deep neural network using an adversarial approach, with the goal of transforming the timbre of a guitar, into…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-21 Alec Wright , Vesa Välimäki , Lauri Juvela

Guitar tablature transcription is an important but understudied problem within the field of music information retrieval. Traditional signal processing approaches offer only limited performance on the task, and there is little acoustic data…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-19 Frank Cwitkowitz , Jonathan Driedger , Zhiyao Duan

Concept-based interpretability methods like TCAV require clean, well-separated positive and negative examples for each concept. Existing music datasets lack this structure: tags are sparse, noisy, or ill-defined. We introduce ConceptCaps, a…

Sound · Computer Science 2026-02-05 Bruno Sienkiewicz , Łukasz Neumann , Mateusz Modrzejewski

Timbre and pitch are the two main perceptual properties of musical sounds. Depending on the target applications, we sometimes prefer to focus on one of them, while reducing the effect of the other. Researchers have managed to hand-craft…

Sound · Computer Science 2018-11-09 Yun-Ning Hung , Yi-An Chen , Yi-Hsuan Yang

While sparse autoencoders (SAEs) successfully extract interpretable features from language models, applying them to audio generation faces unique challenges: audio's dense nature requires compression that obscures semantic meaning, and…

Machine Learning · Computer Science 2025-10-31 Nathan Paek , Yongyi Zang , Qihui Yang , Randal Leistikow

This research project investigates the application of deep learning to timbre transfer, where the timbre of a source audio can be converted to the timbre of a target audio with minimal loss in quality. The adopted approach combines…

Sound · Computer Science 2021-10-12 Russell Sammut Bonnici , Charalampos Saitis , Martin Benning

This paper presents a novel approach to neural instrument sound synthesis using a two-stage semi-supervised learning framework capable of generating pitch-accurate, high-quality music samples from an expressive timbre latent space. Existing…

Sound · Computer Science 2025-10-07 Christian Limberg , Fares Schulz , Zhe Zhang , Stefan Weinzierl

Timbre allows us to distinguish between sounds even when they share the same pitch and loudness, playing an important role in music, instrument recognition, and speech. Traditional approaches, such as frequency analysis or machine learning,…

Sound · Computer Science 2026-02-05 Gakusei Sato , Hiroya Nakao , Riccardo Muolo

In this paper, we propose a musical instrument sound synthesis (MISS) method based on a variational autoencoder (VAE) that has a hierarchy-inducing latent space for timbre. VAE-based MISS methods embed an input signal into a low-dimensional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-05 Futa Nakashima , Tomohiko Nakamura , Norihiro Takamune , Satoru Fukayama , Hiroshi Saruwatari

With the advent of data-driven statistical modeling and abundant computing power, researchers are turning increasingly to deep learning for audio synthesis. These methods try to model audio signals directly in the time or frequency domain.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-13 Krishna Subramani , Preeti Rao , Alexandre D'Hooge

The first voice timbre attribute detection challenge is featured in a special session at NCMMSC 2025. It focuses on the explainability of voice timbre and compares the intensity of two speech utterances in a specified timbre descriptor…

Sound · Computer Science 2025-09-09 Liping Chen , Jinghao He , Zhengyan Sheng , Kong Aik Lee , Zhen-Hua Ling

In this paper, we propose a new dataset named EGDB, that con-tains transcriptions of the electric guitar performance of 240 tab-latures rendered with different tones. Moreover, we benchmark theperformance of two well-known transcription…

Sound · Computer Science 2022-02-22 Yu-Hua Chen , Wen-Yi Hsiao , Tsu-Kuang Hsieh , Jyh-Shing Roger Jang , Yi-Hsuan Yang

Guitar tablature is a form of music notation widely used among guitarists. It captures not only the musical content of a piece, but also its implementation and ornamentation on the instrument. Guitar Tablature Transcription (GTT) is an…

Sound · Computer Science 2025-05-27 Yongyi Zang , Yi Zhong , Frank Cwitkowitz , Zhiyao Duan

Generative models have been successfully applied to image style transfer and domain translation. However, there is still a wide gap in the quality of results when learning such tasks on musical audio. Furthermore, most translation models…

Sound · Computer Science 2018-10-02 Adrien Bitton , Philippe Esling , Axel Chemla-Romeu-Santos

Speaker recognition is an active research area that contains notable usage in biometric security and authentication system. Currently, there exist many well-performing models in the speaker recognition domain. However, most of the advanced…

Voice Timbre Attribute Detection (vTAD) plays a pivotal role in fine-grained timbre modeling for speech generation tasks. However, it remains challenging due to the inherently subjective nature of timbre descriptors and the severe label…

Sound · Computer Science 2025-08-25 Zhiyu Wu , Jingyi Fang , Yufei Tang , Yuanzhong Zheng , Yaoxuan Wang , Haojun Fei

The research in Deep Learning applications in sound and music computing have gathered an interest in the recent years; however, there is still a missing link between these new technologies and on how they can be incorporated into real-world…

Sound · Computer Science 2023-06-21 Kıvanç Tatar , Kelsey Cotton , Daniel Bisig

We propose a unified model for three inter-related tasks: 1) to \textit{separate} individual sound sources from a mixed music audio, 2) to \textit{transcribe} each sound source to MIDI notes, and 3) to\textit{ synthesize} new pieces based…

Sound · Computer Science 2021-08-10 Liwei Lin , Qiuqiang Kong , Junyan Jiang , Gus Xia

Neural audio synthesis is an actively researched topic, having yielded a wide range of techniques that leverages machine learning architectures. Google Magenta elaborated a novel approach called Differential Digital Signal Processing (DDSP)…

Modeling of music audio semantics has been previously tackled through learning of mappings from audio data to high-level tags or latent unsupervised spaces. The resulting semantic spaces are theoretically limited, either because the chosen…

Information Retrieval · Computer Science 2017-12-18 Francisco Raposo , David Martins de Matos , Ricardo Ribeiro , Suhua Tang , Yi Yu