English
Related papers

Related papers: Transfer Learning for Improving Singing-voice Dete…

200 papers

This paper presents a benchmark for singing voice enhancement. The development of singing voice enhancement is limited by the lack of realistic evaluation data. To address this gap, this paper introduces SingVERSE, the first real-world…

Sound · Computer Science 2025-09-26 Shaohan Jiang , Junan Zhang , Yunjia Zhang , Jing Yang , Fan Fan , Zhizheng Wu

Music information retrieval is currently an active research area that addresses the extraction of musically important information from audio signals, and the applications of such information. The extracted information can be used for search…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-08 Preeti Rao

The rapid advancement of AI-generated singing voices, which now closely mimic natural human singing and align seamlessly with musical scores, has led to heightened concerns for artists and the music industry. Unlike spoken voice, singing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-09 You Zhang , Yongyi Zang , Jiatong Shi , Ryuichi Yamamoto , Jionghao Han , Yuxun Tang , Tomoki Toda , Zhiyao Duan

Vocal Percussion Transcription (VPT) is concerned with the automatic detection and classification of vocal percussion sound events, allowing music creators and producers to sketch drum lines on the fly. Classifier algorithms in VPT systems…

Sound · Computer Science 2022-04-12 Alejandro Delgado , Emir Demirel , Vinod Subramanian , Charalampos Saitis , Mark Sandler

In this progress paper the previous results of the single note recognition by deep learning are presented. The several ways for data augmentation and "artificial semantic" augmentation are proposed to enhance efficiency of deep learning…

The Complete Vocal Technique (CVT) is a school of singing developed in the past decades by Cathrin Sadolin et al.. CVT groups the use of the voice into so called vocal modes, namely Neutral, Curbing, Overdrive and Edge. Knowledge of the…

Sound · Computer Science 2026-04-30 Reemt Hinrichs , Sonja Stephan , Alexander Lange , Jörn Ostermann

Singing Voice Conversion (SVC) aims to transform a source singing voice into a target singer while preserving lyrics and melody. Most existing SVC methods depend on F0 extractors to capture the lead melody from clean vocals. However, no…

Sound · Computer Science 2026-05-13 Chen Geng , Meng Chen , Ruohua Zhou , Ruolan Liu , Weifeng Zhao

This paper proposes singing voice synthesis (SVS) based on frame-level sequence-to-sequence models considering vocal timing deviation. In SVS, it is essential to synchronize the timing of singing with temporal structures represented by…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-23 Miku Nishihara , Yukiya Hono , Kei Hashimoto , Yoshihiko Nankaku , Keiichi Tokuda

Animal sounds can be recognised automatically by machine learning, and this has an important role to play in biodiversity monitoring. Yet despite increasingly impressive capabilities, bioacoustic species classifiers still exhibit imbalanced…

Transfer learning is an important step to extract meaningful features and overcome the data limitation in the medical Visual Question Answering (VQA) task. However, most of the existing medical VQA methods rely on external data for transfer…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Tuong Do , Binh X. Nguyen , Erman Tjiputra , Minh Tran , Quang D. Tran , Anh Nguyen

Data synthesis and augmentation are essential for Sound Event Detection (SED) due to the scarcity of temporally labeled data. While augmentation methods like SpecAugment and Mix-up can enhance model performance, they remain constrained by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Jiarui Hai , Mounya Elhilali

Singing techniques are used for expressive vocal performances by employing temporal fluctuations of the timbre, the pitch, and other components of the voice. Their classification is a challenging task, because of mainly two factors: 1) the…

Sound · Computer Science 2022-06-27 Yuya Yamamoto , Juhan Nam , Hiroko Terasawa

Automatic accent identification (AID) remains a challenging task due to the complex variability of accents, the entanglement of accent cues with speaker traits, and the scarcity of reliable accentlabelled data. To address these challenges,…

Signal Processing · Electrical Eng. & Systems 2026-04-29 Rayane Bakari , Olivier Le Blouch , Nicolas Gengembre , Nicholas Evans

To train transcriptor models that produce robust results, a large and diverse labeled dataset is required. Finding such data with the necessary characteristics is a challenging task, especially for languages less popular than English.…

Sound · Computer Science 2026-05-01 Alexandre R. Ferreira , Cláudio E. C. Campelo

Music emotion recognition (MER) aims to identify the emotions conveyed in a given musical piece. However, currently, in the field of MER, the available public datasets have limited sample sizes. Recently, segment-based methods for…

Sound · Computer Science 2025-04-23 Yifu Sun , Xulong Zhang , Monan Zhou , Wei Li

Reverb plays a critical role in music production, where it provides listeners with spatial realization, timbre, and texture of the music. Yet, it is challenging to reproduce the musical reverb of a reference music track even by skilled…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-04 Junghyun Koo , Seungryeol Paik , Kyogu Lee

Lyrics transcription of polyphonic music is challenging because singing vocals are corrupted by the background music. To improve the robustness of lyrics transcription to the background music, we propose a strategy of combining the features…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-25 Xiaoxue Gao , Chitralekha Gupta , Haizhou Li

Tracking beats of singing voices without the presence of musical accompaniment can find many applications in music production, automatic song arrangement, and social media interaction. Its main challenge is the lack of strong rhythmic and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-01 Mojtaba Heydari , Zhiyao Duan

Singing voice conversion is converting the timbre in the source singing to the target speaker's voice while keeping singing content the same. However, singing data for target speaker is much more difficult to collect compared with normal…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Liqiang Zhang , Chengzhu Yu , Heng Lu , Chao Weng , Chunlei Zhang , Yusong Wu , Xiang Xie , Zijin Li , Dong Yu

Existing singing voice synthesis (SVS) models largely rely on fine-grained, phoneme-level durations, which limits their practical application. These methods overlook the complementary role of visual information in duration prediction.To…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Ke Gu , Zhicong Wu , Peng Bai , Sitong Qiao , Zhiqi Jiang , Junchen Lu , Xiaodong Shi , Xinyuan Qian