English
Related papers

Related papers: WeSinger: Data-augmented Singing Voice Synthesis w…

200 papers

Singing voice synthesis (SVS) has seen remarkable advancements in recent years. However, compared to speech and general audio data, publicly available singing datasets remain limited. In practice, this data scarcity often leads to…

Sound · Computer Science 2025-12-17 Yiwen Zhao , Jiatong Shi , Yuxun Tang , William Chen , Shinji Watanabe

In this paper, we propose MakeSinger, a semi-supervised training method for singing voice synthesis (SVS) via classifier-free diffusion guidance. The challenge in SVS lies in the costly process of gathering aligned sets of text, pitch, and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-11 Semin Kim , Myeonghun Jeong , Hyeonseung Lee , Minchan Kim , Byoung Jin Choi , Nam Soo Kim

This paper presents an advanced end-to-end singing voice synthesis (SVS) system based on the source-filter mechanism that directly translates lyrical and melodic cues into expressive and high-fidelity human-like singing. Similarly to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-17 Jianwei Cui , Yu Gu , Chao Weng , Jie Zhang , Liping Chen , Lirong Dai

While recent years have witnessed rapid progress in speech synthesis, open-source singing voice synthesis (SVS) systems still face significant barriers to industrial deployment, particularly in terms of robustness and zero-shot…

High-fidelity singing voices usually require higher sampling rate (e.g., 48kHz) to convey expression and emotion. However, higher sampling rate causes the wider frequency band and longer waveform sequences and throws challenges for singing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-04 Jiawei Chen , Xu Tan , Jian Luan , Tao Qin , Tie-Yan Liu

This paper presents XiaoiceSing, a high-quality singing voice synthesis system which employs an integrated network for spectrum, F0 and duration modeling. We follow the main architecture of FastSpeech while proposing some singing-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-12 Peiling Lu , Jie Wu , Jian Luan , Xu Tan , Li Zhou

It is challenging to build a multi-singer high-fidelity singing voice synthesis system with cross-lingual ability by only using monolingual singers in the training stage. In this paper, we propose CrossSinger, which is a cross-lingual…

Sound · Computer Science 2023-09-25 Xintong Wang , Chang Zeng , Jun Chen , Chunhui Wang

Singing voice synthesis has made remarkable progress in generating natural and high-quality voices. However, existing methods rarely provide precise control over vocal techniques such as intensity, mixed voice, falsetto, bubble, and breathy…

Sound · Computer Science 2025-04-22 Wenxiang Guo , Yu Zhang , Changhao Pan , Rongjie Huang , Li Tang , Ruiqi Li , Zhiqing Hong , Yongqi Wang , Zhou Zhao

Zero-shot singing voice synthesis (SVS) with style transfer and style control aims to generate high-quality singing voices with unseen timbres and styles (including singing method, emotion, rhythm, technique, and pronunciation) from audio…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-02 Yu Zhang , Ziyue Jiang , Ruiqi Li , Changhao Pan , Jinzheng He , Rongjie Huang , Chuxin Wang , Zhou Zhao

Singing voice synthesis (SVS) aims to generate natural and expressive singing waveforms from symbolic musical scores. In cVAE-based SVS, however, a mismatch arises because the decoder is trained with latent representations inferred from…

Sound · Computer Science 2026-03-16 Minhyeok Yun , Yong-Hoon Choi

The single-speaker singing voice synthesis (SVS) usually underperforms at pitch values that are out of the singer's vocal range or associated with limited training samples. Based on our previous work, this work proposes a…

Sound · Computer Science 2023-09-04 Shaohuan Zhou , Xu Li , Zhiyong Wu , Ying Shan , Helen Meng

In singing voice synthesis (SVS), generating singing voices from musical scores faces challenges due to limited data availability. This study proposes a unique strategy to address the data scarcity in SVS. We employ an existing singing…

Sound · Computer Science 2024-06-14 Jiatong Shi , Yueqian Lin , Xinyi Bai , Keyi Zhang , Yuning Wu , Yuxun Tang , Yifeng Yu , Qin Jin , Shinji Watanabe

This paper describes the design of NNSVS, an open-source software for neural network-based singing voice synthesis research. NNSVS is inspired by Sinsy, an open-source pioneer in singing voice synthesis research, and provides many…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-02 Ryuichi Yamamoto , Reo Yoneyama , Tomoki Toda

The purpose of this study is to investigate how humans interpret musical scores expressively, and then design machines that sing like humans. We consider six factors that have a strong influence on the expression of human singing. The…

Sound · Computer Science 2015-02-17 Ju-Chiang Wang , Hung-Yan Gu , Hsin-Min Wang

Singing Voice Synthesis (SVS) aims to generate singing voices of high fidelity and expressiveness. Conventional SVS systems usually utilize an acoustic model to transform a music score into acoustic features, followed by a vocoder to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-16 Jianwei Cui , Yu Gu , Shihao Chen , Jie Zhang , Liping Chen , Lirong Dai

Recent singing-voice-synthesis (SVS) methods have achieved remarkable audio quality and naturalness, yet they lack the capability to control the style attributes of the synthesized singing explicitly. We propose Prompt-Singer, the first SVS…

Sound · Computer Science 2025-01-07 Yongqi Wang , Ruofan Hu , Rongjie Huang , Zhiqing Hong , Ruiqi Li , Wenrui Liu , Fuming You , Tao Jin , Zhou Zhao

This paper proposes singing voice synthesis (SVS) based on frame-level sequence-to-sequence models considering vocal timing deviation. In SVS, it is essential to synchronize the timing of singing with temporal structures represented by…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-23 Miku Nishihara , Yukiya Hono , Kei Hashimoto , Yoshihiko Nankaku , Keiichi Tokuda

This paper presents a high quality singing synthesizer that is able to model a voice with limited available recordings. Based on the sequence-to-sequence singing model, we design a multi-singer framework to leverage all the existing singing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-19 Jie Wu , Jian Luan

We investigate the feasibility of a singing voice synthesis (SVS) system by using a decomposed framework to improve flexibility in generating singing voices. Due to data-driven approaches, SVS performs a music score-to-waveform mapping;…

Sound · Computer Science 2024-07-15 Lester Phillip Violeta , Taketo Akama

Customizable multilingual zero-shot singing voice synthesis (SVS) has various potential applications in music composition and short video dubbing. However, existing SVS models overly depend on phoneme and note boundary annotations, limiting…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-22 Yu Zhang , Wenxiang Guo , Changhao Pan , Dongyu Yao , Zhiyuan Zhu , Ziyue Jiang , Yuhan Wang , Tao Jin , Zhou Zhao