English
Related papers

Related papers: DiTSinger: Scaling Singing Voice Synthesis with Di…

200 papers

Singing voice synthesis (SVS) aims to generate expressive and high-quality vocals from musical scores, requiring precise modeling of pitch, duration, and articulation. While diffusion-based models have achieved remarkable success in image…

Sound · Computer Science 2025-06-27 Kehan Sui , Jinxu Xiang , Fang Jin

Singing voice synthesis (SVS) aims to produce high-fidelity singing audio from music scores, requiring a detailed understanding of notes, pitch, and duration, unlike text-to-speech tasks. Although diffusion models have shown exceptional…

Sound · Computer Science 2024-10-30 Kehan Sui , Jinxu Xiang , Fang Jin

In this paper, we propose MakeSinger, a semi-supervised training method for singing voice synthesis (SVS) via classifier-free diffusion guidance. The challenge in SVS lies in the costly process of gathering aligned sets of text, pitch, and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-11 Semin Kim , Myeonghun Jeong , Hyeonseung Lee , Minchan Kim , Byoung Jin Choi , Nam Soo Kim

Singing voice synthesis (SVS) system is expected to generate high-fidelity singing voice from given music scores (lyrics, duration and pitch). Recently, diffusion models have performed well in this field. However, sacrificing inference…

Sound · Computer Science 2025-03-10 Yulin Song , Guorui Sang , Jing Yu , Chuangbai Xiao

Singing voice synthesis (SVS) systems are built to synthesize high-quality and expressive singing voice, in which the acoustic model generates the acoustic features (e.g., mel-spectrogram) given a music score. Previous singing acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-23 Jinglin Liu , Chengxi Li , Yi Ren , Feiyang Chen , Zhou Zhao

In this paper, we develop a new multi-singer Chinese neural singing voice synthesis (SVS) system named WeSinger. To improve the accuracy and naturalness of synthesized singing voice, we design several specifical modules and techniques: 1) A…

Sound · Computer Science 2022-06-28 Zewang Zhang , Yibin Zheng , Xinhui Li , Li Lu

Singing Voice Synthesis (SVS) remains constrained in practical deployment due to its strong dependence on accurate phoneme-level alignment and manually annotated melody contours, requirements that are resource-intensive and hinder…

Sound · Computer Science 2025-12-05 Junjie Zheng , Chunbo Hao , Guobin Ma , Xiaoyu Zhang , Gongyu Chen , Chaofan Ding , Zihao Chen , Lei Xie

In this paper, we develop DeepSinger, a multi-lingual multi-singer singing voice synthesis (SVS) system, which is built from scratch using singing training data mined from music websites. The pipeline of DeepSinger consists of several…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-16 Yi Ren , Xu Tan , Tao Qin , Jian Luan , Zhou Zhao , Tie-Yan Liu

We are interested in a challenging task, Realistic-Music-Score based Singing Voice Synthesis (RMS-SVS). RMS-SVS aims to generate high-quality singing voices given realistic music scores with different note types (grace, slur, rest, etc.).…

Sound · Computer Science 2023-05-19 Jinzheng He , Jinglin Liu , Zhenhui Ye , Rongjie Huang , Chenye Cui , Huadai Liu , Zhou Zhao

Singing voice synthesis (SVS) aims to generate natural and expressive singing waveforms from symbolic musical scores. In cVAE-based SVS, however, a mismatch arises because the decoder is trained with latent representations inferred from…

Sound · Computer Science 2026-03-16 Minhyeok Yun , Yong-Hoon Choi

Recently, denoising diffusion models have demonstrated remarkable performance among generative models in various domains. However, in the speech domain, the application of diffusion models for synthesizing time-varying audio faces…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-13 Ji-Sang Hwang , Sang-Hoon Lee , Seong-Whan Lee

This paper presents ByteSing, a Chinese singing voice synthesis (SVS) system based on duration allocated Tacotron-like acoustic models and WaveRNN neural vocoders. Different from the conventional SVS models, the proposed ByteSing employs…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-26 Yu Gu , Xiang Yin , Yonghui Rao , Yuan Wan , Benlai Tang , Yang Zhang , Jitong Chen , Yuxuan Wang , Zejun Ma

Existing singing voice synthesis (SVS) models largely rely on fine-grained, phoneme-level durations, which limits their practical application. These methods overlook the complementary role of visual information in duration prediction.To…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-30 Ke Gu , Zhicong Wu , Peng Bai , Sitong Qiao , Zhiqi Jiang , Junchen Lu , Xiaodong Shi , Xinyuan Qian

While recent years have witnessed rapid progress in speech synthesis, open-source singing voice synthesis (SVS) systems still face significant barriers to industrial deployment, particularly in terms of robustness and zero-shot…

Singing Voice Synthesis (SVS) has witnessed significant advancements with the advent of deep learning techniques. However, a significant challenge in SVS is the scarcity of labeled singing voice data, which limits the effectiveness of…

Sound · Computer Science 2024-12-17 Yifeng Yu , Jiatong Shi , Yuning Wu , Yuxun Tang , Shinji Watanabe

Although Singing Voice Synthesis (SVS) has made great strides with Text-to-Speech (TTS) techniques, multilingual singing voice modeling remains relatively unexplored. This paper presents BiSinger, a bilingual pop SVS system for English and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-10 Huali Zhou , Yueqian Lin , Yao Shi , Peng Sun , Ming Li

Building a high-quality singing corpus for a person who is not good at singing is non-trivial, thus making it challenging to create a singing voice synthesizer for this person. Learn2Sing is dedicated to synthesizing the singing voice of a…

Sound · Computer Science 2022-05-27 Heyang Xue , Xinsheng Wang , Yongmao Zhang , Lei Xie , Pengcheng Zhu , Mengxiao Bi

Controllable Singing Voice Synthesis (SVS) aims to generate expressive singing voices reflecting user intent. While recent SVS systems achieve high audio quality, most rely on probabilistic modeling, limiting precise control over attributes…

Sound · Computer Science 2025-09-10 Yerin Ryu , Inseop Shin , Chanwoo Kim

This paper aims to introduce a robust singing voice synthesis (SVS) system to produce very natural and realistic singing voices efficiently by leveraging the adversarial training strategy. On one hand, we designed simple but generic random…

Sound · Computer Science 2023-02-17 Zewang Zhang , Yibin Zheng , Xinhui Li , Li Lu

End-to-end singing voice synthesis (SVS) model VISinger can achieve better performance than the typical two-stage model with fewer parameters. However, VISinger has several problems: text-to-phase problem, the end-to-end model learns the…

Sound · Computer Science 2022-11-08 Yongmao Zhang , Heyang Xue , Hanzhao Li , Lei Xie , Tingwei Guo , Ruixiong Zhang , Caixia Gong
‹ Prev 1 2 3 10 Next ›