中文
相关论文

相关论文: WeSinger: Data-augmented Singing Voice Synthesis w…

200 篇论文

Singing voice synthesis (SVS) has seen remarkable advancements in recent years. However, compared to speech and general audio data, publicly available singing datasets remain limited. In practice, this data scarcity often leads to…

声音 · 计算机科学 2025-12-17 Yiwen Zhao , Jiatong Shi , Yuxun Tang , William Chen , Shinji Watanabe

In this paper, we propose MakeSinger, a semi-supervised training method for singing voice synthesis (SVS) via classifier-free diffusion guidance. The challenge in SVS lies in the costly process of gathering aligned sets of text, pitch, and…

音频与语音处理 · 电气工程与系统科学 2024-06-11 Semin Kim , Myeonghun Jeong , Hyeonseung Lee , Minchan Kim , Byoung Jin Choi , Nam Soo Kim

This paper presents an advanced end-to-end singing voice synthesis (SVS) system based on the source-filter mechanism that directly translates lyrical and melodic cues into expressive and high-fidelity human-like singing. Similarly to…

音频与语音处理 · 电气工程与系统科学 2024-10-17 Jianwei Cui , Yu Gu , Chao Weng , Jie Zhang , Liping Chen , Lirong Dai

While recent years have witnessed rapid progress in speech synthesis, open-source singing voice synthesis (SVS) systems still face significant barriers to industrial deployment, particularly in terms of robustness and zero-shot…

High-fidelity singing voices usually require higher sampling rate (e.g., 48kHz) to convey expression and emotion. However, higher sampling rate causes the wider frequency band and longer waveform sequences and throws challenges for singing…

音频与语音处理 · 电气工程与系统科学 2020-09-04 Jiawei Chen , Xu Tan , Jian Luan , Tao Qin , Tie-Yan Liu

This paper presents XiaoiceSing, a high-quality singing voice synthesis system which employs an integrated network for spectrum, F0 and duration modeling. We follow the main architecture of FastSpeech while proposing some singing-specific…

音频与语音处理 · 电气工程与系统科学 2020-06-12 Peiling Lu , Jie Wu , Jian Luan , Xu Tan , Li Zhou

It is challenging to build a multi-singer high-fidelity singing voice synthesis system with cross-lingual ability by only using monolingual singers in the training stage. In this paper, we propose CrossSinger, which is a cross-lingual…

声音 · 计算机科学 2023-09-25 Xintong Wang , Chang Zeng , Jun Chen , Chunhui Wang

Singing voice synthesis has made remarkable progress in generating natural and high-quality voices. However, existing methods rarely provide precise control over vocal techniques such as intensity, mixed voice, falsetto, bubble, and breathy…

声音 · 计算机科学 2025-04-22 Wenxiang Guo , Yu Zhang , Changhao Pan , Rongjie Huang , Li Tang , Ruiqi Li , Zhiqing Hong , Yongqi Wang , Zhou Zhao

Zero-shot singing voice synthesis (SVS) with style transfer and style control aims to generate high-quality singing voices with unseen timbres and styles (including singing method, emotion, rhythm, technique, and pronunciation) from audio…

音频与语音处理 · 电气工程与系统科学 2025-06-02 Yu Zhang , Ziyue Jiang , Ruiqi Li , Changhao Pan , Jinzheng He , Rongjie Huang , Chuxin Wang , Zhou Zhao

Singing voice synthesis (SVS) aims to generate natural and expressive singing waveforms from symbolic musical scores. In cVAE-based SVS, however, a mismatch arises because the decoder is trained with latent representations inferred from…

声音 · 计算机科学 2026-03-16 Minhyeok Yun , Yong-Hoon Choi

The single-speaker singing voice synthesis (SVS) usually underperforms at pitch values that are out of the singer's vocal range or associated with limited training samples. Based on our previous work, this work proposes a…

声音 · 计算机科学 2023-09-04 Shaohuan Zhou , Xu Li , Zhiyong Wu , Ying Shan , Helen Meng

In singing voice synthesis (SVS), generating singing voices from musical scores faces challenges due to limited data availability. This study proposes a unique strategy to address the data scarcity in SVS. We employ an existing singing…

声音 · 计算机科学 2024-06-14 Jiatong Shi , Yueqian Lin , Xinyi Bai , Keyi Zhang , Yuning Wu , Yuxun Tang , Yifeng Yu , Qin Jin , Shinji Watanabe

This paper describes the design of NNSVS, an open-source software for neural network-based singing voice synthesis research. NNSVS is inspired by Sinsy, an open-source pioneer in singing voice synthesis research, and provides many…

音频与语音处理 · 电气工程与系统科学 2023-03-02 Ryuichi Yamamoto , Reo Yoneyama , Tomoki Toda

The purpose of this study is to investigate how humans interpret musical scores expressively, and then design machines that sing like humans. We consider six factors that have a strong influence on the expression of human singing. The…

声音 · 计算机科学 2015-02-17 Ju-Chiang Wang , Hung-Yan Gu , Hsin-Min Wang

Singing Voice Synthesis (SVS) aims to generate singing voices of high fidelity and expressiveness. Conventional SVS systems usually utilize an acoustic model to transform a music score into acoustic features, followed by a vocoder to…

音频与语音处理 · 电气工程与系统科学 2024-12-16 Jianwei Cui , Yu Gu , Shihao Chen , Jie Zhang , Liping Chen , Lirong Dai

Recent singing-voice-synthesis (SVS) methods have achieved remarkable audio quality and naturalness, yet they lack the capability to control the style attributes of the synthesized singing explicitly. We propose Prompt-Singer, the first SVS…

声音 · 计算机科学 2025-01-07 Yongqi Wang , Ruofan Hu , Rongjie Huang , Zhiqing Hong , Ruiqi Li , Wenrui Liu , Fuming You , Tao Jin , Zhou Zhao

This paper proposes singing voice synthesis (SVS) based on frame-level sequence-to-sequence models considering vocal timing deviation. In SVS, it is essential to synchronize the timing of singing with temporal structures represented by…

音频与语音处理 · 电气工程与系统科学 2023-02-23 Miku Nishihara , Yukiya Hono , Kei Hashimoto , Yoshihiko Nankaku , Keiichi Tokuda

This paper presents a high quality singing synthesizer that is able to model a voice with limited available recordings. Based on the sequence-to-sequence singing model, we design a multi-singer framework to leverage all the existing singing…

音频与语音处理 · 电气工程与系统科学 2020-06-19 Jie Wu , Jian Luan

We investigate the feasibility of a singing voice synthesis (SVS) system by using a decomposed framework to improve flexibility in generating singing voices. Due to data-driven approaches, SVS performs a music score-to-waveform mapping;…

声音 · 计算机科学 2024-07-15 Lester Phillip Violeta , Taketo Akama

Customizable multilingual zero-shot singing voice synthesis (SVS) has various potential applications in music composition and short video dubbing. However, existing SVS models overly depend on phoneme and note boundary annotations, limiting…

音频与语音处理 · 电气工程与系统科学 2025-08-22 Yu Zhang , Wenxiang Guo , Changhao Pan , Dongyu Yao , Zhiyuan Zhu , Ziyue Jiang , Yuhan Wang , Tao Jin , Zhou Zhao