中文
相关论文

相关论文: VISinger2+: End-to-End Singing Voice Synthesis Aug…

200 篇论文

Singing voice synthesis (SVS) is the computer production of a human-like singing voice from given musical scores. To accomplish end-to-end SVS effectively and efficiently, this work adopts the acoustic model-neural vocoder architecture…

音频与语音处理 · 电气工程与系统科学 2022-09-22 Yin-Ping Cho , Yu Tsao , Hsin-Min Wang , Yi-Wen Liu

In singing voice synthesis (SVS), generating singing voices from musical scores faces challenges due to limited data availability. This study proposes a unique strategy to address the data scarcity in SVS. We employ an existing singing…

声音 · 计算机科学 2024-06-14 Jiatong Shi , Yueqian Lin , Xinyi Bai , Keyi Zhang , Yuning Wu , Yuxun Tang , Yifeng Yu , Qin Jin , Shinji Watanabe

Although Singing Voice Synthesis (SVS) has made great strides with Text-to-Speech (TTS) techniques, multilingual singing voice modeling remains relatively unexplored. This paper presents BiSinger, a bilingual pop SVS system for English and…

音频与语音处理 · 电气工程与系统科学 2024-01-10 Huali Zhou , Yueqian Lin , Yao Shi , Peng Sun , Ming Li

Singing voice conversion aims to transform a source singing voice into that of a target singer while preserving the original lyrics, melody, and various vocal techniques. In this paper, we propose a high-fidelity singing voice conversion…

声音 · 计算机科学 2025-01-07 Yiquan Zhou , Wenyu Wang , Hongwu Ding , Jiacheng Xu , Jihua Zhu , Xin Gao , Shihao Li

We are interested in a challenging task, Realistic-Music-Score based Singing Voice Synthesis (RMS-SVS). RMS-SVS aims to generate high-quality singing voices given realistic music scores with different note types (grace, slur, rest, etc.).…

声音 · 计算机科学 2023-05-19 Jinzheng He , Jinglin Liu , Zhenhui Ye , Rongjie Huang , Chenye Cui , Huadai Liu , Zhou Zhao

We propose a flexible framework that deals with both singer conversion and singers vocal technique conversion. The proposed model is trained on non-parallel corpora, accommodates many-to-many conversion, and leverages recent advances of…

音频与语音处理 · 电气工程与系统科学 2020-02-26 Yin-Jyun Luo , Chin-Chen Hsu , Kat Agres , Dorien Herremans

While recent years have witnessed rapid progress in speech synthesis, open-source singing voice synthesis (SVS) systems still face significant barriers to industrial deployment, particularly in terms of robustness and zero-shot…

A singing voice conversion model converts a song in the voice of an arbitrary source singer to the voice of a target singer. Recently, methods that leverage self-supervised audio representations such as HuBERT and Wav2Vec 2.0 have helped…

音频与语音处理 · 电气工程与系统科学 2023-03-23 Tejas Jayashankar , Jilong Wu , Leda Sari , David Kant , Vimal Manohar , Qing He

Recent singing-voice-synthesis (SVS) methods have achieved remarkable audio quality and naturalness, yet they lack the capability to control the style attributes of the synthesized singing explicitly. We propose Prompt-Singer, the first SVS…

声音 · 计算机科学 2025-01-07 Yongqi Wang , Ruofan Hu , Rongjie Huang , Zhiqing Hong , Ruiqi Li , Wenrui Liu , Fuming You , Tao Jin , Zhou Zhao

Text-to-speech (TTS) and singing voice synthesis (SVS) aim at generating high-quality speaking and singing voice according to textual input and music scores, respectively. Unifying TTS and SVS into a single system is crucial to the…

声音 · 计算机科学 2022-12-07 Yi Lei , Shan Yang , Xinsheng Wang , Qicong Xie , Jixun Yao , Lei Xie , Dan Su

Detecting singing-voice in polyphonic instrumental music is critical to music information retrieval. To train a robust vocal detector, a large dataset marked with vocal or non-vocal label at frame-level is essential. However, frame-level…

音频与语音处理 · 电气工程与系统科学 2020-08-12 Yuanbo Hou , Frank K. Soong , Jian Luan , Shengchen Li

Recent progress in diffusion-based Singing Voice Synthesis (SVS) demonstrates strong expressiveness but remains limited by data scarcity and model scalability. We introduce a two-stage pipeline: a compact seed set of human-sung recordings…

Singing voice synthesis has been paid rising attention with the rapid development of speech synthesis area. In general, a studio-level singing corpus is usually necessary to produce a natural singing voice from lyrics and music-related…

声音 · 计算机科学 2020-11-18 Heyang Xue , Shan Yang , Yi Lei , Lei Xie , Xiulin Li

Singing voice synthesis has made remarkable progress in generating natural and high-quality voices. However, existing methods rarely provide precise control over vocal techniques such as intensity, mixed voice, falsetto, bubble, and breathy…

声音 · 计算机科学 2025-04-22 Wenxiang Guo , Yu Zhang , Changhao Pan , Rongjie Huang , Li Tang , Ruiqi Li , Zhiqing Hong , Yongqi Wang , Zhou Zhao

This paper presents a high quality singing synthesizer that is able to model a voice with limited available recordings. Based on the sequence-to-sequence singing model, we design a multi-singer framework to leverage all the existing singing…

音频与语音处理 · 电气工程与系统科学 2020-06-19 Jie Wu , Jian Luan

This paper presents a benchmark for singing voice enhancement. The development of singing voice enhancement is limited by the lack of realistic evaluation data. To address this gap, this paper introduces SingVERSE, the first real-world…

声音 · 计算机科学 2025-09-26 Shaohan Jiang , Junan Zhang , Yunjia Zhang , Jing Yang , Fan Fan , Zhizheng Wu

Zero-shot singing voice synthesis (SVS) with style transfer and style control aims to generate high-quality singing voices with unseen timbres and styles (including singing method, emotion, rhythm, technique, and pronunciation) from audio…

音频与语音处理 · 电气工程与系统科学 2025-06-02 Yu Zhang , Ziyue Jiang , Ruiqi Li , Changhao Pan , Jinzheng He , Rongjie Huang , Chuxin Wang , Zhou Zhao

Recent progress in singing voice separation has primarily focused on supervised deep learning methods. However, the scarcity of ground-truth data with clean musical sources has been a problem for long. Given a limited set of labeled data,…

音频与语音处理 · 电气工程与系统科学 2021-02-17 Zhepei Wang , Ritwik Giri , Umut Isik , Jean-Marc Valin , Arvindh Krishnaswamy

We present S$^2$Voice, the winning system of the Singing Voice Conversion Challenge (SVCC) 2025 for both the in-domain and zero-shot singing style conversion tracks. Built on the strong two-stage Vevo baseline, S$^2$Voice advances style…

音频与语音处理 · 电气工程与系统科学 2026-01-21 Ziqian Wang , Xianjun Xia , Chuanzeng Huang , Lei Xie

Voice conversion (VC) systems are widely used for several applications, from speaker anonymisation to personalised speech synthesis. Supervised approaches learn a mapping between different speakers using parallel data, which is expensive to…