中文
相关论文

相关论文: Learn2Sing 2.0: Diffusion and Mutual Information-B…

200 篇论文

Speech separation is a fundamental task in audio processing, typically addressed with fully supervised systems trained on paired mixtures. While effective, such systems typically rely on synthetic data pipelines, which may not reflect…

音频与语音处理 · 电气工程与系统科学 2025-09-30 Runwu Shi , Kai Li , Chang Li , Jiang Wang , Sihan Tan , Kazuhiro Nakadai

We present S$^2$Voice, the winning system of the Singing Voice Conversion Challenge (SVCC) 2025 for both the in-domain and zero-shot singing style conversion tracks. Built on the strong two-stage Vevo baseline, S$^2$Voice advances style…

音频与语音处理 · 电气工程与系统科学 2026-01-21 Ziqian Wang , Xianjun Xia , Chuanzeng Huang , Lei Xie

Recent progress in deep generative models has improved the quality of neural vocoders in speech domain. However, generating a high-quality singing voice remains challenging due to a wider variety of musical expressions in pitch, loudness,…

声音 · 计算机科学 2022-10-19 Naoya Takahashi , Mayank Kumar , Singh , Yuki Mitsufuji

In the recent years, singing voice separation systems showed increased performance due to the use of supervised training. The design of training datasets is known as a crucial factor in the performance of such systems. We investigate on how…

声音 · 计算机科学 2019-06-07 Laure Prétet , Romain Hennequin , Jimena Royo-Letelier , Andrea Vaglio

Style transfer for out-of-domain (OOD) singing voice synthesis (SVS) focuses on generating high-quality singing voices with unseen styles (such as timbre, emotion, pronunciation, and articulation skills) derived from reference singing voice…

音频与语音处理 · 电气工程与系统科学 2025-06-02 Yu Zhang , Rongjie Huang , Ruiqi Li , JinZheng He , Yan Xia , Feiyang Chen , Xinyu Duan , Baoxing Huai , Zhou Zhao

Recent studies in singing voice synthesis have achieved high-quality results leveraging advances in text-to-speech models based on deep neural networks. One of the main issues in training singing voice synthesis models is that they require…

音频与语音处理 · 电气工程与系统科学 2022-04-15 Soonbeom Choi , Juhan Nam

A text-independent speaker recognition system relies on successfully encoding speech factors such as vocal pitch, intensity, and timbre to achieve good performance. A majority of such systems are trained and evaluated using spoken voice or…

音频与语音处理 · 电气工程与系统科学 2020-08-11 Anurag Chowdhury , Austin Cozzo , Arun Ross

This paper proposes an expressive singing voice synthesis system by introducing explicit vibrato modeling and latent energy representation. Vibrato is essential to the naturalness of synthesized sound, due to the inherent characteristics of…

声音 · 计算机科学 2022-11-03 Yingjie Song , Wei Song , Wei Zhang , Zhengchen Zhang , Dan Zeng , Zhi Liu , Yang Yu

This paper presents an end-to-end high-quality singing voice synthesis (SVS) system that uses bidirectional encoder representation from Transformers (BERT) derived semantic embeddings to improve the expressiveness of the synthesized singing…

声音 · 计算机科学 2023-09-01 Shaohuan Zhou , Shun Lei , Weiya You , Deyi Tuo , Yuren You , Zhiyong Wu , Shiyin Kang , Helen Meng

Singing Voice Synthesis (SVS) aims to generate singing voices of high fidelity and expressiveness. Conventional SVS systems usually utilize an acoustic model to transform a music score into acoustic features, followed by a vocoder to…

音频与语音处理 · 电气工程与系统科学 2024-12-16 Jianwei Cui , Yu Gu , Shihao Chen , Jie Zhang , Liping Chen , Lirong Dai

In this paper, we develop a new multi-singer Chinese neural singing voice synthesis (SVS) system named WeSinger. To improve the accuracy and naturalness of synthesized singing voice, we design several specifical modules and techniques: 1) A…

声音 · 计算机科学 2022-06-28 Zewang Zhang , Yibin Zheng , Xinhui Li , Li Lu

In singing voice synthesis (SVS), generating singing voices from musical scores faces challenges due to limited data availability. This study proposes a unique strategy to address the data scarcity in SVS. We employ an existing singing…

声音 · 计算机科学 2024-06-14 Jiatong Shi , Yueqian Lin , Xinyi Bai , Keyi Zhang , Yuning Wu , Yuxun Tang , Yifeng Yu , Qin Jin , Shinji Watanabe

This paper proposes singing voice synthesis (SVS) based on frame-level sequence-to-sequence models considering vocal timing deviation. In SVS, it is essential to synchronize the timing of singing with temporal structures represented by…

音频与语音处理 · 电气工程与系统科学 2023-02-23 Miku Nishihara , Yukiya Hono , Kei Hashimoto , Yoshihiko Nankaku , Keiichi Tokuda

Text-to-speech (TTS) and singing voice synthesis (SVS) aim at generating high-quality speaking and singing voice according to textual input and music scores, respectively. Unifying TTS and SVS into a single system is crucial to the…

声音 · 计算机科学 2022-12-07 Yi Lei , Shan Yang , Xinsheng Wang , Qicong Xie , Jixun Yao , Lei Xie , Dan Su

Singing Voice Conversion (SVC) transfers a source singer's timbre to a target while keeping melody and lyrics. The key challenge in any-to-any SVC is adapting unseen speaker timbres to source audio without quality degradation. Existing…

声音 · 计算机科学 2025-08-11 Wei Chen , Binzhu Sha , Dan Luo , Jing Yang , Zhuo Wang , Fan Fan , Zhiyong Wu

Automatic Singing Assessment and Singing Information Processing have evolved over the past three decades to support singing pedagogy, performance analysis, and vocal training. While the first approach objectively evaluates a singer's…

音频与语音处理 · 电气工程与系统科学 2026-01-21 Arthur N. dos Santos , Bruno S. Masiero

End-to-end singing voice synthesis (SVS) model VISinger can achieve better performance than the typical two-stage model with fewer parameters. However, VISinger has several problems: text-to-phase problem, the end-to-end model learns the…

声音 · 计算机科学 2022-11-08 Yongmao Zhang , Heyang Xue , Hanzhao Li , Lei Xie , Tingwei Guo , Ruixiong Zhang , Caixia Gong

Singing voice conversion is to convert a singer's voice to another one's voice without changing singing content. Recent work shows that unsupervised singing voice conversion can be achieved with an autoencoder-based approach [1]. However,…

声音 · 计算机科学 2020-02-19 Chengqi Deng , Chengzhu Yu , Heng Lu , Chao Weng , Dong Yu

We introduce Mix2Morph, a text-to-audio diffusion model fine-tuned to perform sound morphing without a dedicated dataset of morphs. By finetuning on noisy surrogate mixes at higher diffusion timesteps, Mix2Morph yields stable, perceptually…

声音 · 计算机科学 2026-01-29 Annie Chu , Hugo Flores García , Oriol Nieto , Justin Salamon , Bryan Pardo , Prem Seetharaman

In this study, we define the identity of the singer with two independent concepts - timbre and singing style - and propose a multi-singer singing synthesis system that can model them separately. To this end, we extend our single-singer…

声音 · 计算机科学 2019-10-30 Juheon Lee , Hyeong-Seok Choi , Junghyun Koo , Kyogu Lee