中文
相关论文

相关论文: ByteSing: A Chinese Singing Voice Synthesis System…

200 篇论文

The present paper describes singing voice synthesis based on convolutional neural networks (CNNs). Singing voice synthesis systems based on deep neural networks (DNNs) are currently being proposed and are improving the naturalness of…

音频与语音处理 · 电气工程与系统科学 2020-04-23 Kazuhiro Nakamura , Shinji Takaki , Kei Hashimoto , Keiichiro Oura , Yoshihiko Nankaku , Keiichi Tokuda

Singing voice synthesis (SVS) aims to generate natural and expressive singing waveforms from symbolic musical scores. In cVAE-based SVS, however, a mismatch arises because the decoder is trained with latent representations inferred from…

声音 · 计算机科学 2026-03-16 Minhyeok Yun , Yong-Hoon Choi

A vocoder is a conditional audio generation model that converts acoustic features such as mel-spectrograms into waveforms. Taking inspiration from Differentiable Digital Signal Processing (DDSP), we propose a new vocoder named SawSing for…

Singing voice synthesis (SVS) system is expected to generate high-fidelity singing voice from given music scores (lyrics, duration and pitch). Recently, diffusion models have performed well in this field. However, sacrificing inference…

声音 · 计算机科学 2025-03-10 Yulin Song , Guorui Sang , Jing Yu , Chuangbai Xiao

In this paper, we develop DeepSinger, a multi-lingual multi-singer singing voice synthesis (SVS) system, which is built from scratch using singing training data mined from music websites. The pipeline of DeepSinger consists of several…

音频与语音处理 · 电气工程与系统科学 2020-07-16 Yi Ren , Xu Tan , Tao Qin , Jian Luan , Zhou Zhao , Tie-Yan Liu

Singing Voice Synthesis (SVS) remains constrained in practical deployment due to its strong dependence on accurate phoneme-level alignment and manually annotated melody contours, requirements that are resource-intensive and hinder…

声音 · 计算机科学 2025-12-05 Junjie Zheng , Chunbo Hao , Guobin Ma , Xiaoyu Zhang , Gongyu Chen , Chaofan Ding , Zihao Chen , Lei Xie

With the rapid development of neural network architectures and speech processing models, singing voice synthesis with neural networks is becoming the cutting-edge technique of digital music production. In this work, in order to explore how…

声音 · 计算机科学 2021-08-29 Dengfeng Ke , Yuxing Lu , Xudong Liu , Yanyan Xu , Jing Sun , Cheng-Hao Cai

Text-to-speech (TTS) and singing voice synthesis (SVS) aim at generating high-quality speaking and singing voice according to textual input and music scores, respectively. Unifying TTS and SVS into a single system is crucial to the…

声音 · 计算机科学 2022-12-07 Yi Lei , Shan Yang , Xinsheng Wang , Qicong Xie , Jixun Yao , Lei Xie , Dan Su

This paper presents a method of using autoregressive neural networks for the acoustic modeling of singing voice synthesis (SVS). Singing voice differs from speech and it contains more local dynamic movements of acoustic features, e.g.,…

声音 · 计算机科学 2019-06-24 Yuan-Hao Yi , Yang Ai , Zhen-Hua Ling , Li-Rong Dai

Zero-shot singing voice synthesis (SVS) with style transfer and style control aims to generate high-quality singing voices with unseen timbres and styles (including singing method, emotion, rhythm, technique, and pronunciation) from audio…

音频与语音处理 · 电气工程与系统科学 2025-06-02 Yu Zhang , Ziyue Jiang , Ruiqi Li , Changhao Pan , Jinzheng He , Rongjie Huang , Chuxin Wang , Zhou Zhao

Recently, denoising diffusion models have demonstrated remarkable performance among generative models in various domains. However, in the speech domain, the application of diffusion models for synthesizing time-varying audio faces…

音频与语音处理 · 电气工程与系统科学 2023-06-13 Ji-Sang Hwang , Sang-Hoon Lee , Seong-Whan Lee

Recent advances in singing voice synthesis (SVS) have attracted substantial attention from both academia and industry. With the advent of large language models and novel generative paradigms, producing controllable, high-fidelity singing…

音频与语音处理 · 电气工程与系统科学 2026-01-22 Changhao Pan , Dongyu Yao , Yu Zhang , Wenxiang Guo , Jingyu Lu , Zhiyuan Zhu , Zhou Zhao

Singing Voice Synthesis (SVS) has witnessed significant advancements with the advent of deep learning techniques. However, a significant challenge in SVS is the scarcity of labeled singing voice data, which limits the effectiveness of…

声音 · 计算机科学 2024-12-17 Yifeng Yu , Jiatong Shi , Yuning Wu , Yuxun Tang , Shinji Watanabe

Controllable Singing Voice Synthesis (SVS) aims to generate expressive singing voices reflecting user intent. While recent SVS systems achieve high audio quality, most rely on probabilistic modeling, limiting precise control over attributes…

声音 · 计算机科学 2025-09-10 Yerin Ryu , Inseop Shin , Chanwoo Kim

Existing singing voice synthesis (SVS) models largely rely on fine-grained, phoneme-level durations, which limits their practical application. These methods overlook the complementary role of visual information in duration prediction.To…

音频与语音处理 · 电气工程与系统科学 2025-09-30 Ke Gu , Zhicong Wu , Peng Bai , Sitong Qiao , Zhiqi Jiang , Junchen Lu , Xiaodong Shi , Xinyuan Qian

Vocoders received renewed attention as main components in statistical parametric text-to-speech (TTS) synthesis and speech transformation systems. Even though there are vocoding techniques give almost accepted synthesized speech, their high…

声音 · 计算机科学 2021-06-22 Mohammed Salah Al-Radhi , Tamás Gábor Csapó , Géza Németh

The present paper describes a singing voice synthesis based on convolutional neural networks (CNNs). Singing voice synthesis systems based on deep neural networks (DNNs) are currently being proposed and are improving the naturalness of…

音频与语音处理 · 电气工程与系统科学 2019-06-26 Kazuhiro Nakamura , Kei Hashimoto , Keiichiro Oura , Yoshihiko Nankaku , Keiichi Tokuda

We propose a semi-supervised singing synthesizer, which is able to learn new voices from audio data only, without any annotations such as phonetic segmentation. Our system is an encoder-decoder model with two encoders, linguistic and…

声音 · 计算机科学 2020-11-06 Jordi Bonada , Merlijn Blaauw

We investigate the feasibility of a singing voice synthesis (SVS) system by using a decomposed framework to improve flexibility in generating singing voices. Due to data-driven approaches, SVS performs a music score-to-waveform mapping;…

声音 · 计算机科学 2024-07-15 Lester Phillip Violeta , Taketo Akama

We present UTACO, a singing synthesis model based on an attention-based sequence-to-sequence mechanism and a vocoder based on dilated causal convolutions. These two classes of models have significantly affected the field of text-to-speech,…

音频与语音处理 · 电气工程与系统科学 2020-05-07 Orazio Angelini , Alexis Moinet , Kayoko Yanagisawa , Thomas Drugman