中文
相关论文

相关论文: Robust One-Shot Singing Voice Conversion

200 篇论文

Voice Conversion (VC) emerged as a significant domain of research in the field of speech synthesis in recent years due to its emerging application in voice-assisting technology, automated movie dubbing, and speech-to-singing conversion to…

声音 · 计算机科学 2021-04-27 Sandipan Dhar , Nanda Dulal Jana , Swagatam Das

One-shot style transfer is a challenging task, since training on one utterance makes model extremely easy to over-fit to training data and causes low speaker similarity and lack of expressiveness. In this paper, we build on the…

音频与语音处理 · 电气工程与系统科学 2022-02-22 Zhichao Wang , Qicong Xie , Tao Li , Hongqiang Du , Lei Xie , Pengcheng Zhu , Mengxiao Bi

Singing voice synthesis (SVS) systems are built to synthesize high-quality and expressive singing voice, in which the acoustic model generates the acoustic features (e.g., mel-spectrogram) given a music score. Previous singing acoustic…

音频与语音处理 · 电气工程与系统科学 2022-03-23 Jinglin Liu , Chengxi Li , Yi Ren , Feiyang Chen , Zhou Zhao

One-shot voice conversion (VC), which performs conversion across arbitrary speakers with only a single target-speaker utterance for reference, can be effectively achieved by speech representation disentanglement. Existing work generally…

音频与语音处理 · 电气工程与系统科学 2021-07-22 Disong Wang , Liqun Deng , Yu Ting Yeung , Xiao Chen , Xunying Liu , Helen Meng

Voice conversion is an increasingly popular technology, and the growing number of real-time applications requires models with streaming conversion capabilities. Unlike typical (non-streaming) voice conversion, which can leverage the entire…

音频与语音处理 · 电气工程与系统科学 2023-06-01 Ziqian Ning , Yuepeng Jiang , Pengcheng Zhu , Jixun Yao , Shuai Wang , Lei Xie , Mengxiao Bi

High-fidelity multi-singer singing voice synthesis is challenging for neural vocoder due to the singing voice data shortage, limited singer generalization, and large computational cost. Existing open corpora could not meet requirements for…

音频与语音处理 · 电气工程与系统科学 2021-12-21 Rongjie Huang , Feiyang Chen , Yi Ren , Jinglin Liu , Chenye Cui , Zhou Zhao

Singing voice synthesis (SVS) is the computer production of a human-like singing voice from given musical scores. To accomplish end-to-end SVS effectively and efficiently, this work adopts the acoustic model-neural vocoder architecture…

音频与语音处理 · 电气工程与系统科学 2022-09-22 Yin-Ping Cho , Yu Tsao , Hsin-Min Wang , Yi-Wen Liu

Zero-shot voice conversion aims to transform a source speech utterance to match the timbre of a reference speech from an unseen speaker. Traditional approaches struggle with timbre leakage, insufficient timbre representation, and mismatches…

声音 · 计算机科学 2024-11-18 Songting Liu

Voice Conversion(VC) refers to changing the timbre of a speech while retaining the discourse content. Recently, many works have focused on disentangle-based learning techniques to separate the timbre and the linguistic content information…

声音 · 计算机科学 2022-02-22 Huaizhen Tang , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Deep generative models have achieved significant progress in speech synthesis to date, while high-fidelity singing voice synthesis is still an open problem for its long continuous pronunciation, rich high-frequency parts, and strong…

音频与语音处理 · 电气工程与系统科学 2022-08-08 Rongjie Huang , Chenye Cui , Feiyang Chen , Yi Ren , Jinglin Liu , Zhou Zhao , Baoxing Huai , Zhefeng Wang

Recently, voice conversion (VC) has been widely studied. Many VC systems use disentangle-based learning techniques to separate the speaker and the linguistic content information from a speech signal. Subsequently, they convert the voice by…

音频与语音处理 · 电气工程与系统科学 2020-11-03 Yen-Hao Chen , Da-Yi Wu , Tsung-Han Wu , Hung-yi Lee

Singing Voice Synthesis (SVS) has witnessed significant advancements with the advent of deep learning techniques. However, a significant challenge in SVS is the scarcity of labeled singing voice data, which limits the effectiveness of…

声音 · 计算机科学 2024-12-17 Yifeng Yu , Jiatong Shi , Yuning Wu , Yuxun Tang , Shinji Watanabe

One-shot voice conversion(VC) aims to change the timbre of any source speech to match that of the target speaker with only one speech sample. Existing style transfer-based VC methods relied on speech representation disentanglement and…

声音 · 计算机科学 2024-11-26 Wenhan Yao , Zedong Xing , Xiarun Chen , Jia Liu , Yongqiang He , Weiping Wen

This paper presents the T02 team's system for the Singing Voice Conversion Challenge 2023 (SVCC2023). Our system entails a VITS-based SVC model, incorporating three modules: a feature extractor, a voice converter, and a post-processor.…

声音 · 计算机科学 2023-10-10 Yiquan Zhou , Meng Chen , Yi Lei , Jihua Zhu , Weifeng Zhao

Style voice conversion aims to transform the speaking style of source speech into a desired style while keeping the original speaker's identity. However, previous style voice conversion approaches primarily focus on well-defined domains…

音频与语音处理 · 电气工程与系统科学 2025-01-09 Xinfa Zhu , Lei He , Yujia Xiao , Xi Wang , Xu Tan , Sheng Zhao , Lei Xie

In this paper, a novel architecture for speaker recognition is proposed by cascading speech enhancement and speaker processing. Its aim is to improve speaker recognition performance when speech signals are corrupted by noise. Instead of…

计算与语言 · 计算机科学 2020-05-25 Yanpei Shi , Qiang Huang , Thomas Hain

Deep learning based singing voice synthesis (SVS) systems have been demonstrated to flexibly generate singing with better qualities, compared to conventional statistical parametric based methods. However, neural systems are generally…

音频与语音处理 · 电气工程与系统科学 2022-07-07 Shuai Guo , Jiatong Shi , Tao Qian , Shinji Watanabe , Qin Jin

We propose noise-robust voice conversion (VC) which takes into account the recording quality and environment of noisy source speech. Conventional denoising training improves the noise robustness of a VC model by learning noisy-to-clean VC…

The goal of voice conversion is to transform the speech of a source speaker to sound like that of a reference speaker while preserving the original content. A key challenge is to extract disentangled linguistic content from the source and…

声音 · 计算机科学 2025-01-15 Jaehun Kim , Ji-Hoon Kim , Yeunju Choi , Tan Dat Nguyen , Seongkyu Mun , Joon Son Chung

Audio to Video generation is an interesting problem that has numerous applications across industry verticals including film making, multi-media, marketing, education and others. High-quality video generation with expressive facial movements…

计算机视觉与模式识别 · 计算机科学 2020-12-16 Neeraj Kumar , Srishti Goel , Ankur Narang , Mujtaba Hasan