中文
相关论文

相关论文: Leveraging Diverse Semantic-based Audio Pretrained…

200 篇论文

Recent singing-voice-synthesis (SVS) methods have achieved remarkable audio quality and naturalness, yet they lack the capability to control the style attributes of the synthesized singing explicitly. We propose Prompt-Singer, the first SVS…

声音 · 计算机科学 2025-01-07 Yongqi Wang , Ruofan Hu , Rongjie Huang , Zhiqing Hong , Ruiqi Li , Wenrui Liu , Fuming You , Tao Jin , Zhou Zhao

Any-to-any voice conversion problem aims to convert voices for source and target speakers, which are out of the training data. Previous works wildly utilize the disentangle-based models. The disentangle-based model assumes the speech…

声音 · 计算机科学 2022-02-23 Qiqi Wang , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Singing voice conversion is converting the timbre in the source singing to the target speaker's voice while keeping singing content the same. However, singing data for target speaker is much more difficult to collect compared with normal…

音频与语音处理 · 电气工程与系统科学 2020-08-10 Liqiang Zhang , Chengzhu Yu , Heng Lu , Chao Weng , Chunlei Zhang , Yusong Wu , Xiang Xie , Zijin Li , Dong Yu

This paper describes an end-to-end adversarial singing voice conversion (EA-SVC) approach. It can directly generate arbitrary singing waveform by given phonetic posteriorgram (PPG) representing content, F0 representing pitch, and speaker…

声音 · 计算机科学 2020-12-04 Haohan Guo , Heng Lu , Na Hu , Chunlei Zhang , Shan Yang , Lei Xie , Dan Su , Dong Yu

Voice conversion is the task to transform voice characteristics of source speech while preserving content information. Nowadays, self-supervised representation learning models are increasingly utilized in content extraction. However, in…

声音 · 计算机科学 2024-05-02 Yimin Deng , Jianzong Wang , Xulong Zhang , Ning Cheng , Jing Xiao

We present S$^2$Voice, the winning system of the Singing Voice Conversion Challenge (SVCC) 2025 for both the in-domain and zero-shot singing style conversion tracks. Built on the strong two-stage Vevo baseline, S$^2$Voice advances style…

音频与语音处理 · 电气工程与系统科学 2026-01-21 Ziqian Wang , Xianjun Xia , Chuanzeng Huang , Lei Xie

Controllable Singing Voice Synthesis (SVS) aims to generate expressive singing voices reflecting user intent. While recent SVS systems achieve high audio quality, most rely on probabilistic modeling, limiting precise control over attributes…

声音 · 计算机科学 2025-09-10 Yerin Ryu , Inseop Shin , Chanwoo Kim

We present the latest iteration of the voice conversion challenge (VCC) series, a bi-annual scientific event aiming to compare and understand different voice conversion (VC) systems based on a common dataset. This year we shifted our focus…

声音 · 计算机科学 2023-07-07 Wen-Chin Huang , Lester Phillip Violeta , Songxiang Liu , Jiatong Shi , Tomoki Toda

This paper presents an end-to-end high-quality singing voice synthesis (SVS) system that uses bidirectional encoder representation from Transformers (BERT) derived semantic embeddings to improve the expressiveness of the synthesized singing…

声音 · 计算机科学 2023-09-01 Shaohuan Zhou , Shun Lei , Weiya You , Deyi Tuo , Yuren You , Zhiyong Wu , Shiyin Kang , Helen Meng

The goal of cross-speaker style transfer in TTS is to transfer a speech style from a source speaker with expressive data to a target speaker with only neutral data. In this context, we propose using a pre-trained singing voice conversion…

音频与语音处理 · 电气工程与系统科学 2024-10-10 Leonardo B. de M. M. Marques , Lucas H. Ueda , Mário U. Neto , Flávio O. Simões , Fernando Runstein , Bianca Dal Bó , Paula D. P. Costa

Voice conversion (VC) techniques aim to modify speaker identity of an utterance while preserving the underlying linguistic information. Most VC approaches ignore modeling of the speaking style (e.g. emotion and emphasis), which may contain…

音频与语音处理 · 电气工程与系统科学 2020-05-20 Songxiang Liu , Yuewen Cao , Shiyin Kang , Na Hu , Xunying Liu , Dan Su , Dong Yu , Helen Meng

Voice conversion (VC) using deep learning technologies can now generate high quality one-to-many voices and thus has been used in some practical application fields, such as entertainment and healthcare. However, voice conversion can pose…

声音 · 计算机科学 2024-05-02 Qiang Huang

Expressive voice conversion (VC) conducts speaker identity conversion for emotional speakers by jointly converting speaker identity and emotional style. Emotional style modeling for arbitrary speakers in expressive VC has not been…

音频与语音处理 · 电气工程与系统科学 2024-05-06 Zongyang Du , Junchen Lu , Kun Zhou , Lakshmish Kaushik , Berrak Sisman

This study presents an innovative Zero-Shot any-to-any Singing Voice Conversion (SVC) method, leveraging a novel clustering-based phoneme representation to effectively separate content, timbre, and singing style. This approach enables…

声音 · 计算机科学 2024-10-15 Wangjin Zhou , Fengrun Zhang , Yiming Liu , Wenhao Guan , Yi Zhao , Tatsuya Kawahara

Voice conversion is a task of synthesizing an utterance with target speaker's voice while maintaining linguistic information of the source utterance. While a speaker can produce varying utterances from a single script with different…

声音 · 计算机科学 2025-04-17 Soobin Suh , Dabi Ahn , Heewoong Park , Jonghun Park

Face-based Voice Conversion (FVC) is a novel task that leverages facial images to generate the target speaker's voice style. Previous work has two shortcomings: (1) suffering from obtaining facial embeddings that are well-aligned with the…

声音 · 计算机科学 2024-09-05 Yan Rong , Li Liu

Previous research has shown that established techniques for spoken voice conversion (VC) do not perform as well when applied to singing voice conversion (SVC). We propose an alternative loss component in a loss function that is otherwise…

声音 · 计算机科学 2023-02-28 Brendan O'Connor , Simon Dixon

Singing voice correction (SVC) is an appealing application for amateur singers. Commercial products automate SVC by snapping pitch contours to equal-tempered scales, which could lead to deadpan modifications. Together with the neglect of…

音频与语音处理 · 电气工程与系统科学 2020-10-26 Yin-Jyun Luo , Yuen-Jen Lin , Li Su

Singing techniques are used for expressive vocal performances by employing temporal fluctuations of the timbre, the pitch, and other components of the voice. Their classification is a challenging task, because of mainly two factors: 1) the…

声音 · 计算机科学 2022-06-27 Yuya Yamamoto , Juhan Nam , Hiroko Terasawa

The goal of voice conversion is to transform the speech of a source speaker to sound like that of a reference speaker while preserving the original content. A key challenge is to extract disentangled linguistic content from the source and…

声音 · 计算机科学 2025-01-15 Jaehun Kim , Ji-Hoon Kim , Yeunju Choi , Tan Dat Nguyen , Seongkyu Mun , Joon Son Chung