中文
相关论文

相关论文: The Multi-speaker Multi-style Voice Cloning Challe…

200 篇论文

In this paper, we describe the TTS models developed by NVIDIA for the MMITS-VC (Multi-speaker, Multi-lingual Indic TTS with Voice Cloning) 2024 Challenge. In Tracks 1 and 2, we utilize RAD-MMM to perform few-shot TTS by training…

声音 · 计算机科学 2024-01-30 Akshit Arora , Rohan Badlani , Sungwon Kim , Rafael Valle , Bryan Catanzaro

Deep learning models are becoming predominant in many fields of machine learning. Text-to-Speech (TTS), the process of synthesizing artificial speech from text, is no exception. To this end, a deep neural network is usually trained using a…

声音 · 计算机科学 2021-02-11 Giuseppe Ruggiero , Enrico Zovato , Luigi Di Caro , Vincent Pollet

The voice conversion challenge is a bi-annual scientific event held to compare and understand different voice conversion (VC) systems built on a common dataset. In 2020, we organized the third edition of the challenge and constructed and…

音频与语音处理 · 电气工程与系统科学 2020-08-31 Yi Zhao , Wen-Chin Huang , Xiaohai Tian , Junichi Yamagishi , Rohan Kumar Das , Tomi Kinnunen , Zhenhua Ling , Tomoki Toda

We present a thorough analysis of the findings of the latest iteration of the Singing Voice Conversion Challenge, a scientific event aiming to compare and understand different voice conversion systems in a controlled environment. Compared…

Voice cloning is the task of learning to synthesize the voice of an unseen speaker from a few samples. While current voice cloning methods achieve promising results in Text-to-Speech (TTS) synthesis for a new voice, these approaches lack…

声音 · 计算机科学 2021-02-02 Paarth Neekhara , Shehzeen Hussain , Shlomo Dubnov , Farinaz Koushanfar , Julian McAuley

Voice cloning is a prominent feature in personalized speech interfaces. A neural vocal cloning system can mimic someone's voice using just a few audio samples. Both speaker encoding and speaker adaptation are topics of research in the field…

声音 · 计算机科学 2024-08-26 Manjil Karki , Pratik Shakya , Sandesh Acharya , Ravi Pandit , Dinesh Gothe

This paper presents the details of our system designed for the Task 1 of Multimodal Information Based Speech Processing (MISP) Challenge 2021. The purpose of Task 1 is to leverage both audio and video information to improve the…

The ConferencingSpeech 2021 challenge is proposed to stimulate research on far-field multi-channel speech enhancement for video conferencing. The challenge consists of two separate tasks: 1) Task 1 is multi-channel speech enhancement with…

音频与语音处理 · 电气工程与系统科学 2021-04-05 Wei Rao , Yihui Fu , Yanxin Hu , Xin Xu , Yvkai Jv , Jiangyu Han , Zhongjie Jiang , Lei Xie , Yannan Wang , Shinji Watanabe , Zheng-Hua Tan , Hui Bu , Tao Yu , Shidong Shang

In this work, we explore multiple architectures and training procedures for developing a multi-speaker and multi-lingual neural TTS system with the goals of a) improving the quality when the available data in the target language is limited…

计算与语言 · 计算机科学 2021-08-18 Javier Latorre , Charlotte Bailleul , Tuuli Morrill , Alistair Conkie , Yannis Stylianou

Voice conversion (VC) systems can transform audio to mimic another speaker's voice, thereby attacking speaker verification (SV) systems. However, ongoing studies on source speaker verification (SSV) are hindered by limited data availability…

音频与语音处理 · 电气工程与系统科学 2024-10-08 Ze Li , Yuke Lin , Tian Yao , Hongbin Suo , Pengyuan Zhang , Yanzhen Ren , Zexin Cai , Hiromitsu Nishizaki , Ming Li

This document outlines the Text-dependent Speaker Verification (TdSV) Challenge 2024, which centers on analyzing and exploring novel approaches for text-dependent speaker verification. The primary goal of this challenge is to motive…

声音 · 计算机科学 2024-04-23 Zeinali Hossein , Lee Kong Aik , Alam Jahangir , Burget Lukas

This paper presents our systems (denoted as T13) for the singing voice conversion challenge (SVCC) 2023. For both in-domain and cross-domain English singing voice conversion (SVC) tasks (Task 1 and Task 2), we adopt a recognition-synthesis…

音频与语音处理 · 电气工程与系统科学 2023-10-10 Ryuichi Yamamoto , Reo Yoneyama , Lester Phillip Violeta , Wen-Chin Huang , Tomoki Toda

We address the problem of cross-speaker style transfer for text-to-speech (TTS) using data augmentation via voice conversion. We assume to have a corpus of neutral non-expressive data from a target speaker and supporting conversational…

音频与语音处理 · 电气工程与系统科学 2022-02-11 Manuel Sam Ribeiro , Julian Roth , Giulia Comini , Goeric Huybrechts , Adam Gabrys , Jaime Lorenzo-Trueba

While neural methods for text-to-speech (TTS) have shown great advances in modeling multiple speakers, even in zero-shot settings, the amount of data needed for those approaches is generally not feasible for the vast majority of the world's…

计算与语言 · 计算机科学 2022-10-25 Florian Lux , Julia Koch , Ngoc Thang Vu

We introduce an approach to multilingual speech synthesis which uses the meta-learning concept of contextual parameter generation and produces natural-sounding multilingual speech using more languages and less training data than previous…

音频与语音处理 · 电气工程与系统科学 2020-08-04 Tomáš Nekvinda , Ondřej Dušek

Speaker Verification (SV) is a task to verify the claimed identity of the claimant using his/her voice sample. Though there exists an ample amount of research in SV technologies, the development concerning a multilingual conversation is…

音频与语音处理 · 电气工程与系统科学 2023-02-28 Jagabandhu Mishra , Mrinmoy Bhattacharjee , S. R. Mahadeva Prasanna

Modeling voices for multiple speakers and multiple languages in one text-to-speech system has been a challenge for a long time. This paper presents an extension on Tacotron2 to achieve bilingual multispeaker speech synthesis when there are…

音频与语音处理 · 电气工程与系统科学 2020-05-22 Zexin Cai , Yaogen Yang , Ming Li

The ICASSP 2022 Multi-channel Multi-party Meeting Transcription Grand Challenge (M2MeT) focuses on one of the most valuable and the most challenging scenarios of speech technologies. The M2MeT challenge has particularly set up two tracks,…

We present a meta-learning approach for adaptive text-to-speech (TTS) with few data. During training, we learn a multi-speaker model using a shared conditional WaveNet core and independent learned embeddings for each speaker. The aim of…

On account of growing demands for personalization, the need for a so-called few-shot TTS system that clones speakers with only a few data is emerging. To address this issue, we propose Attentron, a few-shot TTS model that clones voices of…

音频与语音处理 · 电气工程与系统科学 2020-08-13 Seungwoo Choi , Seungju Han , Dongyoung Kim , Sungjoo Ha