English
Related papers

Related papers: The AS-NU System for the M2VoC Challenge

200 papers

Evaluation of text-to-music systems is constrained by the cost and availability of collecting experts for assessment. AudioMOS 2025 Challenge track 1 is created to automatically predict music impression (MI) as well as text alignment (TA)…

We aim to characterize how different speakers contribute to the perceived output quality of multi-speaker Text-to-Speech (TTS) synthesis. We automatically rate the quality of TTS using a neural network (NN) trained on human mean opinion…

Computation and Language · Computer Science 2020-04-28 Jennifer Williams , Joanna Rownicka , Pilar Oplustil , Simon King

We introduce a novel speech synthesis system, called NAUTILUS, that can generate speech with a target voice either from a text input or a reference utterance of an arbitrary source speaker. By using a multi-speaker speech corpus to train…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-08 Hieu-Thi Luong , Junichi Yamagishi

Voice cloning is a highly desired feature for personalized speech interfaces. Neural network based speech synthesis has been shown to generate high quality speech for a large number of speakers. In this paper, we introduce a neural voice…

Computation and Language · Computer Science 2018-10-15 Sercan O. Arik , Jitong Chen , Kainan Peng , Wei Ping , Yanqi Zhou

This technical report describes the SJTU X-LANCE Lab system for the three tracks in CNSRC 2022. In this challenge, we explored the speaker embedding modeling ability of deep ResNet (Deeper r-vector). All the systems are only trained on the…

Sound · Computer Science 2023-05-16 Zhengyang Chen , Bei Liu , Bing Han , Leying Zhang , Yanmin Qian

On account of growing demands for personalization, the need for a so-called few-shot TTS system that clones speakers with only a few data is emerging. To address this issue, we propose Attentron, a few-shot TTS model that clones voices of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-13 Seungwoo Choi , Seungju Han , Dongyoung Kim , Sungjoo Ha

While neural methods for text-to-speech (TTS) have shown great advances in modeling multiple speakers, even in zero-shot settings, the amount of data needed for those approaches is generally not feasible for the vast majority of the world's…

Computation and Language · Computer Science 2022-10-25 Florian Lux , Julia Koch , Ngoc Thang Vu

Data efficient voice cloning aims at synthesizing target speaker's voice with only a few enrollment samples at hand. To this end, speaker adaptation and speaker encoding are two typical methods based on base model trained from multiple…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-12 Jian Cong , Shan Yang , Lei Xie , Guoqiao Yu , Guanglu Wan

Transformer-based text to speech (TTS) model (e.g., Transformer TTS~\cite{li2019neural}, FastSpeech~\cite{ren2019fastspeech}) has shown the advantages of training and inference efficiency over RNN-based model (e.g.,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Mingjian Chen , Xu Tan , Yi Ren , Jin Xu , Hao Sun , Sheng Zhao , Tao Qin , Tie-Yan Liu

This report describes the NPU-HC speaker verification system submitted to the O-COCOSDA Multi-lingual Speaker Verification (MSV) Challenge 2022, which focuses on developing speaker verification systems for low-resource Asian languages. We…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-05 Yue Li , Li Zhang , Namin Wang , Jie Liu , Lei Xie

This paper presents our MSXF TTS system for Task 3.1 of the Audio Deep Synthesis Detection (ADD) Challenge 2022. We use an end to end text to speech system, and add a constraint loss to the system when training stage. The end to end TTS…

Sound · Computer Science 2022-01-28 Chunyong Yang , Pengfei Liu , Yanli Chen , Hongbin Wang , Min Liu

This paper describes our RoyalFlush system for the track of multi-speaker automatic speech recognition (ASR) in the M2MeT challenge. We adopted the serialized output training (SOT) based multi-speakers ASR system with large-scale simulation…

Sound · Computer Science 2022-02-25 Shuaishuai Ye , Peiyao Wang , Shunfei Chen , Xinhui Hu , Xinkang Xu

This paper describes the NTNU ASR system participating in the Interspeech 2020 Non-Native Children's Speech ASR Challenge supported by the SIG-CHILD group of ISCA. This ASR shared task is made much more challenging due to the coexisting…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-04 Tien-Hong Lo , Fu-An Chao , Shi-Yan Weng , Berlin Chen

Code-switching (CS) is a common phenomenon and recognizing CS speech is challenging. But CS speech data is scarce and there' s no common testbed in relevant research. This paper describes the design and main outcomes of the ASRU 2019…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-14 Xian Shi , Qiangze Feng , Lei Xie

This paper is the system description of the DKU-MSXF System for the track1, track2 and track3 of the VoxCeleb Speaker Recognition Challenge 2023 (VoxSRC-23). For Track 1, we utilize a network structure based on ResNet for training. By…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-21 Ze Li , Yuke Lin , Xiaoyi Qin , Ning Jiang , Guoqing Zhao , Ming Li

Automatic speech recognition (ASR) of single channel far-field recordings with an unknown number of speakers is traditionally tackled by cascaded modules. Recent research shows that end-to-end (E2E) multi-speaker ASR models can achieve…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-11 Ilya Sklyar , Anna Piunova , Xianrui Zheng , Yulan Liu

Flow-matching-based text-to-speech (TTS) models have shown high-quality speech synthesis. However, most current flow-matching-based TTS models still rely on reference transcripts corresponding to the audio prompt for synthesis. This…

This paper describes our speaker diarization system submitted to the Multi-channel Multi-party Meeting Transcription (M2MeT) challenge, where Mandarin meeting data were recorded in multi-channel format for diarization and automatic speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-07 Naijun Zheng , Na Li , Xixin Wu , Lingwei Meng , Jiawen Kang , Haibin Wu , Chao Weng , Dan Su , Helen Meng

A recent line of research on spoken language assessment (SLA) employs neural models such as BERT and wav2vec 2.0 (W2V) to evaluate speaking proficiency across linguistic and acoustic modalities. Although both models effectively capture…

Computation and Language · Computer Science 2025-09-12 Hong-Yun Lin , Tien-Hong Lo , Yu-Hsuan Fang , Jhen-Ke Lin , Chung-Chun Wang , Hao-Chien Lu , Berlin Chen

We present the DKU system for Task 2 of the MLC-SLM Challenge, which aims to perform multi-speaker automatic speech recognition directly from raw audio without Oracle speaker labels or time boundaries. Our approach builds upon a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-15 Yuke Lin , Ming Cheng , Ze Li , Ming Li