English
Related papers

Related papers: A multi-speaker multi-lingual voice cloning system…

200 papers

Singing Voice Synthesis (SVS) has witnessed significant advancements with the advent of deep learning techniques. However, a significant challenge in SVS is the scarcity of labeled singing voice data, which limits the effectiveness of…

Sound · Computer Science 2024-12-17 Yifeng Yu , Jiatong Shi , Yuning Wu , Yuxun Tang , Shinji Watanabe

We present a CLSRIL-23, a self supervised learning based audio pre-trained model which learns cross lingual speech representations from raw audio across 23 Indic languages. It is built on top of wav2vec 2.0 which is solved by training a…

Computation and Language · Computer Science 2022-01-14 Anirudh Gupta , Harveen Singh Chadha , Priyanshi Shah , Neeraj Chhimwal , Ankur Dhuriya , Rishabh Gaur , Vivek Raghavan

One-shot voice cloning aims to transform speaker voice and speaking style in speech synthesized from a text-to-speech (TTS) system, where only a shot recording from the target reference speech can be used. Out-of-domain transfer is still a…

Sound · Computer Science 2022-02-25 Rui Li , Dong Pu , Minnie Huang , Bill Huang

Spoken language Identification (LID) systems are needed to identify the language(s) present in a given audio sample, and typically could be the first step in many speech processing related tasks such as automatic speech recognition (ASR).…

Computation and Language · Computer Science 2020-10-15 Pradeep Rangan , Sundeep Teki , Hemant Misra

In this report, we describe our submitted system for track 2 of the VoxCeleb Speaker Recognition Challenge 2022 (VoxSRC-22). We fuse a variety of good-performing models ranging from supervised models to self-supervised learning(SSL)…

Sound · Computer Science 2022-09-26 Gang Liu , Tianyan Zhou , Yong Zhao , Yu Wu , Zhuo Chen , Yao Qian , Jian Wu

With recent advancements in voice cloning, the performance of speech synthesis for a target speaker has been rendered similar to the human level. However, autoregressive voice cloning systems still suffer from text alignment failures,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-27 Artem Gorodetskii , Ivan Ozhiganov

In recent years, Text-To-Speech (TTS) has been used as a data augmentation technique for speech recognition to help complement inadequacies in the training data. Correspondingly, we investigate the use of a multi-speaker TTS system to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-25 Yiling Huang , Yutian Chen , Jason Pelecanos , Quan Wang

This paper presents HITSZ's submission for the IWSLT 2025 Indic track, focusing on speech-to-text translation (ST) for English-to-Indic and Indic-to-English language pairs. To enhance translation quality in this low-resource scenario, we…

Computation and Language · Computer Science 2025-07-29 Xuchen Wei , Yangxin Wu , Yaoyin Zhang , Henglyu Liu , Kehai Chen , Xuefeng Bai , Min Zhang

Speech representation learning has improved both speech understanding and speech synthesis tasks for single language. However, its ability in cross-lingual scenarios has not been explored. In this paper, we extend the pretraining method for…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-06 Xiaoran Fan , Chao Pang , Tian Yuan , He Bai , Renjie Zheng , Pengfei Zhu , Shuohuan Wang , Junkun Chen , Zeyu Chen , Liang Huang , Yu Sun , Hua Wu

Existing Voice Cloning (VC) tasks aim to convert a paragraph text to a speech with desired voice specified by a reference audio. This has significantly boosted the development of artificial speech applications. However, there also exist…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Qi Chen , Yuanqing Li , Yuankai Qi , Jiaqiu Zhou , Mingkui Tan , Qi Wu

In this paper, we present CopyCat2 (CC2), a novel model capable of: a) synthesizing speech with different speaker identities, b) generating speech with expressive and contextually appropriate prosody, and c) transferring prosody at…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Sri Karlapati , Penny Karanasou , Mateusz Lajszczak , Ammar Abbas , Alexis Moinet , Peter Makarov , Ray Li , Arent van Korlaar , Simon Slangen , Thomas Drugman

This work presents a speech-to-text system "Pisets" for scientists and journalists which is based on a three-component architecture aimed at improving speech recognition accuracy while minimizing errors and hallucinations associated with…

Computation and Language · Computer Science 2026-01-27 Ivan Bondarenko , Daniil Grebenkin , Oleg Sedukhin , Mikhail Klementev , Roman Derunets , Lyudmila Budneva

This paper describes speaker verification (SV) systems submitted by the SpeakIn team to the Task 1 and Task 2 of the Far-Field Speaker Verification Challenge 2022 (FFSVC2022). SV tasks of the challenge focus on the problem of fully…

Sound · Computer Science 2022-09-26 Yu Zheng , Jinghan Peng , Yihao Chen , Yajun Zhang , Jialong Wang , Min Liu , Minqiang Xu

Video-to-speech (V2S) synthesis, the task of generating speech directly from silent video input, is inherently more challenging than other speech synthesis tasks due to the need to accurately reconstruct both speech content and speaker…

Sound · Computer Science 2025-03-10 Yifan Liu , Yu Fang , Zhouhan Lin

In this work, we present our deployment-ready Speech-to-Speech Machine Translation (SSMT) system for English-Hindi, English-Marathi, and Hindi-Marathi language pairs. We develop the SSMT system by cascading Automatic Speech Recognition…

Computation and Language · Computer Science 2023-05-23 Shivam Mhaskar , Vineet Bhat , Akshay Batheja , Sourabh Deoghare , Paramveer Choudhary , Pushpak Bhattacharyya

Recent improvements in multilingual ASR have not been equally distributed across languages and language varieties. To advance state-of-the-art (SOTA) ASR models, we present the Interspeech 2025 ML-SUPERB 2.0 Challenge. We construct a new…

In multi-lingual societies, where multiple languages are spoken in a small geographic vicinity, informal conversations often involve mix of languages. Existing speech technologies may be inefficient in extracting information from such…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-04 Shikha Baghel , Shreyas Ramoji , Somil Jain , Pratik Roy Chowdhuri , Prachi Singh , Deepu Vijayasenan , Sriram Ganapathy

We present a thorough analysis of the findings of the latest iteration of the Singing Voice Conversion Challenge, a scientific event aiming to compare and understand different voice conversion systems in a controlled environment. Compared…

Text-to-speech (TTS) systems are an important component in voice-based e-commerce applications. These applications include end-to-end voice assistant and customer experience (CX) voice bot. Code-mixed TTS is also relevant in these…

Machine Learning · Computer Science 2023-12-05 Raviraj Joshi , Nikesh Garera

A text-to-speech (TTS) model trained to reconstruct speech given text tends towards predictions that are close to the average characteristics of a dataset, failing to model the variations that make human speech sound natural. This problem…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-29 John Janiczek , Dading Chong , Dongyang Dai , Arlo Faria , Chao Wang , Tao Wang , Yuzong Liu
‹ Prev 1 3 4 5 6 7 10 Next ›