English
Related papers

Related papers: The X-LANCE Technical Report for Interspeech 2024 …

200 papers

While automatic speech recognition (ASR) systems have achieved remarkable performance with large-scale datasets, their efficacy remains inadequate in low-resource settings, encompassing dialects, accents, minority languages, and long-tail…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Guanrou Yang , Fan Yu , Ziyang Ma , Zhihao Du , Zhifu Gao , Shiliang Zhang , Xie Chen

This paper presents a method for selecting appropriate synthetic speech samples from a given large text-to-speech (TTS) dataset as supplementary training data for an automatic speech recognition (ASR) model. We trained a neural network,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-05 Shuo Liu , Leda Sarı , Chunyang Wu , Gil Keren , Yuan Shangguan , Jay Mahadeokar , Ozlem Kalinli

This paper presents the system description of the THUEE team for the NIST 2020 Speaker Recognition Evaluation (SRE) conversational telephone speech (CTS) challenge. The subsystems including ResNet74, ResNet152, and RepVGG-B2 are developed…

Sound · Computer Science 2022-10-13 Yu Zheng , Jinghan Peng , Miao Zhao , Yufeng Ma , Min Liu , Xinyue Ma , Tianyu Liang , Tianlong Kong , Liang He , Minqiang Xu

Self-supervised learning (SSL) techniques have achieved remarkable results in various speech processing tasks. Nonetheless, a significant challenge remains in reducing the reliance on vast amounts of speech data for pre-training. This paper…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Po-chun Hsu , Ali Elkahky , Wei-Ning Hsu , Yossi Adi , Tu Anh Nguyen , Jade Copet , Emmanuel Dupoux , Hung-yi Lee , Abdelrahman Mohamed

We propose a novel two-stage text-to-speech (TTS) framework with two types of discrete tokens, i.e., semantic and acoustic tokens, for high-fidelity speech synthesis. It features two core components: the Interpreting module, which processes…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-26 Joun Yeop Lee , Myeonghun Jeong , Minchan Kim , Ji-Hyun Lee , Hoon-Young Cho , Nam Soo Kim

This paper presents a newly developed, simultaneous neural speech-to-speech translation system and its evaluation. The system consists of three fully-incremental neural processing modules for automatic speech recognition (ASR), machine…

Computation and Language · Computer Science 2020-11-12 Katsuhito Sudoh , Takatomo Kano , Sashi Novitasari , Tomoya Yanagita , Sakriani Sakti , Satoshi Nakamura

This paper presents the SJTU system for both text-dependent and text-independent tasks in short-duration speaker verification (SdSV) challenge 2021. In this challenge, we explored different strong embedding extractors to extract robust…

Sound · Computer Science 2022-08-04 Bing Han , Zhengyang Chen , Zhikai Zhou , Yanmin Qian

With the advancement of Self-supervised Learning (SSL) in speech-related tasks, there has been growing interest in utilizing discrete tokens generated by SSL for automatic speech recognition (ASR), as they offer faster processing…

Computation and Language · Computer Science 2024-09-16 Mingyu Cui , Daxin Tan , Yifan Yang , Dingdong Wang , Huimeng Wang , Xiao Chen , Xie Chen , Xunying Liu

The aim of this project is to implement and design arobust synthetic speech classifier for the IEEE Signal ProcessingCup 2022 challenge. Here, we learn a synthetic speech attributionmodel using the speech generated from various…

We introduce Inworld TTS-1, a set of two Transformer-based autoregressive text-to-speech (TTS) models. Our largest model, TTS-1-Max, has 8.8B parameters and is designed for utmost quality and expressiveness in demanding applications. TTS-1…

This paper delineates the visual speech recognition (VSR) system introduced by the NPU-ASLP (Team 237) in the second Chinese Continuous Visual Speech Recognition Challenge (CNVSRC 2024), engaging in all four tracks, including the fixed and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 He Wang , Lei Xie

Speech encoders pretrained through self-supervised learning (SSL) have demonstrated remarkable performance in various downstream tasks, including Spoken Language Understanding (SLU) and Automatic Speech Recognition (ASR). For instance,…

Computation and Language · Computer Science 2024-07-10 Salima Mdhaffar , Haroun Elleuch , Fethi Bougares , Yannick Estève

Synthesizing the voices of unseen speakers remains a persisting challenge in multi-speaker text-to-speech (TTS). Existing methods model speaker characteristics through speaker conditioning during training, leading to increased model…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-18 Ismail Rasim Ulgen , Shreeram Suresh Chandra , Junchen Lu , Berrak Sisman

Most text-to-speech (TTS) methods use high-quality speech corpora recorded in a well-designed environment, incurring a high cost for data collection. To solve this problem, existing noise-robust TTS methods are intended to use noisy speech…

Sound · Computer Science 2022-06-30 Takaaki Saeki , Kentaro Tachibana , Ryuichi Yamamoto

This paper describes the NPU-MSXF system for the IWSLT 2023 speech-to-speech translation (S2ST) task which aims to translate from English speech of multi-source to Chinese speech. The system is built in a cascaded manner consisting of…

Sound · Computer Science 2023-07-11 Kun Song , Yi lei , Peikun Chen , Yiqing Cao , Kun Wei , Yongmao Zhang , Lei Xie , Ning Jiang , Guoqing Zhao

This paper introduces the model structure used in the SVDD 2024 Challenge. The SVDD 2024 challenge has been introduced this year for the first time. Singing voice deepfake detection (SVDD) which faces complexities due to informal speech…

Sound · Computer Science 2024-10-03 Qishan Zhang , Shuangbing Wen , Fangke Yan , Tao Hu , Jun Li

This paper presents a speech recognition system developed by the Transsion Speech Understanding Processing Team (TSUP) for the ASRU 2023 MADASR Challenge. The system focuses on adapting ASR models for low-resource Indian languages and…

Computation and Language · Computer Science 2023-07-25 Xiaoxiao Li , Gaosheng Zhang , An Zhu , Weiyong Li , Shuming Fang , Xiaoyue Yang , Jianchao Zhu

In this paper, a multilingual end-to-end framework, called as ATCSpeechNet, is proposed to tackle the issue of translating communication speech into human-readable text in air traffic control (ATC) systems. In the proposed framework, we…

Computation and Language · Computer Science 2021-02-18 Yi Lin , Bo Yang , Linchao Li , Dongyue Guo , Jianwei Zhang , Hu Chen , Yi Zhang

The University of Sheffield (USFD) participated in the International Workshop for Spoken Language Translation (IWSLT) in 2014. In this paper, we will introduce the USFD SLT system for IWSLT. Automatic speech recognition (ASR) is achieved by…

Computation and Language · Computer Science 2015-09-22 Raymond W. M. Ng , Mortaza Doulaty , Rama Doddipatla , Wilker Aziz , Kashif Shah , Oscar Saz , Madina Hasan , Ghada AlHarbi , Lucia Specia , Thomas Hain

The IEEE Spoken Language Technology Workshop (SLT) 2021 Alpha-mini Speech Challenge (ASC) is intended to improve research on keyword spotting (KWS) and sound source location (SSL) on humanoid robots. Many publications report significant…