中文
相关论文

相关论文: Universal Robust Speech Adaptation for Cross-Domai…

200 篇论文

In this study, we propose a novel noise adaptive speech enhancement (SE) system, which employs a domain adversarial training (DAT) approach to tackle the issue of a noise type mismatch between the training and testing conditions. Such a…

声音 · 计算机科学 2019-07-02 Chien-Feng Liao , Yu Tsao , Hung-Yi Lee , Hsin-Min Wang

The Interspeech 2025 URGENT Challenge aimed to advance universal, robust, and generalizable speech enhancement by unifying speech enhancement tasks across a wide variety of conditions, including seven different distortion types and five…

声音 · 计算机科学 2025-10-01 Rong Chao , Rauf Nasretdinov , Yu-Chiang Frank Wang , Ante Jukić , Szu-Wei Fu , Yu Tsao

We propose an end-to-end Automatic Speech Recognition (ASR) system that can be trained on transcribed speech data, text-only data, or a mixture of both. The proposed model uses an integrated auxiliary block for text-based training. This…

音频与语音处理 · 电气工程与系统科学 2024-07-08 Vladimir Bataev , Roman Korostik , Evgeny Shabalin , Vitaly Lavrukhin , Boris Ginsburg

Automatic Speech Recognition (ASR) has advanced with Speech Foundation Models (SFMs), yet performance degrades on dysarthric speech due to variability and limited data. This study as part of the submission to the Speech Accessibility…

音频与语音处理 · 电气工程与系统科学 2025-05-28 Alexandre Ducorroy , Rachid Riad

Compared with automatic speech recognition (ASR), the human auditory system is more adept at handling noise-adverse situations, including environmental noise and channel distortion. To mimic this adeptness, auditory models have been widely…

计算与语言 · 计算机科学 2016-09-16 Peng Dai , Xue Teng , Frank Rudzicz , Ing Yann Soon

Speaker diarisation systems nowadays use embeddings generated from speech segments in a bottleneck layer, which are needed to be discriminative for unseen speakers. It is well-known that large-margin training can improve the generalisation…

音频与语音处理 · 电气工程与系统科学 2020-07-07 Yassir Fathullah , Chao Zhang , Philip C. Woodland

In this work, we investigate application of generative speech enhancement to improve the robustness of ASR models in noisy and reverberant conditions. We employ a recently-proposed speech enhancement model based on Schr\"odinger bridge,…

音频与语音处理 · 电气工程与系统科学 2025-05-09 Rauf Nasretdinov , Roman Korostik , Ante Jukić

Speaker-attributed automatic speech recognition (SA-ASR) aims to transcribe speech while assigning transcripts to the corresponding speakers accurately. Existing methods often rely on complex modular systems or require extensive fine-tuning…

计算与语言 · 计算机科学 2025-01-16 Thai-Binh Nguyen , Alexander Waibel

The application of generative adversarial networks (GANs) has recently advanced speech super-resolution (SR) based on intermediate representations like mel-spectrograms. However, existing SR methods that typically rely on independently…

声音 · 计算机科学 2025-01-20 Shengkui Zhao , Kun Zhou , Zexu Pan , Yukun Ma , Chong Zhang , Bin Ma

In this paper we address the instability issue of generative adversarial network (GAN) by proposing a new similarity metric in unitary space of Schur decomposition for 2D representations of audio and speech signals. We show that encoding…

This paper proposes SEFGAN, a Deep Neural Network (DNN) combining maximum likelihood training and Generative Adversarial Networks (GANs) for efficient speech enhancement (SE). For this, a DNN is trained to synthesize the enhanced speech…

音频与语音处理 · 电气工程与系统科学 2023-12-05 Martin Strauss , Nicola Pia , Nagashree K. S. Rao , Bernd Edler

Producing a large annotated speech corpus for training ASR systems remains difficult for more than 95% of languages all over the world which are low-resourced, but collecting a relatively big unlabeled data set for such languages is more…

计算与语言 · 计算机科学 2019-08-26 Kuan-Yu Chen , Che-Ping Tsai , Da-Rong Liu , Hung-Yi Lee , Lin-shan Lee

Neural network language models (LMs) are confronted with significant challenges in generalization and robustness. Currently, many studies focus on improving either generalization or robustness in isolation, without methods addressing both…

计算与语言 · 计算机科学 2025-03-24 Yudao Sun , Juan Yin , Juan Zhao , Fan Zhang , Yongheng Liu , Hongji Chen

Recent advancements in deep learning led to human-level performance in single-speaker speech synthesis. However, there are still limitations in terms of speech quality when generalizing those systems into multiple-speaker models especially…

音频与语音处理 · 电气工程与系统科学 2020-08-13 Dipjyoti Paul , Yannis Pantazis , Yannis Stylianou

We present our experiments in training robust to noise an end-to-end automatic speech recognition (ASR) model using intensive data augmentation. We explore the efficacy of fine-tuning a pre-trained model to improve noise robustness, and we…

音频与语音处理 · 电气工程与系统科学 2020-10-27 Jagadeesh Balam , Jocelyn Huang , Vitaly Lavrukhin , Slyne Deng , Somshubra Majumdar , Boris Ginsburg

We propose Universal MelGAN, a vocoder that synthesizes high-fidelity speech in multiple domains. To preserve sound quality when the MelGAN-based structure is trained with a dataset of hundreds of speakers, we added multi-resolution…

音频与语音处理 · 电气工程与系统科学 2021-03-05 Won Jang , Dan Lim , Jaesam Yoon

Most of the deep learning-based speech enhancement models are learned in a supervised manner, which implies that pairs of noisy and clean speech are required during training. Consequently, several noisy speeches recorded in daily life…

声音 · 计算机科学 2021-10-13 Szu-Wei Fu , Cheng Yu , Kuo-Hsuan Hung , Mirco Ravanelli , Yu Tsao

This paper introduces Structured Noise Space GAN (SNS-GAN), a novel approach in the field of generative modeling specifically tailored for class-conditional generation in both image and time series data. It addresses the challenge of…

机器学习 · 计算机科学 2023-12-21 Hamidreza Gholamrezaei , Alireza Koochali , Andreas Dengel , Sheraz Ahmed

Neural volume rendering techniques, such as NeRF, have revolutionized 3D-aware image synthesis by enabling the generation of images of a single scene or object from various camera poses. However, the high computational cost of NeRF presents…

计算机视觉与模式识别 · 计算机科学 2025-01-20 Peng Zheng , Linzhi Huang , Yizhou Yu , Yi Chang , Yilin Wang , Rui Ma

Generative adversarial networks (GANs) are neural networks that learn data distributions through adversarial training. In intensive studies, recent GANs have shown promising results for reproducing training images. However, in spite of…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Takuhiro Kaneko , Tatsuya Harada