中文
相关论文

相关论文: Towards Better Meta-Initialization with Task Augme…

200 篇论文

Local dialects influence people to pronounce words of the same language differently from each other. The great variability and complex characteristics of accents creates a major challenge for training a robust and accent-agnostic automatic…

音频与语音处理 · 电气工程与系统科学 2020-03-05 Genta Indra Winata , Samuel Cahyawijaya , Zihan Liu , Zhaojiang Lin , Andrea Madotto , Peng Xu , Pascale Fung

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

计算与语言 · 计算机科学 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

Speech emotion recognition (SER) has garnered increasing attention due to its wide range of applications in various fields, including human-machine interaction, virtual assistants, and mental health assistance. However, existing SER methods…

声音 · 计算机科学 2024-05-02 Dongyuan Li , Ying Zhang , Yusong Wang , Funakoshi Kataro , Manabu Okumura

Language modeling (LM) for automatic speech recognition (ASR) does not usually incorporate utterance level contextual information. For some domains like voice assistants, however, additional context, such as the time at which an utterance…

计算与语言 · 计算机科学 2021-06-04 Richard Diehl Martinez , Scott Novotney , Ivan Bulyko , Ariya Rastrow , Andreas Stolcke , Ankur Gandhe

Reliable transcription of child-adult conversations in clinical settings is crucial for diagnosing developmental disorders like Autism. Recent advances in deep learning and availability of large scale transcribed data has led to development…

音频与语音处理 · 电气工程与系统科学 2025-08-15 Aditya Ashvin , Rimita Lahiri , Aditya Kommineni , Somer Bishop , Catherine Lord , Sudarsana Reddy Kadiri , Shrikanth Narayanan

State-of-the-art models like OpenAI's Whisper exhibit strong performance in multilingual automatic speech recognition (ASR), but they still face challenges in accurately recognizing diverse subdialects. In this paper, we propose…

声音 · 计算机科学 2025-03-13 Jiaming Zhou , Shiwan Zhao , Jiabei He , Hui Wang , Wenjia Zeng , Yong Chen , Haoqin Sun , Aobo Kong , Yong Qin

In recent years, speech-based self-supervised learning (SSL) has made significant progress in various tasks, including automatic speech recognition (ASR). An ASR model with decent performance can be realized by fine-tuning an SSL model with…

音频与语音处理 · 电气工程与系统科学 2023-08-30 Zhisheng Zheng , Ziyang Ma , Yu Wang , Xie Chen

Pre-trained models have been a foundational approach in speech recognition, albeit with associated additional costs. In this study, we propose a regularization technique that facilitates the training of visual and audio-visual speech…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Adriana Fernandez-Lopez , Honglie Chen , Pingchuan Ma , Lu Yin , Qiao Xiao , Stavros Petridis , Shiwei Liu , Maja Pantic

Model agnostic meta-learning (MAML) is a popular state-of-the-art meta-learning algorithm that provides good weight initialization of a model given a variety of learning tasks. The model initialized by provided weight can be fine-tuned to…

机器学习 · 计算机科学 2021-06-11 Thanh Nguyen , Tung Luu , Trung Pham , Sanzhar Rakhimkul , Chang D. Yoo

This paper presents the TEA-ASLP's system submitted to the MLC-SLM 2025 Challenge, addressing multilingual conversational automatic speech recognition (ASR) in Task I and speech diarization ASR in Task II. For Task I, we enhance Ideal-LLM…

声音 · 计算机科学 2025-07-25 Hongfei Xue , Kaixun Huang , Zhikai Zhou , Shen Huang , Shidong Shang

This paper explores the integration of Large Language Models (LLMs) into Automatic Speech Recognition (ASR) systems to improve transcription accuracy. The increasing sophistication of LLMs, with their in-context learning capabilities and…

计算与语言 · 计算机科学 2025-06-03 Zeping Min , Jinbo Wang

Recent speech enhancement (SE) models increasingly leverage self-supervised learning (SSL) representations for their rich semantic information. Typically, intermediate features are aggregated into a single representation via a lightweight…

声音 · 计算机科学 2026-02-02 Seungu Han , Sungho Lee , Kyogu Lee

In this paper, we analyzed how audio-visual speech enhancement can help to perform the ASR task in a cocktail party scenario. Therefore we considered two simple end-to-end LSTM-based models that perform single-channel audio-visual speech…

音频与语音处理 · 电气工程与系统科学 2019-11-28 Luca Pasa , Giovanni Morrone , Leonardo Badino

Data augmentation is one of the most effective ways to make end-to-end automatic speech recognition (ASR) perform close to the conventional hybrid approach, especially when dealing with low-resource tasks. Using recent advances in speech…

音频与语音处理 · 电气工程与系统科学 2020-12-21 Aleksandr Laptev , Roman Korostik , Aleksey Svischev , Andrei Andrusenko , Ivan Medennikov , Sergey Rybin

In recent years, automatic speech recognition (ASR) models greatly improved transcription performance both in clean, low noise, acoustic conditions and in reverberant environments. However, all these systems rely on the availability of…

音频与语音处理 · 电气工程与系统科学 2024-09-18 Francesco Nespoli , Daniel Barreda , Patrick A. Naylor

Speech enhancement (SE) is usually required as a front end to improve the speech quality in noisy environments, while the enhanced speech might not be optimal for automatic speech recognition (ASR) systems due to speech distortion. On the…

音频与语音处理 · 电气工程与系统科学 2022-05-27 Qiu-Shi Zhu , Jie Zhang , Zi-Qiang Zhang , Li-Rong Dai

Unsupervised single-channel overlapped speech recognition is one of the hardest problems in automatic speech recognition (ASR). Permutation invariant training (PIT) is a state of the art model-based approach, which applies a single neural…

计算与语言 · 计算机科学 2017-12-27 Zhehuai Chen , Jasha Droppo , Jinyu Li , Wayne Xiong

Personalizing dysarthric ASR is hindered by demanding enrollment collection and per-user training. We propose a hybrid meta-training method for a single model, enabling zero-shot and few-shot on-the-fly personalization via in-context…

音频与语音处理 · 电气工程与系统科学 2026-02-24 Dhruuv Agarwal , Harry Zhang , Yang Yu , Quan Wang

Noise robustness is critical when applying automatic speech recognition (ASR) in real-world scenarios. One solution involves the used of speech enhancement (SE) models as the front end of ASR. However, neural network-based (NN-based) SE…

To better model the contextual information and increase the generalization ability of Speech Activity Detection (SAD) system, this paper leverages a multi-lingual Automatic Speech Recognition (ASR) system to perform SAD. Sequence…

声音 · 计算机科学 2021-04-13 Seyyed Saeed Sarfjoo , Srikanth Madikeri , Petr Motlicek