中文
相关论文

相关论文: Audio-visual Recognition of Overlapped speech for …

200 篇论文

Recent research shows end-to-end ASR systems can recognize overlapped speech from multiple speakers. However, all published works have assumed no latency constraints during inference, which does not hold for most voice assistant…

音频与语音处理 · 电气工程与系统科学 2021-02-22 Ilya Sklyar , Anna Piunova , Yulan Liu

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

音频与语音处理 · 电气工程与系统科学 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

This paper presents the architecture and performance of a novel Multilingual Automatic Speech Recognition (ASR) system developed by the Transsion Speech Team for Track 1 of the MLC-SLM 2025 Challenge. The proposed system comprises three key…

音频与语音处理 · 电气工程与系统科学 2025-08-22 Xiaoxiao Li , An Zhu , Youhai Jiang , Fengjie Zhu

Benchmarks for language-guided embodied agents typically assume text-based instructions, but deployed agents will encounter spoken instructions. While Automatic Speech Recognition (ASR) models can bridge the input gap, erroneous ASR…

计算与语言 · 计算机科学 2023-10-11 Allen Chang , Xiaoyuan Zhu , Aarav Monga , Seoho Ahn , Tejas Srinivasan , Jesse Thomason

In this work, we propose a new automatic speech recognition (ASR) system based on feature learning and an end-to-end training procedure for air traffic control (ATC) systems. The proposed model integrates the feature learning block,…

声音 · 计算机科学 2021-11-05 Peng Fan , Dongyue Guo , Yi Lin , Bo Yang , Jianwei Zhang

Automatic Speech Recognition (ASR) systems exhibit the best performance on speech that is similar to that on which it was trained. As such, underrepresented varieties including regional dialects, minority-speakers, and low-resource…

计算与语言 · 计算机科学 2023-05-15 Emma O'Neill , Julie Carson-Berndsen

We introduce LRS-VoxMM, an in-the-wild benchmark for audio-visual speech recognition (AVSR). The benchmark is derived from VoxMM, a dataset of diverse real-world spoken conversations with human-annotated transcriptions. We select…

音频与语音处理 · 电气工程与系统科学 2026-05-01 Doyeop Kwak , Jeongsoo Choi , Suyeon Lee , Joon Son Chung

Aligning acoustic and linguistic representations is a central challenge to bridge the pre-trained models in knowledge transfer for automatic speech recognition (ASR). This alignment is inherently structured and asymmetric: while multiple…

计算与语言 · 计算机科学 2026-03-06 Xugang Lu , Peng Shen , Hisashi Kawai

Unsupervised speech recognition has shown great potential to make Automatic Speech Recognition (ASR) systems accessible to every language. However, existing methods still heavily rely on hand-crafted pre-processing. Similar to the trend of…

计算与语言 · 计算机科学 2022-06-16 Alexander H. Liu , Wei-Ning Hsu , Michael Auli , Alexei Baevski

Many approaches can derive information about a single speaker's identity from the speech by learning to recognize consistent characteristics of acoustic parameters. However, it is challenging to determine identity information when there are…

音频与语音处理 · 电气工程与系统科学 2020-08-07 Hyewon Han , Soo-Whan Chung , Hong-Goo Kang

During conversations, humans are capable of inferring the intention of the speaker at any point of the speech to prepare the following action promptly. Such ability is also the key for conversational systems to achieve rhythmic and natural…

声音 · 计算机科学 2022-11-03 Huaibo Zhao , Shinya Fujie , Tetsuji Ogawa , Jin Sakuma , Yusuke Kida , Tetsunori Kobayashi

Prior works have investigated the use of articulatory features as complementary representations for automatic speech recognition (ASR), but their use was largely confined to shallow acoustic models. In this work, we revisit articulatory…

音频与语音处理 · 电气工程与系统科学 2025-10-13 Ahmed Adel Attia , Jing Liu , Carol Espy Wilson

In the era of large models, the autoregressive nature of decoding often results in latency serving as a significant bottleneck. We propose a non-autoregressive LM-fused ASR system that effectively leverages the parallelization capabilities…

Speaker-independent VSR is a complex task that involves identifying spoken words or phrases from video recordings of a speaker's facial movements. Over the years, there has been a considerable amount of research in the field of VSR…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Praneeth Nemani , G. Sai Krishna , Supriya Kundrapu

The limited availability of non-native speech datasets presents a major challenge in automatic speech recognition (ASR) to narrow the performance gap between native and non-native speakers. To address this, the focus of this study is on the…

计算与语言 · 计算机科学 2023-06-06 Jisung Wang , Haram Lee , Myungwoo Oh

Audio-Visual Speech Recognition (AVSR) has achieved remarkable progress in offline conditions, yet its robustness in real-world video conferencing (VC) remains largely unexplored. This paper presents the first systematic evaluation of…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Yihuan Huang , Jun Xue , Liu Jiajun , Daixian Li , Tong Zhang , Zhuolin Yi , Yanzhen Ren , Kai Li

Natural Language Processing (NLP) and Voice Recognition agents are rapidly evolving healthcare by enabling efficient, accessible, and professional patient support while automating grunt work. This report serves as my self project wherein…

音频与语音处理 · 电气工程与系统科学 2025-02-21 Kabir Kumar

The goal of this work is to develop a meeting transcription system that can recognize speech even when utterances of different speakers are overlapped. While speech overlaps have been regarded as a major obstacle in accurately transcribing…

音频与语音处理 · 电气工程与系统科学 2018-10-10 Takuya Yoshioka , Hakan Erdogan , Zhuo Chen , Xiong Xiao , Fil Alleva

Acoustic models in real-time speech recognition systems typically stack multiple unidirectional LSTM layers to process the acoustic frames over time. Performance improvements over vanilla LSTM architectures have been reported by prepending…

音频与语音处理 · 电气工程与系统科学 2020-07-02 Maarten Van Segbroeck , Harish Mallidih , Brian King , I-Fan Chen , Gurpreet Chadha , Roland Maas

Joint optimization of multi-channel front-end and automatic speech recognition (ASR) has attracted much interest. While promising results have been reported for various tasks, past studies on its meeting transcription application were…

音频与语音处理 · 电气工程与系统科学 2020-11-30 Xiaofei Wang , Naoyuki Kanda , Yashesh Gaur , Zhuo Chen , Zhong Meng , Takuya Yoshioka