中文
相关论文

相关论文: BUT System for the MLC-SLM Challenge

200 篇论文

Recognizing overlapping speech from multiple speakers in conversational scenarios is one of the most challenging problem for automatic speech recognition (ASR). Serialized output training (SOT) is a classic method to address multi-talker…

音频与语音处理 · 电气工程与系统科学 2024-09-02 Mohan Shi , Zengrui Jin , Yaoxun Xu , Yong Xu , Shi-Xiong Zhang , Kun Wei , Yiwen Shao , Chunlei Zhang , Dong Yu

This paper presents the system developed for Task 1 of the Multi-modal Information-based Speech Processing (MISP) 2025 Challenge. We introduce CASA-Net, an embedding fusion method designed for end-to-end audio-visual speaker diarization…

声音 · 计算机科学 2025-06-04 Zhaoyang Li , Haodong Zhou , Longjie Luo , Xiaoxiao Li , Yongxin Chen , Lin Li , Qingyang Hong

Automatic Speech Recognition (ASR) has advanced with Speech Foundation Models (SFMs), yet performance degrades on dysarthric speech due to variability and limited data. This study as part of the submission to the Speech Accessibility…

音频与语音处理 · 电气工程与系统科学 2025-05-28 Alexandre Ducorroy , Rachid Riad

This paper investigates the use of target-speaker automatic speech recognition (TS-ASR) for simultaneous speech recognition and speaker diarization of single-channel dialogue recordings. TS-ASR is a technique to automatically extract and…

计算与语言 · 计算机科学 2019-09-19 Naoyuki Kanda , Shota Horiguchi , Yusuke Fujita , Yawen Xue , Kenji Nagamatsu , Shinji Watanabe

Accurate transcription and speaker diarization of child-adult spoken interactions are crucial for developmental and clinical research. However, manual annotation is time-consuming and challenging to scale. Existing automated systems…

音频与语音处理 · 电气工程与系统科学 2026-01-27 Anfeng Xu , Tiantian Feng , Somer Bishop , Catherine Lord , Shrikanth Narayanan

Most existing automatic speech recognition (ASR) research evaluate models using in-domain datasets. However, they seldom evaluate how they generalize across diverse speech contexts. This study addresses this gap by benchmarking seven Akan…

This report describes the submitted system to the In-Car Multi-Channel Automatic Speech Recognition (ICMC-ASR) challenge, which considers the ASR task with multi-speaker overlapping and Mandarin accent dynamics in the ICMC case. We…

As human-machine voice interfaces provide easy access to increasingly intelligent machines, many state-of-the-art automatic speech recognition (ASR) systems are proposed. However, commercial ASR systems usually have poor performance on…

计算与语言 · 计算机科学 2023-09-28 Yanan Jia

In this paper, we present the submitted system for the second DIHARD Speech Diarization Challenge from the DKULENOVO team. Our diarization system includes multiple modules, namely voice activity detection (VAD), segmentation, speaker…

音频与语音处理 · 电气工程与系统科学 2020-05-06 Qingjian Lin , Weicheng Cai , Lin Yang , Junjie Wang , Jun Zhang , Ming Li

Although automatic emotion recognition (AER) has recently drawn significant research interest, most current AER studies use manually segmented utterances, which are usually unavailable for dialogue systems. This paper proposes integrating…

音频与语音处理 · 电气工程与系统科学 2023-08-15 Wen Wu , Chao Zhang , Philip C. Woodland

Code-switching (CS) automatic speech recognition (ASR) faces challenges due to the language confusion resulting from accents, auditory similarity, and seamless language switches. Adaptation on the pre-trained multi-lingual model has shown…

计算与语言 · 计算机科学 2025-01-07 Jiahui Zhao , Hao Shi , Chenrui Cui , Tianrui Wang , Hexin Liu , Zhaoheng Ni , Lingxuan Ye , Longbiao Wang

Bengali is spoken by over 230 million people yet remains severely under-served in automatic speech recognition (ASR) and speaker diarization research. In this paper, we present our system for the DL Sprint 4.0 Bengali Long-Form Speech…

计算与语言 · 计算机科学 2026-03-23 Md. Nazmus Sakib , Shafiul Tanvir , Mesbah Uddin Ahamed , H. M. Aktaruzzaman Mukdho

In this paper, we present a neural spoken language diarization model that supports an unconstrained span of languages within a single framework. Our approach integrates a learnable query-based architecture grounded in multilingual…

计算与语言 · 计算机科学 2025-10-02 Sangmin Lee , Woongjib Choi , Jihyun Kim , Hong-Goo Kang

The scarcity of labeled audio-visual datasets is a constraint for training superior audio-visual speaker diarization systems. To improve the performance of audio-visual speaker diarization, we leverage pre-trained supervised and…

音频与语音处理 · 电气工程与系统科学 2023-12-08 Huan Zhao , Li Zhang , Yue Li , Yannan Wang , Hongji Wang , Wei Rao , Qing Wang , Lei Xie

This study explores fine-tuning multilingual ASR (Automatic Speech Recognition) models, specifically OpenAI's Whisper-Tiny, to improve performance in Japanese. While multilingual models like Whisper offer versatility, they often lack…

计算与语言 · 计算机科学 2024-12-17 Mark Bajo , Haruka Fukukawa , Ryuji Morita , Yuma Ogasawara

This paper describes the FlySpeech speaker diarization system submitted to the second \textbf{M}ultimodal \textbf{I}nformation Based \textbf{S}peech \textbf{P}rocessing~(\textbf{MISP}) Challenge held in ICASSP 2022. We develop an end-to-end…

声音 · 计算机科学 2023-07-31 Li Zhang , Huan Zhao , Yue Li , Bowen Pang , Yannan Wang , Hongji Wang , Wei Rao , Qing Wang , Lei Xie

Self-supervised speech models such as wav2vec2.0 and WavLM have been shown to significantly improve the performance of many downstream speech tasks, especially in low-resource settings, over the past few years. Despite this, evaluations on…

音频与语音处理 · 电气工程与系统科学 2025-12-18 Séverin Baroudi , Hervé Bredin , Joseph Razik , Ricard Marxer

We describe the speech activity detection (SAD), speaker diarization (SD), and automatic speech recognition (ASR) experiments conducted by the Behavox team for the Interspeech 2020 Fearless Steps Challenge (FSC-2). A relatively small amount…

音频与语音处理 · 电气工程与系统科学 2020-08-05 Arseniy Gorin , Daniil Kulko , Steven Grima , Alex Glasman

This paper presents a novel framework for joint speaker diarization (SD) and automatic speech recognition (ASR), named SLIDAR (sliding-window diarization-augmented recognition). SLIDAR can process arbitrary length inputs and can handle any…

音频与语音处理 · 电气工程与系统科学 2023-10-04 Samuele Cornell , Jee-weon Jung , Shinji Watanabe , Stefano Squartini

This article concerns comparative studies on the Automatic Speech Recognition (ASR) model incorporated with the Large Language Model (LLM) used for medical interviews. The proposed solution is tested on polish language benchmarks and…

音频与语音处理 · 电气工程与系统科学 2026-03-04 Marcin Pietroń , Szymon Piórkowski , Kamil Faber , Dominik Żurek , Michał Karwatowski , Jerzy Duda , Hubert Zieliński , Piotr Lipnicki , Mikołaj Leszczuk