English
Related papers

Related papers: Contextualized Token Discrimination for Speech Sea…

200 papers

General-purpose automatic speech recognition (ASR) systems do not always perform well in goal-oriented dialogue. Existing ASR correction methods rely on prior user data or named entities. We extend correction to tasks that have no prior…

Computation and Language · Computer Science 2025-01-13 Yuya Asano , Sabit Hassan , Paras Sharma , Anthony Sicilia , Katherine Atwell , Diane Litman , Malihe Alikhani

In multi-talker scenarios such as meetings and conversations, speech processing systems are usually required to segment the audio and then transcribe each segmentation. These two stages are addressed separately by speaker change detection…

Sound · Computer Science 2022-11-18 Zhiyun Fan , Zhenlin Liang , Linhao Dong , Yi Liu , Shiyu Zhou , Meng Cai , Jun Zhang , Zejun Ma , Bo Xu

This paper presents the first unsupervised approach to lexical semantic change that makes use of contextualised word representations. We propose a novel method that exploits the BERT neural language model to obtain representations of word…

Computation and Language · Computer Science 2020-10-21 Mario Giulianelli , Marco Del Tredici , Raquel Fernández

Spoken conversational question answering (SCQA) requires machines to model complex dialogue flow given the speech utterances and text corpora. Different from traditional text question answering (QA) tasks, SCQA involves audio signal…

Computation and Language · Computer Science 2021-06-25 Chenyu You , Nuo Chen , Yuexian Zou

Despite recent advances in end-to-end speech recognition methods, the output tends to be biased to the training data's vocabulary, resulting in inaccurate recognition of proper nouns and other unknown terms. To address this issue, we…

Computation and Language · Computer Science 2025-06-03 Yu Nakagome , Michael Hentschel

This paper presents our latest investigations on dialog act (DA) classification on automatically generated transcriptions. We propose a novel approach that combines convolutional neural networks (CNNs) and conditional random fields (CRFs)…

Computation and Language · Computer Science 2019-03-01 Daniel Ortega , Chia-Yu Li , Gisela Vallejo , Pavel Denisov , Ngoc Thang Vu

Code-switching (CS) refers to the phenomenon that languages switch within a speech signal and leads to language confusion for automatic speech recognition (ASR). This paper aims to address language confusion for improving CS-ASR from two…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-27 Hexin Liu , Haihua Xu , Leibny Paola Garcia , Andy W. H. Khong , Yi He , Sanjeev Khudanpur

Connectionist Temporal Classification (CTC) models are popular for their balance between speed and performance for Automatic Speech Recognition (ASR). However, these CTC models still struggle in other areas, such as personalization towards…

Computation and Language · Computer Science 2023-07-04 Devang Kulshreshtha , Saket Dingliwal , Brady Houston , Sravan Bodapati

Existing natural language processing systems are vulnerable to noisy inputs resulting from misspellings. On the contrary, humans can easily infer the corresponding correct words from their misspellings and surrounding context. Inspired by…

Computation and Language · Computer Science 2025-05-19 Xiangci Li , Hairong Liu , Liang Huang

Recently, the advance in deep learning has brought a considerable improvement in the end-to-end speech recognition field, simplifying the traditional pipeline while producing promising results. Among the end-to-end models, the connectionist…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-29 Ji Won Yoon , Beom Jun Woo , Sunghwan Ahn , Hyeonseung Lee , Nam Soo Kim

Connectionist Temporal Classification (CTC) based end-to-end speech recognition system usually need to incorporate an external language model by using WFST-based decoding in order to achieve promising results. This is more essential to…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-24 Shiliang Zhang , Ming Lei , Zhijie Yan

The fusion of speech and language in the era of large language models has garnered significant attention. Discrete speech token is often utilized in text-to-speech tasks for speech compression and portability, which is convenient for joint…

Sound · Computer Science 2025-04-01 Yixing Li , Ruobing Xie , Xingwu Sun , Yu Cheng , Zhanhui Kang

Conversational Query Reformulation (CQR) has significantly advanced in addressing the challenges of conversational search, particularly those stemming from the latent user intent and the need for historical context. Recent works aimed to…

Computation and Language · Computer Science 2025-01-06 Yilong Lai , Jialong Wu , Congzhi Zhang , Haowen Sun , Deyu Zhou

Automatic speech recognition (ASR) is a relevant area in multiple settings because it provides a natural communication mechanism between applications and users. ASRs often fail in environments that use language specific to particular…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Rafael Viana-Cámara , Mario Campos-Soberanis , Diego Campos-Sobrino

Automatic Speech Recognition (ASR) is an area of growing academic and commercial interest due to the high demand for applications that use it to provide a natural communication method. It is common for general purpose ASR systems to fail in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-24 Rafael Viana-Cámara , Diego Campos-Sobrino , Mario Campos-Soberanis

Sound event localization and detection (SELD) aims to determine the appearance of sound classes, together with their Direction of Arrival (DOA). However, current SELD systems can only predict the activities of specific classes, for example,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-25 Jinzheng Zhao , Xinyuan Qian , Yong Xu , Haohe Liu , Yin Cao , Davide Berghi , Wenwu Wang

Speech applications dealing with conversations require not only recognizing the spoken words, but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate…

Computation and Language · Computer Science 2019-07-12 Laurent El Shafey , Hagen Soltau , Izhak Shafran

The enormous growth of research publications has made it challenging for academic search engines to bring the most relevant papers against the given search query. Numerous solutions have been proposed over the years to improve the…

Information Retrieval · Computer Science 2023-01-27 Shah Khalid , Shah Khusro , Aftab Alam , Abdul Wahid

Automatic Speech Recognition (ASR) has witnessed a profound research interest. Recent breakthroughs have given ASR systems different prospects such as faithfully transcribing spoken language, which is a pivotal advancement in building…

Computation and Language · Computer Science 2024-03-05 Ankitha Sudarshan , Vinay Samuel , Parth Patwa , Ibtihel Amara , Aman Chadha

Connectionist Temporal Classification (CTC) is a widely used approach for automatic speech recognition (ASR) that performs conditionally independent monotonic alignment. However for translation, CTC exhibits clear limitations due to the…

Computation and Language · Computer Science 2022-10-12 Brian Yan , Siddharth Dalmia , Yosuke Higuchi , Graham Neubig , Florian Metze , Alan W Black , Shinji Watanabe