English
Related papers

Related papers: Gated Recurrent Context: Softmax-free Attention fo…

200 papers

Decoding the attended speaker in a multi-speaker environment from electroencephalography (EEG) has attracted growing interest in recent years, with neuro-steered hearing devices as a driver application. Current approaches typically rely on…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Yuanyuan Yao , Simon Geirnaert , Tinne Tuytelaars , Alexander Bertrand

Alzheimer's disease (AD) is a progressive neurodegenerative disease and recently attracts extensive attention worldwide. Speech technology is considered a promising solution for the early diagnosis of AD and has been enthusiastically…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-05 Ying Qin , Wei Liu , Zhiyuan Peng , Si-Ioi Ng , Jingyu Li , Haibo Hu , Tan Lee

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

Computation and Language · Computer Science 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

In the realm of automatic speech recognition (ASR), robustness in noisy environments remains a significant challenge. Recent ASR models, such as Whisper, have shown promise, but their efficacy in noisy conditions can be further enhanced.…

Sound · Computer Science 2024-06-28 Yehoshua Dissen , Shiry Yonash , Israel Cohen , Joseph Keshet

This paper proposes a unified framework, All-in-One ASR, that allows a single model to support multiple automatic speech recognition (ASR) paradigms, including connectionist temporal classification (CTC), attention-based encoder-decoder…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-15 Takafumi Moriya , Masato Mimura , Tomohiro Tanaka , Hiroshi Sato , Ryo Masumura , Atsunori Ogawa

End-to-end (E2E) automatic speech recognition (ASR) systems often have difficulty recognizing uncommon words, that appear infrequently in the training data. One promising method, to improve the recognition accuracy on such rare words, is to…

Computation and Language · Computer Science 2021-11-08 Feng-Ju Chang , Jing Liu , Martin Radfar , Athanasios Mouchtaris , Maurizio Omologo , Ariya Rastrow , Siegfried Kunzmann

Recent publications on automatic-speech-recognition (ASR) have a strong focus on attention encoder-decoder (AED) architectures which tend to suffer from over-fitting in low resource scenarios. One solution to tackle this issue is to…

Computation and Language · Computer Science 2021-07-14 Nick Rossenbach , Mohammad Zeineldeen , Benedikt Hilmes , Ralf Schlüter , Hermann Ney

Automatic Speech Recognition (ASR) has seen remarkable progress, with models like OpenAI Whisper and NVIDIA Canary achieving state-of-the-art (SOTA) performance in offline transcription. However, these models are not designed for streaming…

Computation and Language · Computer Science 2026-04-07 Tomer Krichli , Bhiksha Raj , Joseph Keshet

Auditory Attention Decoding (AAD) can help to determine the identity of the attended speaker during an auditory selective attention task, by analyzing and processing measurements of electroencephalography (EEG) data. Most studies on AAD are…

Signal Processing · Electrical Eng. & Systems 2024-09-16 Haolin Zhu , Yujie Yan , Xiran Xu , Zhongshu Ge , Pei Tian , Xihong Wu , Jing Chen

Transformers, originally proposed for natural language processing (NLP) tasks, have recently achieved great success in automatic speech recognition (ASR). However, adjacent acoustic units (i.e., frames) are highly correlated, and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Yangyang Shi , Yongqiang Wang , Chunyang Wu , Christian Fuegen , Frank Zhang , Duc Le , Ching-Feng Yeh , Michael L. Seltzer

Non-autoregressive (NAR) modeling has gained more and more attention in speech processing. With recent state-of-the-art attention-based automatic speech recognition (ASR) structure, NAR can realize promising real-time factor (RTF)…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-21 Tianzi Wang , Yuya Fujita , Xuankai Chang , Shinji Watanabe

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

The Transformer self-attention network has recently shown promising performance as an alternative to recurrent neural networks (RNNs) in end-to-end (E2E) automatic speech recognition (ASR) systems. However, the Transformer has a drawback in…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-17 Emiru Tsunoo , Yosuke Kashiwagi , Toshiyuki Kumakura , Shinji Watanabe

Code-switching speech recognition has attracted an increasing interest recently, but the need for expert linguistic knowledge has always been a big issue. End-to-end automatic speech recognition (ASR) simplifies the building of ASR systems…

Computation and Language · Computer Science 2018-11-02 Ne Luo , Dongwei Jiang , Shuaijiang Zhao , Caixia Gong , Wei Zou , Xiangang Li

Recent promising results in auditory attention decoding (AAD) using scalp electroencephalography (EEG) have motivated the exploration of cEEGrid, a flexible and portable ear-EEG system. While prior cEEGrid-based studies have confirmed the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-23 Yuanming Zhang , Zeyan Song , Jing Lu , Fei Chen , Zhibin Lin

Recent advances in Automatic Speech Recognition (ASR) demonstrated how end-to-end systems are able to achieve state-of-the-art performance. There is a trend towards deeper neural networks, however those ASR models are also more complex and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-22 Ludwig Kürzinger , Edgar Ricardo Chavez Rosas , Lujun Li , Tobias Watzel , Gerhard Rigoll

Auditory attention decoding from electroencephalogram (EEG) could infer to which source the user is attending in noisy environments. Decoding algorithms and experimental paradigm designs are crucial for the development of technology in…

Machine Learning · Computer Science 2025-01-08 Keren Shi , Xu Liu , Xue Yuan , Haijie Shang , Ruiting Dai , Hanbin Wang , Yunfa Fu , Ning Jiang , Jiayuan He

Conventional automatic speech recognition (ASR) typically performs multi-level pattern recognition tasks that map the acoustic speech waveform into a hierarchy of speech units. But, it is widely known that information loss in the earlier…

Computation and Language · Computer Science 2017-09-25 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Hotword customization is one of the concerned issues remained in ASR field - it is of value to enable users of ASR systems to customize names of entities, persons and other phrases to obtain better experience. The past few years have seen…

Sound · Computer Science 2023-12-27 Xian Shi , Yexin Yang , Zerui Li , Yanni Chen , Zhifu Gao , Shiliang Zhang

We present a Conformer-based end-to-end neural diarization (EEND) model that uses both acoustic input and features derived from an automatic speech recognition (ASR) model. Two categories of features are explored: features derived directly…

Computation and Language · Computer Science 2022-07-13 Aparna Khare , Eunjung Han , Yuguang Yang , Andreas Stolcke