English
Related papers

Related papers: Learning Domain Specific Language Models for Autom…

200 papers

As human-machine voice interfaces provide easy access to increasingly intelligent machines, many state-of-the-art automatic speech recognition (ASR) systems are proposed. However, commercial ASR systems usually have poor performance on…

Computation and Language · Computer Science 2023-09-28 Yanan Jia

Conversational speech normally is embodied with loose syntactic structures at the utterance level but simultaneously exhibits topical coherence relations across consecutive utterances. Prior work has shown that capturing longer context…

Computation and Language · Computer Science 2022-06-02 Bi-Cheng Yan , Hsin-Wei Wang , Shih-Hsuan Chiu , Hsuan-Sheng Chiu , Berlin Chen

Multi-speaker automatic speech recognition (MS-ASR) faces significant challenges in transcribing overlapped speech, a task critical for applications like meeting transcription and conversational analysis. While serialized output training…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-09 Yuke Lin , Ming Cheng , Ze Li , Beilong Tang , Ming Li

Automatic speech recognition (ASR) has recently become an important challenge when using deep learning (DL). It requires large-scale training datasets and high computational and storage resources. Moreover, DL techniques and machine…

Sound · Computer Science 2023-08-01 Hamza Kheddar , Yassine Himeur , Somaya Al-Maadeed , Abbes Amira , Faycal Bensaali

Through the development of neural machine translation, the quality of machine translation systems has been improved significantly. By exploiting advancements in deep learning, systems are now able to better approximate the complex mapping…

Computation and Language · Computer Science 2018-08-03 Jan Niehues , Ngoc-Quan Pham , Thanh-Le Ha , Matthias Sperber , Alex Waibel

Standard neural machine translation (NMT) is on the assumption that the document-level context is independent. Most existing document-level NMT approaches are satisfied with a smattering sense of global document-level information, while…

Computation and Language · Computer Science 2021-08-25 Shu Jiang , Rui Wang , Zuchao Li , Masao Utiyama , Kehai Chen , Eiichiro Sumita , Hai Zhao , Bao-liang Lu

Resolving semantic ambiguity has long been recognised as a central challenge in the field of Machine Translation. Recent work on benchmarking translation performance on ambiguous sentences has exposed the limitations of conventional Neural…

Computation and Language · Computer Science 2023-10-24 Vivek Iyer , Pinzhen Chen , Alexandra Birch

Building conversational speech recognition systems for new languages is constrained by the availability of utterances that capture user-device interactions. Data collection is both expensive and limited by the speed of manual transcription.…

Computation and Language · Computer Science 2019-12-03 Surabhi Punjabi , Harish Arsikere , Sri Garimella

This paper presents a newly developed, simultaneous neural speech-to-speech translation system and its evaluation. The system consists of three fully-incremental neural processing modules for automatic speech recognition (ASR), machine…

Computation and Language · Computer Science 2020-11-12 Katsuhito Sudoh , Takatomo Kano , Sashi Novitasari , Tomoya Yanagita , Sakriani Sakti , Satoshi Nakamura

Neural machine translation (NMT) becomes a new state-of-the-art and achieves promising translation results using a simple encoder-decoder neural network. This neural network is trained once on the parallel corpus and the fixed network is…

Computation and Language · Computer Science 2016-09-22 Xiaoqing Li , Jiajun Zhang , Chengqing Zong

Neural Machine Translation (NMT) models have demonstrated strong state of the art performance on translation tasks where well-formed training and evaluation data are provided, but they remain sensitive to inputs that include errors of…

Computation and Language · Computer Science 2020-10-22 Daniel Li , Te I , Naveen Arivazhagan , Colin Cherry , Dirk Padfield

This paper tackles several challenges that arise when integrating Automatic Speech Recognition (ASR) and Machine Translation (MT) for real-time, on-device streaming speech translation. Although state-of-the-art ASR systems based on…

Computation and Language · Computer Science 2025-08-20 Zeeshan Ahmed , Frank Seide , Niko Moritz , Ju Lin , Ruiming Xie , Simone Merello , Zhe Liu , Christian Fuegen

Neural Machine translation is a challenging task due to the inherent complex nature and the fluidity that natural languages bring. Nonetheless, in recent years, it has achieved state-of-the-art performance in several language pairs.…

Computation and Language · Computer Science 2023-04-19 Vakul Goyle , Parvathy Krishnaswamy , Kannan Girija Ravikumar , Utsa Chattopadhyay , Kartikay Goyle

Document-level machine translation incorporates inter-sentential dependencies into the translation of a source sentence. In this paper, we propose a new framework to model cross-sentence dependencies by training neural machine translation…

Computation and Language · Computer Science 2020-03-31 Pei Zhang , Xu Zhang , Wei Chen , Jian Yu , Yanfeng Wang , Deyi Xiong

We develop a large language model (LLM) based automatic speech recognition (ASR) system that can be contextualized by providing keywords as prior information in text prompts. We adopt decoder-only architecture and use our in-house LLM,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-14 Kento Nozawa , Takashi Masuko , Toru Taniguchi

Phrase-based statistical machine translation (SMT) systems have previously been used for the task of grammatical error correction (GEC) to achieve state-of-the-art accuracy. The superiority of SMT systems comes from their ability to learn…

Computation and Language · Computer Science 2016-06-02 Shamil Chollampatt , Kaveh Taghipour , Hwee Tou Ng

Although Automatic Speech Recognition (ASR) systems have achieved human-like performance for a few languages, the majority of the world's languages do not have usable systems due to the lack of large speech datasets to train these models.…

Computation and Language · Computer Science 2022-02-28 Hemant Yadav , Sunayana Sitaram

In simultaneous machine translation, the objective is to determine when to produce a partial translation given a continuous stream of source words, with a trade-off between latency and quality. We propose a neural machine translation (NMT)…

Computation and Language · Computer Science 2020-06-01 Patrick Wilken , Tamer Alkhouli , Evgeny Matusov , Pavel Golik

Neural Machine Translation (NMT) is the task of translating a text from one language to another with the use of a trained neural network. Several existing works aim at incorporating external information into NMT models to improve or control…

Computation and Language · Computer Science 2024-04-30 Charles Brazier , Jean-Luc Rouas

Neural network language model (NNLM) plays an essential role in automatic speech recognition (ASR) systems, especially in adaptation tasks when text-only data is available. In practice, an NNLM is typically trained on a combination of data…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-11 Yingyi Ma , Zhe Liu , Xuedong Zhang