English
Related papers

Related papers: Automatic Spelling Correction with Transformer for…

200 papers

Recently, end-to-end automatic speech recognition has become the mainstream approach in both industry and academia. To optimize system performance in specific scenarios, the Weighted Finite-State Transducer (WFST) is extensively used to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-08 Wei Zhang , Tian-Hao Zhang , Chao Luo , Hui Zhou , Chao Yang , Xinyuan Qian , Xu-Cheng Yin

Chinese spelling correction (CSC) is a crucial task that aims to correct character errors in Chinese text. While conventional CSC focuses on character substitution errors caused by mistyping, two other common types of character errors,…

Computation and Language · Computer Science 2025-06-17 Houquan Zhou , Bo Zhang , Zhenghua Li , Ming Yan , Min Zhang

Chinese Spelling Check (CSC) is a meaningful task in the area of Natural Language Processing (NLP) which aims at detecting spelling errors in Chinese texts and then correcting these errors. However, CSC models are based on pretrained…

Computation and Language · Computer Science 2024-01-29 Xi Wang , Ruoqing Zhao , Hongliang Dai , Piji Li

Recently, end-to-end mispronunciation detection and diagnosis (MD&D) systems has become a popular alternative to greatly simplify the model-building process of conventional hybrid DNN-HMM systems by representing complicated modules with a…

Computation and Language · Computer Science 2021-04-20 Kaiqi Fu , Jones Lin , Dengfeng Ke , Yanlu Xie , Jinsong Zhang , Binghuai Lin

State-of-the-art approaches to spelling error correction problem include Transformer-based Seq2Seq models, which require large training sets and suffer from slow inference time; and sequence labeling models based on Transformer encoders…

Computation and Language · Computer Science 2021-09-30 Mengyi Gao , Canran Xu , Peng Shi

There has been an increasing interest in large speech models that can perform multiple tasks in a single model. Such models usually adopt an encoder-decoder or decoder-only architecture due to their popularity and good performance in many…

Computation and Language · Computer Science 2024-08-28 Yifan Peng , Yui Sudo , Muhammad Shakeel , Shinji Watanabe

There is often a trade-off between performance and latency in streaming automatic speech recognition (ASR). Traditional methods such as look-ahead and chunk-based methods, usually require information from future frames to advance…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-07 Zehan Li , Haoran Miao , Keqi Deng , Gaofeng Cheng , Sanli Tian , Ta Li , Yonghong Yan

Chinese Spelling Correction (CSC) aims to detect and correct erroneous characters in Chinese texts. Although efforts have been made to introduce phonetic information (Hanyu Pinyin) in this task, they typically merge phonetic representations…

Computation and Language · Computer Science 2023-05-25 Zihong Liang , Xiaojun Quan , Qifan Wang

The choice of modeling units is crucial for automatic speech recognition (ASR) tasks. In mandarin scenarios, the Chinese characters represent meaning but are not directly related to the pronunciation. Thus only considering the writing of…

Computation and Language · Computer Science 2022-10-19 Yuting Yang , Binbin Du , Yuke Li

The goal of accent conversion (AC) is to convert speech accents while preserving content and speaker identity. Previous methods either required reference utterances during inference, did not preserve speaker identity well, or used…

Sound · Computer Science 2024-10-08 Tuan Nam Nguyen , Ngoc Quan Pham , Alexander Waibel

This paper presents the use of non-autoregressive (NAR) approaches for joint automatic speech recognition (ASR) and spoken language understanding (SLU) tasks. The proposed NAR systems employ a Conformer encoder that applies connectionist…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-24 Mohan Li , Rama Doddipatla

Code-switching (CSW) is a common phenomenon among multilingual speakers where multiple languages are used in a single discourse or utterance. Mixed language utterances may still contain grammatical errors however, yet most existing Grammar…

Computation and Language · Computer Science 2024-08-13 Kelvin Wey Han Chan , Christopher Bryant , Li Nguyen , Andrew Caines , Zheng Yuan

Deep learning based methods have been dominating the text recognition tasks in different and multilingual scenarios. The offline handwritten Chinese text recognition (HCTR) is one of the most challenging tasks because it involves thousands…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Brian Liu , Xianchao Xu , Yu Zhang

We present a novel method of performing spelling correction on short input strings, such as search queries or individual words. At its core lies a procedure for generating artificial typos which closely follow the error patterns manifested…

Computation and Language · Computer Science 2021-05-14 Alex Kuznetsov , Hector Urdiales

End-to-end (E2E) automatic speech recognition (ASR) systems have revolutionized the field by integrating all components into a single neural network, with attention-based encoder-decoder models achieving state-of-the-art performance.…

Computation and Language · Computer Science 2025-07-01 Duygu Altinok

In this study, we propose advancing all-neural speech recognition by directly incorporating attention modeling within the Connectionist Temporal Classification (CTC) framework. In particular, we derive new context vectors using time…

Computation and Language · Computer Science 2018-03-16 Amit Das , Jinyu Li , Rui Zhao , Yifan Gong

Phrase-based statistical machine translation (SMT) systems have previously been used for the task of grammatical error correction (GEC) to achieve state-of-the-art accuracy. The superiority of SMT systems comes from their ability to learn…

Computation and Language · Computer Science 2016-06-02 Shamil Chollampatt , Kaveh Taghipour , Hwee Tou Ng

It is challenging to extract semantic meanings directly from audio signals in spoken language understanding (SLU), due to the lack of textual information. Popular end-to-end (E2E) SLU models utilize sequence-to-sequence automatic speech…

Computation and Language · Computer Science 2023-06-05 Jixuan Wang , Martin Radfar , Kai Wei , Clement Chung

This study propose a fully automated system for speech correction and accent reduction. Consider the application scenario that a recorded speech audio contains certain errors, e.g., inappropriate words, mispronunciations, that need to be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-17 Daxin Tan , Liqun Deng , Nianzu Zheng , Yu Ting Yeung , Xin Jiang , Xiao Chen , Tan Lee

Recently, many studies have shown the efficiency of using Bidirectional Encoder Representations from Transformers (BERT) in various Natural Language Processing (NLP) tasks. Specifically, English spelling correction task that uses…

Computation and Language · Computer Science 2024-05-07 Hieu Ngo Trung , Duong Tran Ham , Tin Huynh , Kiem Hoang