English
Related papers

Related papers: Spelling Error Correction with Soft-Masked BERT

200 papers

Connectionist Temporal Classification (CTC) based end-to-end speech recognition system usually need to incorporate an external language model by using WFST-based decoding in order to achieve promising results. This is more essential to…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-24 Shiliang Zhang , Ming Lei , Zhijie Yan

Chinese Spell Checking (CSC) task aims to detect and correct Chinese spelling errors. Recently, related researches focus on introducing character similarity from confusion set to enhance the CSC models, ignoring the context of characters…

Computation and Language · Computer Science 2023-03-02 Ding Zhang , Yinghui Li , Qingyu Zhou , Shirong Ma , Yangning Li , Yunbo Cao , Hai-Tao Zheng

Chinese Grammatical Error Correction (CGEC) aims to generate a correct sentence from an erroneous sequence, where different kinds of errors are mixed. This paper divides the CGEC task into two steps, namely spelling error correction and…

Computation and Language · Computer Science 2022-11-04 Xiuyu Wu , Yunfang Wu

Chinese Automatic Speech Recognition (ASR) error correction presents significant challenges due to the Chinese language's unique features, including a large character set and borderless, morpheme-based structure. Current mainstream models…

Computation and Language · Computer Science 2023-08-08 Jiaxin Fan , Yong Zhang , Hanzhang Li , Jianzong Wang , Zhitao Li , Sheng Ouyang , Ning Cheng , Jing Xiao

Chinese spelling correction (CSC) is a crucial task that aims to correct character errors in Chinese text. While conventional CSC focuses on character substitution errors caused by mistyping, two other common types of character errors,…

Computation and Language · Computer Science 2025-06-17 Houquan Zhou , Bo Zhang , Zhenghua Li , Ming Yan , Min Zhang

We previously proposed contextual spelling correction (CSC) to correct the output of end-to-end (E2E) automatic speech recognition (ASR) models with contextual information such as name, place, etc. Although CSC has achieved reasonable…

Sound · Computer Science 2023-02-23 Xiaoqiang Wang , Yanqing Liu , Jinyu Li , Sheng Zhao

Chinese Spelling Correction (CSC) is gaining increasing attention due to its promise of automatically detecting and correcting spelling errors in Chinese texts. Despite its extensive use in many applications, like search engines and optical…

Computation and Language · Computer Science 2022-10-24 Wangjie Jiang , Zhihao Ye , Zijing Ou , Ruihui Zhao , Jianguang Zheng , Yi Liu , Siheng Li , Bang Liu , Yujiu Yang , Yefeng Zheng

Automatic spelling and grammatical correction systems are one of the most widely used tools within natural language applications. In this thesis, we assume the task of error correction as a type of monolingual machine translation where the…

Computation and Language · Computer Science 2018-10-02 Sina Ahmadi

Chinese spelling check is a task to detect and correct spelling mistakes in Chinese text. Existing research aims to enhance the text representation and use multi-source information to improve the detection and correction capabilities of…

Computation and Language · Computer Science 2023-07-07 Nankai Lin , Hongyan Wu , Sihui Fu , Shengyi Jiang , Aimin Yang

With the development of pre-trained models and the incorporation of phonetic and graphic information, neural models have achieved high scores in Chinese Spelling Check (CSC). However, it does not provide a comprehensive reflection of the…

Computation and Language · Computer Science 2023-07-26 Xunjian Yin , Xiaojun Wan

Chinese Spelling Check (CSC) aims to detect and correct error tokens in Chinese contexts, which has a wide range of applications. However, it is confronted with the challenges of insufficient annotated data and the issue that previous…

Computation and Language · Computer Science 2024-02-27 Xunjian Yin , Xinyu Hu , Jin Jiang , Xiaojun Wan

Recent advancements in large language models (LLMs) demonstrate exceptional Chinese text processing capabilities, particularly in Chinese Spelling Correction (CSC). While LLMs outperform traditional BERT-based models in accuracy and…

Computation and Language · Computer Science 2025-05-15 Sophie Zhang , Zhiming Lin

Chinese Spell Checking (CSC) aims to detect and correct Chinese spelling errors. Recent researches start from the pretrained knowledge of language models and take multimodal information into CSC models to improve the performance. However,…

Computation and Language · Computer Science 2022-10-20 Yinghui Li , Shirong Ma , Qingyu Zhou , Zhongli Li , Li Yangning , Shulin Huang , Ruiyang Liu , Chao Li , Yunbo Cao , Haitao Zheng

Achieving reliable communication has long been a fundamental challenge in networked systems. Semantic Error Correction (SEC) leverages the semantic understanding capabilities of language models (LMs) to perform application-layer error…

Information Theory · Computer Science 2026-03-30 Yirun Wang , Yuyang Du , Soung Chang Liew , Yuchen Pan , Feifan Zhang , Lihao Zhang

In computing, spell checking is the process of detecting and sometimes providing spelling suggestions for incorrectly spelled words in a text. Basically, a spell checker is a computer program that uses a dictionary of words to perform spell…

Computation and Language · Computer Science 2012-04-27 Youssef Bassil , Mohammad Alwani

Since automatic translations can contain errors that require substantial human post-editing, machine translation proofreading is essential for improving quality. This paper proposes a novel hybrid approach for robust proofreading that…

Computation and Language · Computer Science 2025-06-06 Feijun Liu , Huifeng Wang , Kun Wang , Yizhen Wang

Chinese Spelling Correction (CSC) aims to detect and correct erroneous characters in Chinese texts. Although efforts have been made to introduce phonetic information (Hanyu Pinyin) in this task, they typically merge phonetic representations…

Computation and Language · Computer Science 2023-05-25 Zihong Liang , Xiaojun Quan , Qifan Wang

In recent years BERT shows apparent advantages and great potential in natural language processing tasks. However, both training and applying BERT requires intensive time and resources for computing contextual language representations, which…

Computation and Language · Computer Science 2021-11-05 Tan Huang

Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and consecutive variants have been proposed to further improve the performance of the pre-trained language models. In…

Computation and Language · Computer Science 2020-12-14 Yiming Cui , Wanxiang Che , Ting Liu , Bing Qin , Shijin Wang , Guoping Hu

Lexicon information and pre-trained models, such as BERT, have been combined to explore Chinese sequence labelling tasks due to their respective strengths. However, existing methods solely fuse lexicon features via a shallow and random…

Computation and Language · Computer Science 2021-12-28 Wei Liu , Xiyan Fu , Yue Zhang , Wenming Xiao