English
Related papers

Related papers: Rethinking Masked Language Modeling for Chinese Sp…

200 papers

The lack of label data is one of the significant bottlenecks for Chinese Spelling Check (CSC). Existing researches use the method of automatic generation by exploiting unlabeled data to expand the supervised corpus. However, there is a big…

Computation and Language · Computer Science 2022-12-08 Qi Lv , Ziqiang Cao , Lei Geng , Chunhui Ai , Xu Yan , Guohong Fu

Due to the recent advances of natural language processing, several works have applied the pre-trained masked language model (MLM) of BERT to the post-correction of speech recognition. However, existing pre-trained models only consider the…

Computation and Language · Computer Science 2021-11-17 Yi-Chang Chen , Chun-Yen Cheng , Chien-An Chen , Ming-Chieh Sung , Yi-Ren Yeh

Chinese Spell Checking (CSC) aims to detect and correct spelling errors in sentences. Despite Large Language Models (LLMs) exhibit robust capabilities and are widely applied in various tasks, their performance on CSC is often…

Computation and Language · Computer Science 2024-10-29 Kunting Li , Yong Hu , Liang He , Fandong Meng , Jie Zhou

Existing Chinese text error detection mainly focuses on spelling and simple grammatical errors. These errors have been studied extensively and are relatively simple for humans. On the contrary, Chinese semantic errors are understudied and…

Computation and Language · Computer Science 2022-04-18 Bo Sun , Baoxin Wang , Wanxiang Che , Dayong Wu , Zhigang Chen , Ting Liu

Chinese Spelling Correction (CSC) aims to detect and correct erroneous tokens in sentences. Traditional CSC focuses on equal length correction and uses pretrained language models (PLMs). While Large Language Models (LLMs) have shown…

Computation and Language · Computer Science 2025-08-12 Junhong Liang , Yu Zhou

Chinese spelling correction (CSC) is a crucial task that aims to correct character errors in Chinese text. While conventional CSC focuses on character substitution errors caused by mistyping, two other common types of character errors,…

Computation and Language · Computer Science 2025-06-17 Houquan Zhou , Bo Zhang , Zhenghua Li , Ming Yan , Min Zhang

Chinese Spelling Correction (CSC) is a critical task in natural language processing, aimed at detecting and correcting spelling errors in Chinese text. This survey provides a comprehensive overview of CSC, tracing its evolution from…

Computation and Language · Computer Science 2025-02-18 Changchun Liu , Kai Zhang , Junzhe Jiang , Zixiao Kong , Qi Liu , Enhong Chen

Spelling irregularities, known now as spelling mistakes, have been found for several centuries. As humans, we are able to understand most of the misspelled words based on their location in the sentence, perceived pronunciation, and context.…

Computation and Language · Computer Science 2021-01-12 Yifei Hu , Xiaonan Jing , Youlim Ko , Julia Taylor Rayz

Lexicon information and pre-trained models, such as BERT, have been combined to explore Chinese sequence labelling tasks due to their respective strengths. However, existing methods solely fuse lexicon features via a shallow and random…

Computation and Language · Computer Science 2021-12-28 Wei Liu , Xiyan Fu , Yue Zhang , Wenming Xiao

Chinese Spelling Correction (CSC) stands as a foundational Natural Language Processing (NLP) task, which primarily focuses on the correction of erroneous characters in Chinese texts. Certain existing methodologies opt to disentangle the…

Computation and Language · Computer Science 2024-09-09 Xiangke Zeng , Zuchao Li , Lefei Zhang , Ping Wang , Hongqiu Wu , Hai Zhao

Recent advancements in large language models (LLMs) demonstrate exceptional Chinese text processing capabilities, particularly in Chinese Spelling Correction (CSC). While LLMs outperform traditional BERT-based models in accuracy and…

Computation and Language · Computer Science 2025-05-15 Sophie Zhang , Zhiming Lin

Writing, as an omnipresent form of human communication, permeates nearly every aspect of contemporary life. Consequently, inaccuracies or errors in written communication can lead to profound consequences, ranging from financial losses to…

Computation and Language · Computer Science 2024-07-25 Amirreza Naziri , Hossein Zeinali

Chinese Spell Checking (CSC) task aims to detect and correct Chinese spelling errors. Recently, related researches focus on introducing character similarity from confusion set to enhance the CSC models, ignoring the context of characters…

Computation and Language · Computer Science 2023-03-02 Ding Zhang , Yinghui Li , Qingyu Zhou , Shirong Ma , Yangning Li , Yunbo Cao , Hai-Tao Zheng

Chinese Spelling Check (CSC) is a task to detect and correct spelling errors in Chinese natural language. Existing methods have made attempts to incorporate the similarity knowledge between Chinese characters. However, they take the…

Computation and Language · Computer Science 2020-05-14 Xingyi Cheng , Weidi Xu , Kunlong Chen , Shaohua Jiang , Feng Wang , Taifeng Wang , Wei Chu , Yuan Qi

Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and consecutive variants have been proposed to further improve the performance of the pre-trained language models. In…

Computation and Language · Computer Science 2020-12-14 Yiming Cui , Wanxiang Che , Ting Liu , Bing Qin , Shijin Wang , Guoping Hu

Large-scale language models (LLMs) has shown remarkable capability in various of Natural Language Processing (NLP) tasks and attracted lots of attention recently. However, some studies indicated that large language models fail to achieve…

Computation and Language · Computer Science 2025-03-18 Fanyi Qu , Chenming Tang , Yunfang Wu

Classifiers are an important and defining feature of the Chinese language, and their correct prediction is key to numerous educational applications. Yet, whether the most popular Large Language Models (LLMs) possess proper knowledge the…

Computation and Language · Computer Science 2025-11-04 Ziqi Zhang , Jianfei Ma , Emmanuele Chersoni , Jieshun You , Zhaoxin Feng

This paper proposes a Chinese spelling correction method based on plugin extension modules, aimed at addressing the limitations of existing models in handling domain-specific texts. Traditional Chinese spelling correction models are…

Computation and Language · Computer Science 2024-11-18 Xiaowu Zhang , Hongfei Zhao , Xuan Chang

Despite the development of pre-trained language models (PLMs) significantly raise the performances of various Chinese natural language processing (NLP) tasks, the vocabulary for these Chinese PLMs remain to be the one provided by Google…

Computation and Language · Computer Science 2020-11-18 Wei Zhu

Chinese Spell Checking (CSC) aims to detect and correct erroneous characters for user-generated text in the Chinese language. Most of the Chinese spelling errors are misused semantically, phonetically or graphically similar characters.…

Computation and Language · Computer Science 2021-05-27 Heng-Da Xu , Zhongli Li , Qingyu Zhou , Chao Li , Zizhen Wang , Yunbo Cao , Heyan Huang , Xian-Ling Mao