English
Related papers

Related papers: Rethinking Masked Language Modeling for Chinese Sp…

200 papers

Spelling error correction is an important yet challenging task because a satisfactory solution of it essentially needs human-level language understanding ability. Without loss of generality we consider Chinese spelling error correction…

Computation and Language · Computer Science 2020-05-18 Shaohua Zhang , Haoran Huang , Jicong Liu , Hang Li

This paper studies Chinese Spelling Correction (CSC), which aims to detect and correct the potential spelling errors in a given sentence. Current state-of-the-art methods regard CSC as a sequence tagging task and fine-tune BERT-based models…

Computation and Language · Computer Science 2024-02-29 Linfeng Liu , Hongqiu Wu , Hai Zhao

The task of Chinese Spelling Check (CSC) is aiming to detect and correct spelling errors that can be found in the text. While manually annotating a high-quality dataset is expensive and time-consuming, thus the scale of the training dataset…

Computation and Language · Computer Science 2022-09-16 Piji Li

BERT-based models have shown a remarkable ability in the Chinese Spelling Check (CSC) task recently. However, traditional BERT-based methods still suffer from two limitations. First, although previous works have identified that explicit…

Computation and Language · Computer Science 2023-12-29 Yongchang Cao , Liang He , Zhen Wu , Xinyu Dai

The Chinese Spelling Correction (CSC) task focuses on detecting and correcting spelling errors in sentences. Current research primarily explores two approaches: traditional multimodal pre-trained models and large language models (LLMs).…

Computation and Language · Computer Science 2025-04-11 Xiaowu Zhang , Hongfei Zhao , Jingyi Hou , Zhijie Liu

In the era of large language models (LLMs), the Chinese Spelling Check (CSC) task has seen various LLM methods developed, yet their performance remains unsatisfactory. In contrast, fine-tuned BERT-based models, relying on high-quality…

Computation and Language · Computer Science 2025-06-10 Ziheng Qiao , Houquan Zhou , Zhenghua Li

Whole word masking (WWM), which masks all subwords corresponding to a word at once, makes a better English BERT model. For the Chinese language, however, there is no subword because each token is an atomic character. The meaning of a word…

Computation and Language · Computer Science 2022-03-03 Yong Dai , Linyang Li , Cong Zhou , Zhangyin Feng , Enbo Zhao , Xipeng Qiu , Piji Li , Duyu Tang

A sequence-to-sequence learning with neural networks has empirically proven to be an effective framework for Chinese Spelling Correction (CSC), which takes a sentence with some spelling errors as input and outputs the corrected one.…

Computation and Language · Computer Science 2021-06-02 Chong Li , Cenyuan Zhang , Xiaoqing Zheng , Xuanjing Huang

Chinese Spelling Check (CSC) is a meaningful task in the area of Natural Language Processing (NLP) which aims at detecting spelling errors in Chinese texts and then correcting these errors. However, CSC models are based on pretrained…

Computation and Language · Computer Science 2024-01-29 Xi Wang , Ruoqing Zhao , Hongliang Dai , Piji Li

With the development of pre-trained models and the incorporation of phonetic and graphic information, neural models have achieved high scores in Chinese Spelling Check (CSC). However, it does not provide a comprehensive reflection of the…

Computation and Language · Computer Science 2023-07-26 Xunjian Yin , Xiaojun Wan

This work proposes a simple training-free prompt-free approach to leverage large language models (LLMs) for the Chinese spelling correction (CSC) task, which is totally different from all previous CSC approaches. The key idea is to use an…

Computation and Language · Computer Science 2024-10-08 Houquan Zhou , Zhenghua Li , Bo Zhang , Chen Li , Shaopeng Lai , Ji Zhang , Fei Huang , Min Zhang

Chinese Spell Checking (CSC) aims to detect and correct Chinese spelling errors. Recent researches start from the pretrained knowledge of language models and take multimodal information into CSC models to improve the performance. However,…

Computation and Language · Computer Science 2022-10-20 Yinghui Li , Shirong Ma , Qingyu Zhou , Zhongli Li , Li Yangning , Shulin Huang , Ruiyang Liu , Chao Li , Yunbo Cao , Haitao Zheng

Due to the ambiguity of homophones, Chinese Spell Checking (CSC) has widespread applications. Existing systems typically utilize BERT for text encoding. However, CSC requires the model to account for both phonetic and graphemic information.…

Computation and Language · Computer Science 2022-11-08 Xiaotian Zhang , Hang Yan , Yu Sun , Xipeng Qiu

Chinese Spelling Correction (CSC) aims to detect and correct spelling errors in Chinese sentences caused by phonetic or visual similarities. While current CSC models integrate pinyin or glyph features and have shown significant…

Computation and Language · Computer Science 2024-09-10 Lei Sheng , Shuai-Shuai Xu

Recently, Chinese Spell Checking(CSC), a task to detect erroneous characters in a sentence and correct them, has attracted extensive interest because of its wide applications in various NLP tasks. Most of the existing methods have utilized…

Computation and Language · Computer Science 2023-05-08 Haiyun Yang

Chinese Spelling Correction (CSC) commonly lacks large-scale high-quality corpora, due to the labor-intensive labeling of spelling errors in real-life human writing or typing scenarios. Two data augmentation methods are widely adopted: (1)…

Computation and Language · Computer Science 2024-07-23 Dingyao Yu , Yang An , Wei Ye , Xiongfeng Xiao , Shaoguang Mao , Tao Ge , Shikun Zhang

In this paper, we present CSCD-NS, the first Chinese spelling check (CSC) dataset designed for native speakers, containing 40,000 samples from a Chinese social platform. Compared with existing CSC datasets aimed at Chinese learners, CSCD-NS…

Computation and Language · Computer Science 2024-05-24 Yong Hu , Fandong Meng , Jie Zhou

Although existing neural network approaches have achieved great success on Chinese spelling correction, there is still room to improve. The model is required to avoid over-correction and to distinguish a correct token from its phonological…

Computation and Language · Computer Science 2023-03-21 Rui Sun , Xiuyu Wu , Yunfang Wu

Chinese Spell Checking (CSC) is a widely used technology, which plays a vital role in speech to text (STT) and optical character recognition (OCR). Most of the existing CSC approaches relying on BERT architecture achieve excellent…

Computation and Language · Computer Science 2024-11-21 Ming Dong , Yujing Chen , Miao Zhang , Hao Sun , Tingting He

Chinese Spelling Correction (CSC) aims to detect and correct spelling errors in given sentences. Recently, multi-domain CSC has gradually attracted the attention of researchers because it is more practicable. In this paper, we focus on the…

Computation and Language · Computer Science 2024-02-20 Peng Xing , Yinghui Li , Shirong Ma , Xinnian Liang , Haojing Huang , Yangning Li , Hai-Tao Zheng , Wenhao Jiang , Ying Shen
‹ Prev 1 2 3 10 Next ›