English
Related papers

Related papers: Make BERT-based Chinese Spelling Check Model Enhan…

200 papers

In this paper, we study Chinese Spelling Correction (CSC) as a joint decision made by two separate models: a language model and an error model. Through empirical analysis, we find that fine-tuning BERT tends to over-fit the error model…

Computation and Language · Computer Science 2023-05-30 Hongqiu Wu , Shaohua Zhang , Yuchen Zhang , Hai Zhao

Spelling error correction is an important yet challenging task because a satisfactory solution of it essentially needs human-level language understanding ability. Without loss of generality we consider Chinese spelling error correction…

Computation and Language · Computer Science 2020-05-18 Shaohua Zhang , Haoran Huang , Jicong Liu , Hang Li

In the era of large language models (LLMs), the Chinese Spelling Check (CSC) task has seen various LLM methods developed, yet their performance remains unsatisfactory. In contrast, fine-tuned BERT-based models, relying on high-quality…

Computation and Language · Computer Science 2025-06-10 Ziheng Qiao , Houquan Zhou , Zhenghua Li

Recently, Chinese Spell Checking(CSC), a task to detect erroneous characters in a sentence and correct them, has attracted extensive interest because of its wide applications in various NLP tasks. Most of the existing methods have utilized…

Computation and Language · Computer Science 2023-05-08 Haiyun Yang

The task of Chinese Spelling Check (CSC) is aiming to detect and correct spelling errors that can be found in the text. While manually annotating a high-quality dataset is expensive and time-consuming, thus the scale of the training dataset…

Computation and Language · Computer Science 2022-09-16 Piji Li

Chinese Spell Checking (CSC) is a widely used technology, which plays a vital role in speech to text (STT) and optical character recognition (OCR). Most of the existing CSC approaches relying on BERT architecture achieve excellent…

Computation and Language · Computer Science 2024-11-21 Ming Dong , Yujing Chen , Miao Zhang , Hao Sun , Tingting He

With the development of pre-trained models and the incorporation of phonetic and graphic information, neural models have achieved high scores in Chinese Spelling Check (CSC). However, it does not provide a comprehensive reflection of the…

Computation and Language · Computer Science 2023-07-26 Xunjian Yin , Xiaojun Wan

Chinese word segmentation and dependency parsing are two fundamental tasks for Chinese natural language processing. The dependency parsing is defined on word-level. Therefore word segmentation is the precondition of dependency parsing,…

Computation and Language · Computer Science 2019-12-19 Hang Yan , Xipeng Qiu , Xuanjing Huang

Due to the ambiguity of homophones, Chinese Spell Checking (CSC) has widespread applications. Existing systems typically utilize BERT for text encoding. However, CSC requires the model to account for both phonetic and graphemic information.…

Computation and Language · Computer Science 2022-11-08 Xiaotian Zhang , Hang Yan , Yu Sun , Xipeng Qiu

Lexicon information and pre-trained models, such as BERT, have been combined to explore Chinese sequence labelling tasks due to their respective strengths. However, existing methods solely fuse lexicon features via a shallow and random…

Computation and Language · Computer Science 2021-12-28 Wei Liu , Xiyan Fu , Yue Zhang , Wenming Xiao

Chinese word segmentation (CWS) is a fundamental task for Chinese language understanding. Recently, neural network-based models have attained superior performance in solving the in-domain CWS task. Last year, Bidirectional Encoder…

Computation and Language · Computer Science 2019-09-23 Haiqin Yang

In recent years, pre-trained models have been extensively studied, and several downstream tasks have benefited from their utilization. In this study, we verify the effectiveness of two methods that incorporate a BERT-based pre-trained model…

Computation and Language · Computer Science 2020-11-05 Hongfei Wang , Michiki Kurosawa , Satoru Katsumata , Mamoru Komachi

Contextualized representations give significantly improved results for a wide range of NLP tasks. Much work has been dedicated to analyzing the features captured by representative models such as BERT. Existing work finds that syntactic,…

Computation and Language · Computer Science 2020-10-16 Yile Wang , Leyang Cui , Yue Zhang

In this paper, we present CSCD-NS, the first Chinese spelling check (CSC) dataset designed for native speakers, containing 40,000 samples from a Chinese social platform. Compared with existing CSC datasets aimed at Chinese learners, CSCD-NS…

Computation and Language · Computer Science 2024-05-24 Yong Hu , Fandong Meng , Jie Zhou

A sequence-to-sequence learning with neural networks has empirically proven to be an effective framework for Chinese Spelling Correction (CSC), which takes a sentence with some spelling errors as input and outputs the corrected one.…

Computation and Language · Computer Science 2021-06-02 Chong Li , Cenyuan Zhang , Xiaoqing Zheng , Xuanjing Huang

This paper studies Chinese Spelling Correction (CSC), which aims to detect and correct the potential spelling errors in a given sentence. Current state-of-the-art methods regard CSC as a sequence tagging task and fine-tune BERT-based models…

Computation and Language · Computer Science 2024-02-29 Linfeng Liu , Hongqiu Wu , Hai Zhao

Chinese Spelling Correction (CSC) commonly lacks large-scale high-quality corpora, due to the labor-intensive labeling of spelling errors in real-life human writing or typing scenarios. Two data augmentation methods are widely adopted: (1)…

Computation and Language · Computer Science 2024-07-23 Dingyao Yu , Yang An , Wei Ye , Xiongfeng Xiao , Shaoguang Mao , Tao Ge , Shikun Zhang

Chinese Spelling Correction (CSC) aims to detect and correct spelling errors in given sentences. Recently, multi-domain CSC has gradually attracted the attention of researchers because it is more practicable. In this paper, we focus on the…

Computation and Language · Computer Science 2024-02-20 Peng Xing , Yinghui Li , Shirong Ma , Xinnian Liang , Haojing Huang , Yangning Li , Hai-Tao Zheng , Wenhao Jiang , Ying Shen

Existing Chinese text error detection mainly focuses on spelling and simple grammatical errors. These errors have been studied extensively and are relatively simple for humans. On the contrary, Chinese semantic errors are understudied and…

Computation and Language · Computer Science 2022-04-18 Bo Sun , Baoxin Wang , Wanxiang Che , Dayong Wu , Zhigang Chen , Ting Liu

We propose a new Named entity recognition (NER) method to effectively make use of the results of Part-of-speech (POS) tagging, Chinese word segmentation (CWS) and parsing while avoiding NER error caused by POS tagging error. This paper…

Computation and Language · Computer Science 2021-01-28 Xiao Fu , Guijun Zhang
‹ Prev 1 2 3 10 Next ›