English
Related papers

Related papers: Mixture of Small and Large Models for Chinese Spel…

200 papers

Chinese Spell Checking (CSC) is a widely used technology, which plays a vital role in speech to text (STT) and optical character recognition (OCR). Most of the existing CSC approaches relying on BERT architecture achieve excellent…

Computation and Language · Computer Science 2024-11-21 Ming Dong , Yujing Chen , Miao Zhang , Hao Sun , Tingting He

In this paper, we study Chinese Spelling Correction (CSC) as a joint decision made by two separate models: a language model and an error model. Through empirical analysis, we find that fine-tuning BERT tends to over-fit the error model…

Computation and Language · Computer Science 2023-05-30 Hongqiu Wu , Shaohua Zhang , Yuchen Zhang , Hai Zhao

BERT-based models have shown a remarkable ability in the Chinese Spelling Check (CSC) task recently. However, traditional BERT-based methods still suffer from two limitations. First, although previous works have identified that explicit…

Computation and Language · Computer Science 2023-12-29 Yongchang Cao , Liang He , Zhen Wu , Xinyu Dai

This work proposes a simple training-free prompt-free approach to leverage large language models (LLMs) for the Chinese spelling correction (CSC) task, which is totally different from all previous CSC approaches. The key idea is to use an…

Computation and Language · Computer Science 2024-10-08 Houquan Zhou , Zhenghua Li , Bo Zhang , Chen Li , Shaopeng Lai , Ji Zhang , Fei Huang , Min Zhang

The Chinese Spelling Correction (CSC) task focuses on detecting and correcting spelling errors in sentences. Current research primarily explores two approaches: traditional multimodal pre-trained models and large language models (LLMs).…

Computation and Language · Computer Science 2025-04-11 Xiaowu Zhang , Hongfei Zhao , Jingyi Hou , Zhijie Liu

Recently, the development and progress of Large Language Models (LLMs) have amazed the entire Artificial Intelligence community. Benefiting from their emergent abilities, LLMs have attracted more and more researchers to study their…

Computation and Language · Computer Science 2024-10-28 Yinghui Li , Haojing Huang , Shirong Ma , Yong Jiang , Yangning Li , Feng Zhou , Hai-Tao Zheng , Qingyu Zhou

The rapid progress in Large Language Models (LLMs) has prompted the creation of numerous benchmarks to evaluate their capabilities.This study focuses on the Comprehensive Medical Benchmark in Chinese (CMB), showcasing how dataset diversity…

Computation and Language · Computer Science 2024-10-01 Jingwei Zhu , Minghuan Tan , Min Yang , Ruixue Li , Hamid Alinejad-Rokny

This paper studies Chinese Spelling Correction (CSC), which aims to detect and correct the potential spelling errors in a given sentence. Current state-of-the-art methods regard CSC as a sequence tagging task and fine-tune BERT-based models…

Computation and Language · Computer Science 2024-02-29 Linfeng Liu , Hongqiu Wu , Hai Zhao

Chinese Spell Checking (CSC) aims to detect and correct spelling errors in sentences. Despite Large Language Models (LLMs) exhibit robust capabilities and are widely applied in various tasks, their performance on CSC is often…

Computation and Language · Computer Science 2024-10-29 Kunting Li , Yong Hu , Liang He , Fandong Meng , Jie Zhou

Recently, Large Language Models (LLMs) have been widely studied by researchers for their roles in various downstream NLP tasks. As a fundamental task in the NLP field, Chinese Grammatical Error Correction (CGEC) aims to correct all…

Computation and Language · Computer Science 2024-09-20 Yinghui Li , Shang Qin , Haojing Huang , Yangning Li , Libo Qin , Xuming Hu , Wenhao Jiang , Hai-Tao Zheng , Philip S. Yu

Spelling error detection serves as a crucial preprocessing in many natural language processing applications. Due to the characteristics of Chinese Language, Chinese spelling error detection is more challenging than error detection in…

Computation and Language · Computer Science 2019-11-26 Hao Wang , Bing Wang , Jianyong Duan , Jiajun Zhang

Recent advancements in large language models (LLMs) demonstrate exceptional Chinese text processing capabilities, particularly in Chinese Spelling Correction (CSC). While LLMs outperform traditional BERT-based models in accuracy and…

Computation and Language · Computer Science 2025-05-15 Sophie Zhang , Zhiming Lin

Large-scale language models (LLMs) has shown remarkable capability in various of Natural Language Processing (NLP) tasks and attracted lots of attention recently. However, some studies indicated that large language models fail to achieve…

Computation and Language · Computer Science 2025-03-18 Fanyi Qu , Chenming Tang , Yunfang Wu

Spelling error correction is an important yet challenging task because a satisfactory solution of it essentially needs human-level language understanding ability. Without loss of generality we consider Chinese spelling error correction…

Computation and Language · Computer Science 2020-05-18 Shaohua Zhang , Haoran Huang , Jicong Liu , Hang Li

Classifiers are an important and defining feature of the Chinese language, and their correct prediction is key to numerous educational applications. Yet, whether the most popular Large Language Models (LLMs) possess proper knowledge the…

Computation and Language · Computer Science 2025-11-04 Ziqi Zhang , Jianfei Ma , Emmanuele Chersoni , Jieshun You , Zhaoxin Feng

Chinese Spelling Correction (CSC) is a critical task in natural language processing, aimed at detecting and correcting spelling errors in Chinese text. This survey provides a comprehensive overview of CSC, tracing its evolution from…

Computation and Language · Computer Science 2025-02-18 Changchun Liu , Kai Zhang , Junzhe Jiang , Zixiao Kong , Qi Liu , Enhong Chen

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

Computation and Language · Computer Science 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev

Due to the recent advances of natural language processing, several works have applied the pre-trained masked language model (MLM) of BERT to the post-correction of speech recognition. However, existing pre-trained models only consider the…

Computation and Language · Computer Science 2021-11-17 Yi-Chang Chen , Chun-Yen Cheng , Chien-An Chen , Ming-Chieh Sung , Yi-Ren Yeh

The recent success of Large Language Models (LLMs) has garnered significant attention in both academia and industry. Prior research on LLMs has primarily focused on enhancing or leveraging their generalization capabilities in zero- and…

Computation and Language · Computer Science 2024-04-01 Shulin Liu , Chengcheng Xu , Hao Liu , Tinghao Yu , Tao Yang

Hate speech detection on Chinese social networks presents distinct challenges, particularly due to the widespread use of cloaking techniques designed to evade conventional text-based detection systems. Although large language models (LLMs)…

Computation and Language · Computer Science 2025-08-04 Qiyao Xue , Yuchen Dou , Ryan Shi , Xiang Lorraine Li , Wei Gao
‹ Prev 1 2 3 10 Next ›