English
Related papers

Related papers: Improving Pre-trained Language Models with Syntact…

200 papers

Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and consecutive variants have been proposed to further improve the performance of the pre-trained language models. In…

Computation and Language · Computer Science 2020-12-14 Yiming Cui , Wanxiang Che , Ting Liu , Bing Qin , Shijin Wang , Guoping Hu

Chinese sequence labeling tasks are heavily reliant on accurate word boundary demarcation. Although current pre-trained language models (PLMs) have achieved substantial gains on these tasks, they rarely explicitly incorporate boundary…

Computation and Language · Computer Science 2024-04-09 Longhui Zhang , Dingkun Long , Meishan Zhang , Yanzhao Zhang , Pengjun Xie , Min Zhang

Chinese Spell Checking (CSC) aims to detect and correct spelling errors in sentences. Despite Large Language Models (LLMs) exhibit robust capabilities and are widely applied in various tasks, their performance on CSC is often…

Computation and Language · Computer Science 2024-10-29 Kunting Li , Yong Hu , Liang He , Fandong Meng , Jie Zhou

Chinese Spelling Correction (CSC) aims to detect and correct erroneous tokens in sentences. Traditional CSC focuses on equal length correction and uses pretrained language models (PLMs). While Large Language Models (LLMs) have shown…

Computation and Language · Computer Science 2025-08-12 Junhong Liang , Yu Zhou

Scene text recognition (STR) methods have demonstrated their excellent capability in English text images. However, due to the complex inner structures of Chinese and the extensive character categories, it poses challenges for recognizing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Qilong Li , Chongsheng Zhang

In this paper, we present CSCD-NS, the first Chinese spelling check (CSC) dataset designed for native speakers, containing 40,000 samples from a Chinese social platform. Compared with existing CSC datasets aimed at Chinese learners, CSCD-NS…

Computation and Language · Computer Science 2024-05-24 Yong Hu , Fandong Meng , Jie Zhou

With the development of pre-trained models and the incorporation of phonetic and graphic information, neural models have achieved high scores in Chinese Spelling Check (CSC). However, it does not provide a comprehensive reflection of the…

Computation and Language · Computer Science 2023-07-26 Xunjian Yin , Xiaojun Wan

Multi-Criteria Chinese Word Segmentation (MCCWS) aims at finding word boundaries in a Chinese sentence composed of continuous characters while multiple segmentation criteria exist. The unified framework has been widely used in MCCWS and…

Computation and Language · Computer Science 2020-04-14 Zhen Ke , Liang Shi , Erli Meng , Bin Wang , Xipeng Qiu , Xuanjing Huang

The Chinese Spelling Correction (CSC) task focuses on detecting and correcting spelling errors in sentences. Current research primarily explores two approaches: traditional multimodal pre-trained models and large language models (LLMs).…

Computation and Language · Computer Science 2025-04-11 Xiaowu Zhang , Hongfei Zhao , Jingyi Hou , Zhijie Liu

In recent years, Chinese Spelling Check (CSC) has been greatly improved by designing task-specific pre-training methods or introducing auxiliary tasks, which mostly solve this task in an end-to-end fashion. In this paper, we propose to…

Computation and Language · Computer Science 2023-10-16 Haojing Huang , Jingheng Ye , Qingyu Zhou , Yinghui Li , Yangning Li , Feng Zhou , Hai-Tao Zheng

Chinese Spell Checking (CSC) aims to detect and correct erroneous characters for user-generated text in the Chinese language. Most of the Chinese spelling errors are misused semantically, phonetically or graphically similar characters.…

Computation and Language · Computer Science 2021-05-27 Heng-Da Xu , Zhongli Li , Qingyu Zhou , Chao Li , Zizhen Wang , Yunbo Cao , Heyan Huang , Xian-Ling Mao

Spelling irregularities, known now as spelling mistakes, have been found for several centuries. As humans, we are able to understand most of the misspelled words based on their location in the sentence, perceived pronunciation, and context.…

Computation and Language · Computer Science 2021-01-12 Yifei Hu , Xiaonan Jing , Youlim Ko , Julia Taylor Rayz

Rhetoric recognition is a critical component in automated essay scoring. By identifying rhetorical elements in student writing, AI systems can better assess linguistic and higher-order thinking skills, making it an essential task in the…

Computation and Language · Computer Science 2026-04-17 Yuxuan Lai , Xiajing Wang , Chen Zheng

Despite remarkable progress in text-to-SQL semantic parsing in recent years, the performance of existing parsers is still far from perfect. Specifically, modern text-to-SQL parsers based on deep learning are often over-confident, thus…

Computation and Language · Computer Science 2023-12-07 Shijie Chen , Ziru Chen , Huan Sun , Yu Su

Chinese medical question-answer matching is more challenging than the open-domain question answer matching in English. Even though the deep learning method has performed well in improving the performance of question answer matching, these…

Computation and Language · Computer Science 2020-11-30 Xiongtao Cui , Jungang Han

Clinical Named Entity Recognition (CNER) aims to identify and classify clinical terms such as diseases, symptoms, treatments, exams, and body parts in electronic health records, which is a fundamental and crucial task for clinical and…

Computation and Language · Computer Science 2018-04-16 Qi Wang , Yuhang Xia , Yangming Zhou , Tong Ruan , Daqi Gao , Ping He

Chinese Spelling Check (CSC) is a meaningful task in the area of Natural Language Processing (NLP) which aims at detecting spelling errors in Chinese texts and then correcting these errors. However, CSC models are based on pretrained…

Computation and Language · Computer Science 2024-01-29 Xi Wang , Ruoqing Zhao , Hongliang Dai , Piji Li

Chinese Named Entity Recognition (NER) is an important task in information extraction, which has a significant impact on downstream applications. Due to the lack of natural separators in Chinese, previous NER methods mostly relied on…

Computation and Language · Computer Science 2024-12-17 Yaqiong Qiao , Shixuan Peng

Chinese Spelling Correction (CSC) stands as a foundational Natural Language Processing (NLP) task, which primarily focuses on the correction of erroneous characters in Chinese texts. Certain existing methodologies opt to disentangle the…

Computation and Language · Computer Science 2024-09-09 Xiangke Zeng , Zuchao Li , Lefei Zhang , Ping Wang , Hongqiu Wu , Hai Zhao

This paper presents new state-of-the-art models for three tasks, part-of-speech tagging, syntactic parsing, and semantic parsing, using the cutting-edge contextualized embedding framework known as BERT. For each task, we first replicate and…

Computation and Language · Computer Science 2020-05-26 Han He , Jinho D. Choi