English
Related papers

Related papers: Mitigating Catastrophic Forgetting in Multi-domain…

200 papers

A common scenario of Multilingual Neural Machine Translation (MNMT) is that each translation task arrives in a sequential manner, and the training data of previous tasks is unavailable. In this scenario, the current methods suffer heavily…

Computation and Language · Computer Science 2022-12-07 Yang Zhao , Junnan Zhu , Lu Xiang , Jiajun Zhang , Yu Zhou , Feifei Zhai , Chengqing Zong

Supervised Fine-Tuning (SFT) is a critical step for enhancing the instruction-following capabilities of Large Language Models (LLMs) and adapting them to specialized domains. However, SFT often leads to a degradation of the model's general…

Computation and Language · Computer Science 2025-07-01 Fei Ding , Baiqiao Wang

Neural Machine Translation (NMT) models can be specialized by domain adaptation, often involving fine-tuning on a dataset of interest. This process risks catastrophic forgetting: rapid loss of generic translation quality. Forgetting has…

Computation and Language · Computer Science 2024-12-24 Danielle Saunders , Steve DeNeefe

The growing demand for automated writing assistance in diverse academic domains highlights the need for robust Chinese Grammatical Error Correction (CGEC) systems that can adapt across disciplines. However, existing CGEC research largely…

Computation and Language · Computer Science 2025-09-18 Shang Qin , Jingheng Ye , Yinghui Li , Hai-Tao Zheng , Qi Li , Jinxiao Shan , Zhixing Li , Hong-Gee Kim

Class-incremental learning for semantic segmentation (CiSS) is presently a highly researched field which aims at updating a semantic segmentation model by sequentially learning new semantic classes. A major challenge in CiSS is overcoming…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Tobias Kalb , Jürgen Beyerer

This work proposes a simple training-free prompt-free approach to leverage large language models (LLMs) for the Chinese spelling correction (CSC) task, which is totally different from all previous CSC approaches. The key idea is to use an…

Computation and Language · Computer Science 2024-10-08 Houquan Zhou , Zhenghua Li , Bo Zhang , Chen Li , Shaopeng Lai , Ji Zhang , Fei Huang , Min Zhang

Chinese spelling check is a task to detect and correct spelling mistakes in Chinese text. Existing research aims to enhance the text representation and use multi-source information to improve the detection and correction capabilities of…

Computation and Language · Computer Science 2023-07-07 Nankai Lin , Hongyan Wu , Sihui Fu , Shengyi Jiang , Aimin Yang

Chinese spelling correction (CSC) is a crucial task that aims to correct character errors in Chinese text. While conventional CSC focuses on character substitution errors caused by mistyping, two other common types of character errors,…

Computation and Language · Computer Science 2025-06-17 Houquan Zhou , Bo Zhang , Zhenghua Li , Ming Yan , Min Zhang

In this paper, we present CSCD-NS, the first Chinese spelling check (CSC) dataset designed for native speakers, containing 40,000 samples from a Chinese social platform. Compared with existing CSC datasets aimed at Chinese learners, CSCD-NS…

Computation and Language · Computer Science 2024-05-24 Yong Hu , Fandong Meng , Jie Zhou

Adapting Automatic Speech Recognition (ASR) models to new domains results in a deterioration of performance on the original domain(s), a phenomenon called Catastrophic Forgetting (CF). Even monolingual ASR models cannot be extended to new…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-22 Steven Vander Eeckt , Hugo Van hamme

Machine reading comprehension (MRC) has become a core component in a variety of natural language processing (NLP) applications such as question answering and dialogue systems. It becomes a practical challenge that an MRC model needs to…

Information Retrieval · Computer Science 2020-08-26 Lixin Su , Jiafeng Guo , Ruqing Zhang , Yixing Fan , Yanyan Lan , Xueqi Cheng

The creation of large-scale open domain reading comprehension data sets in recent years has enabled the development of end-to-end neural comprehension models with promising results. To use these models for domains with limited training…

Computation and Language · Computer Science 2020-11-23 Y. Xu , X. Zhong , A. J. J. Yepes , J. H. Lau

Real-life multilingual systems should be able to efficiently incorporate new languages as data distributions fed to the system evolve and shift over time. To do this, systems need to handle the issue of catastrophic forgetting, where the…

Recently, much Chinese text error correction work has focused on Chinese Spelling Check (CSC) and Chinese Grammatical Error Diagnosis (CGED). In contrast, little attention has been paid to the complicated problem of Chinese Semantic Error…

Computation and Language · Computer Science 2023-05-10 Bo Sun , Baoxin Wang , Yixuan Wang , Wanxiang Che , Dayong Wu , Shijin Wang , Ting Liu

Chinese Spell Checking (CSC) task aims to detect and correct Chinese spelling errors. Recently, related researches focus on introducing character similarity from confusion set to enhance the CSC models, ignoring the context of characters…

Computation and Language · Computer Science 2023-03-02 Ding Zhang , Yinghui Li , Qingyu Zhou , Shirong Ma , Yangning Li , Yunbo Cao , Hai-Tao Zheng

Artificial neural networks, celebrated for their human-like cognitive learning abilities, often encounter the well-known catastrophic forgetting (CF) problem, where the neural networks lose the proficiency in previously acquired knowledge.…

Machine Learning · Computer Science 2024-05-14 Weiwei Weng , Mahardhika Pratama , Jie Zhang , Chen Chen , Edward Yapp Kien Yee , Ramasamy Savitha

Chinese Spelling Check (CSC) refers to the detection and correction of spelling errors in Chinese texts. In practical application scenarios, it is important to make CSC models have the ability to correct errors across different domains. In…

Computation and Language · Computer Science 2023-08-31 Siqi Song , Qi Lv , Lei Geng , Ziqiang Cao , Guohong Fu

Incremental semantic segmentation aims to continually learn the segmentation of new coming classes without accessing the training data of previously learned classes. However, most current methods fail to address catastrophic forgetting and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Wei Cong , Yang Cong , Jiahua Dong , Gan Sun , Henghui Ding

Chinese Grammatical Error Correction (CGEC) aims to automatically detect and correct grammatical errors contained in Chinese text. In the long term, researchers regard CGEC as a task with a certain degree of uncertainty, that is, an…

Computation and Language · Computer Science 2022-10-28 Jingheng Ye , Yinghui Li , Shirong Ma , Rui Xie , Wei Wu , Hai-Tao Zheng

This paper proposes a Chinese spelling correction method based on plugin extension modules, aimed at addressing the limitations of existing models in handling domain-specific texts. Traditional Chinese spelling correction models are…

Computation and Language · Computer Science 2024-11-18 Xiaowu Zhang , Hongfei Zhao , Xuan Chang