中文
相关论文

相关论文: Mitigating Catastrophic Forgetting in Multi-domain…

200 篇论文

A common scenario of Multilingual Neural Machine Translation (MNMT) is that each translation task arrives in a sequential manner, and the training data of previous tasks is unavailable. In this scenario, the current methods suffer heavily…

计算与语言 · 计算机科学 2022-12-07 Yang Zhao , Junnan Zhu , Lu Xiang , Jiajun Zhang , Yu Zhou , Feifei Zhai , Chengqing Zong

Supervised Fine-Tuning (SFT) is a critical step for enhancing the instruction-following capabilities of Large Language Models (LLMs) and adapting them to specialized domains. However, SFT often leads to a degradation of the model's general…

计算与语言 · 计算机科学 2025-07-01 Fei Ding , Baiqiao Wang

Neural Machine Translation (NMT) models can be specialized by domain adaptation, often involving fine-tuning on a dataset of interest. This process risks catastrophic forgetting: rapid loss of generic translation quality. Forgetting has…

计算与语言 · 计算机科学 2024-12-24 Danielle Saunders , Steve DeNeefe

The growing demand for automated writing assistance in diverse academic domains highlights the need for robust Chinese Grammatical Error Correction (CGEC) systems that can adapt across disciplines. However, existing CGEC research largely…

计算与语言 · 计算机科学 2025-09-18 Shang Qin , Jingheng Ye , Yinghui Li , Hai-Tao Zheng , Qi Li , Jinxiao Shan , Zhixing Li , Hong-Gee Kim

Class-incremental learning for semantic segmentation (CiSS) is presently a highly researched field which aims at updating a semantic segmentation model by sequentially learning new semantic classes. A major challenge in CiSS is overcoming…

计算机视觉与模式识别 · 计算机科学 2022-09-19 Tobias Kalb , Jürgen Beyerer

This work proposes a simple training-free prompt-free approach to leverage large language models (LLMs) for the Chinese spelling correction (CSC) task, which is totally different from all previous CSC approaches. The key idea is to use an…

计算与语言 · 计算机科学 2024-10-08 Houquan Zhou , Zhenghua Li , Bo Zhang , Chen Li , Shaopeng Lai , Ji Zhang , Fei Huang , Min Zhang

Chinese spelling check is a task to detect and correct spelling mistakes in Chinese text. Existing research aims to enhance the text representation and use multi-source information to improve the detection and correction capabilities of…

计算与语言 · 计算机科学 2023-07-07 Nankai Lin , Hongyan Wu , Sihui Fu , Shengyi Jiang , Aimin Yang

Chinese spelling correction (CSC) is a crucial task that aims to correct character errors in Chinese text. While conventional CSC focuses on character substitution errors caused by mistyping, two other common types of character errors,…

计算与语言 · 计算机科学 2025-06-17 Houquan Zhou , Bo Zhang , Zhenghua Li , Ming Yan , Min Zhang

In this paper, we present CSCD-NS, the first Chinese spelling check (CSC) dataset designed for native speakers, containing 40,000 samples from a Chinese social platform. Compared with existing CSC datasets aimed at Chinese learners, CSCD-NS…

计算与语言 · 计算机科学 2024-05-24 Yong Hu , Fandong Meng , Jie Zhou

Adapting Automatic Speech Recognition (ASR) models to new domains results in a deterioration of performance on the original domain(s), a phenomenon called Catastrophic Forgetting (CF). Even monolingual ASR models cannot be extended to new…

音频与语音处理 · 电气工程与系统科学 2026-01-22 Steven Vander Eeckt , Hugo Van hamme

Machine reading comprehension (MRC) has become a core component in a variety of natural language processing (NLP) applications such as question answering and dialogue systems. It becomes a practical challenge that an MRC model needs to…

信息检索 · 计算机科学 2020-08-26 Lixin Su , Jiafeng Guo , Ruqing Zhang , Yixing Fan , Yanyan Lan , Xueqi Cheng

The creation of large-scale open domain reading comprehension data sets in recent years has enabled the development of end-to-end neural comprehension models with promising results. To use these models for domains with limited training…

计算与语言 · 计算机科学 2020-11-23 Y. Xu , X. Zhong , A. J. J. Yepes , J. H. Lau

Real-life multilingual systems should be able to efficiently incorporate new languages as data distributions fed to the system evolve and shift over time. To do this, systems need to handle the issue of catastrophic forgetting, where the…

Recently, much Chinese text error correction work has focused on Chinese Spelling Check (CSC) and Chinese Grammatical Error Diagnosis (CGED). In contrast, little attention has been paid to the complicated problem of Chinese Semantic Error…

计算与语言 · 计算机科学 2023-05-10 Bo Sun , Baoxin Wang , Yixuan Wang , Wanxiang Che , Dayong Wu , Shijin Wang , Ting Liu

Chinese Spell Checking (CSC) task aims to detect and correct Chinese spelling errors. Recently, related researches focus on introducing character similarity from confusion set to enhance the CSC models, ignoring the context of characters…

计算与语言 · 计算机科学 2023-03-02 Ding Zhang , Yinghui Li , Qingyu Zhou , Shirong Ma , Yangning Li , Yunbo Cao , Hai-Tao Zheng

Artificial neural networks, celebrated for their human-like cognitive learning abilities, often encounter the well-known catastrophic forgetting (CF) problem, where the neural networks lose the proficiency in previously acquired knowledge.…

机器学习 · 计算机科学 2024-05-14 Weiwei Weng , Mahardhika Pratama , Jie Zhang , Chen Chen , Edward Yapp Kien Yee , Ramasamy Savitha

Chinese Spelling Check (CSC) refers to the detection and correction of spelling errors in Chinese texts. In practical application scenarios, it is important to make CSC models have the ability to correct errors across different domains. In…

计算与语言 · 计算机科学 2023-08-31 Siqi Song , Qi Lv , Lei Geng , Ziqiang Cao , Guohong Fu

Incremental semantic segmentation aims to continually learn the segmentation of new coming classes without accessing the training data of previously learned classes. However, most current methods fail to address catastrophic forgetting and…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Wei Cong , Yang Cong , Jiahua Dong , Gan Sun , Henghui Ding

Chinese Grammatical Error Correction (CGEC) aims to automatically detect and correct grammatical errors contained in Chinese text. In the long term, researchers regard CGEC as a task with a certain degree of uncertainty, that is, an…

计算与语言 · 计算机科学 2022-10-28 Jingheng Ye , Yinghui Li , Shirong Ma , Rui Xie , Wei Wu , Hai-Tao Zheng

This paper proposes a Chinese spelling correction method based on plugin extension modules, aimed at addressing the limitations of existing models in handling domain-specific texts. Traditional Chinese spelling correction models are…

计算与语言 · 计算机科学 2024-11-18 Xiaowu Zhang , Hongfei Zhao , Xuan Chang