English
Related papers

Related papers: Example Forgetting: A Novel Approach to Explain an…

200 papers

In this paper, we investigate knowledge forgetting in large language models with a focus on its generalisation, ensuring that models forget not only specific training samples but also related implicit knowledge. To this end, we begin by…

Computation and Language · Computer Science 2025-10-10 Huazheng Wang , Yongcheng Jing , Haifeng Sun , Yingjie Wang , Jingyu Wang , Jianxin Liao , Dacheng Tao

Neural network models have achieved state-of-the-art performances in a wide range of natural language processing (NLP) tasks. However, a long-standing criticism against neural network models is the lack of interpretability, which not only…

Computation and Language · Computer Science 2021-10-26 Xiaofei Sun , Diyi Yang , Xiaoya Li , Tianwei Zhang , Yuxian Meng , Han Qiu , Guoyin Wang , Eduard Hovy , Jiwei Li

Models trained on a new task typically degrade on prior tasks, a phenomenon known as forgetting. Traditionally, mitigating forgetting has required replaying stored exemplars from prior tasks, which is often impractical. By contrast,…

Machine Learning · Computer Science 2026-05-26 Martin Marek , Dongkyu Cho , Shikai Qiu , Rumi Chunara , Pavel Izmailov , Andrew Gordon Wilson

The rise of deep neural networks has led to several breakthroughs for semantic segmentation. In spite of this, a model trained on source domain often fails to work properly in new challenging domains, that is directly concerned with the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

Autonomous machine learning systems that learn many tasks in sequence are prone to the catastrophic forgetting problem. Mathematical theory is needed in order to understand the extent of forgetting during continual learning. As a…

Machine Learning · Computer Science 2025-02-18 Daniel Goldfarb , Paul Hand

Deep neural networks are widely used for classification. These deep models often suffer from a lack of interpretability -- they are particularly difficult to understand because of their non-linear nature. As a result, neural networks are…

Artificial Intelligence · Computer Science 2017-11-22 Oscar Li , Hao Liu , Chaofan Chen , Cynthia Rudin

Scaled post-training now drives many of the largest capability gains in language models (LMs), yet its effect on pretrained knowledge remains poorly understood. Not all forgetting is equal: Forgetting one fact (e.g., a U.S. president or an…

Machine Learning · Computer Science 2025-10-21 Jackson Harmon , Andreas Hochlehnert , Matthias Bethge , Ameya Prabhu

We present a survey of ways in which existing scientific knowledge are included when constructing models with neural networks. The inclusion of domain-knowledge is of special interest not just to constructing scientific assistants, but…

Machine Learning · Computer Science 2022-01-25 Tirtharaj Dash , Sharad Chitlangia , Aditya Ahuja , Ashwin Srinivasan

Deep networks for image classification often rely more on texture information than object shape. While efforts have been made to make deep-models shape-aware, it is often difficult to make such models simple, interpretable, or rooted in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Rajhans Singh , Ankita Shukla , Pavan Turaga

We propose a novel explanation method that explains the decisions of a deep neural network by investigating how the intermediate representations at each layer of the deep network were refined during the training process. This way we can a)…

Machine Learning · Computer Science 2021-09-14 Lukas Pfahler , Katharina Morik

Neural networks have opened up many new opportunities to utilize remotely sensed images in meteorology. Common applications include image classification, e.g., to determine whether an image contains a tropical cyclone, and image…

Atmospheric and Oceanic Physics · Physics 2020-05-08 Imme Ebert-Uphoff , Kyle A. Hilburn

We propose a predictive neural network architecture that can be utilized to update reference velocity models as inputs to the full waveform inversion. Deep learning models are explored to augment velocity model building workflows during…

Image and Video Processing · Electrical Eng. & Systems 2019-10-08 Ping Lu , Yanyan Zhang , Jianxiong Chen , Yuan Xiao , George Zhao

Large language models exhibit remarkable performance across diverse tasks through pre-training and fine-tuning paradigms. However, continual fine-tuning on sequential tasks induces catastrophic forgetting, where newly acquired knowledge…

Machine Learning · Computer Science 2026-01-27 Olaf Yunus Laitinen Imanov

Catastrophic forgetting of previously learned knowledge while learning new tasks is a widely observed limitation of contemporary neural networks. Although many continual learning methods are proposed to mitigate this drawback, the main…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Wojciech Masarczyk , Kamil Deja , Tomasz Trzciński

Most of mathematic forgetting curve models fit well with the forgetting data under the learning condition of one time rather than repeated. In the paper, a convolution model of forgetting curve is proposed to simulate the memory process…

Neurons and Cognition · Quantitative Biology 2019-01-25 Yanlu Xie , Yue Chen , Man Li

To improve the trustworthiness of an AI model, finding consistent, understandable representations of its inference process is essential. This understanding is particularly important in high-stakes operations such as weather forecasting,…

Artificial Intelligence · Computer Science 2025-04-02 Soyeon Kim , Junho Choi , Subeen Lee , Jaesik Choi

Expanding the domain that deep neural network has already learned without accessing old domain data is a challenging task because deep neural networks forget previously learned information when learning new data from a new domain. In this…

Machine Learning · Computer Science 2017-11-17 Heechul Jung , Jeongwoo Ju , Minju Jung , Junmo Kim

When a computational system continuously learns from an ever-changing environment, it rapidly forgets its past experiences. This phenomenon is called catastrophic forgetting. While a line of studies has been proposed with respect to…

Machine Learning · Statistics 2021-09-15 Haruka Asanuma , Shiro Takagi , Yoshihiro Nagano , Yuki Yoshida , Yasuhiko Igarashi , Masato Okada

Neural networks are becoming a popular tool for solving many real-world problems such as object recognition and machine translation, thanks to its exceptional performance as an end-to-end solution. However, neural networks are complex…

Machine Learning · Computer Science 2020-09-29 Guoliang Dong , Jingyi Wang , Jun Sun , Yang Zhang , Xinyu Wang , Ting Dai , Jin Song Dong , Xingen Wang

The ability to learn more and more concepts over time from incrementally arriving data is essential for the development of a life-long learning system. However, deep neural networks often suffer from forgetting previously learned concepts…

Machine Learning · Computer Science 2019-07-08 Huaiyu Li , Weiming Dong , Bao-Gang Hu