English
Related papers

Related papers: CIP-Net: Continual Interpretable Prototype-based N…

200 papers

The human brain is capable of learning tasks sequentially mostly without forgetting. However, deep neural networks (DNNs) suffer from catastrophic forgetting when learning one task after another. We address this challenge considering a…

Machine Learning · Computer Science 2023-01-18 Aleksandr Dekhovich , David M. J. Tax , Marcel H. F. Sluiter , Miguel A. Bessa

The continual learning setting aims to learn new tasks over time without forgetting the previous ones. The literature reports several significant efforts to tackle this problem with limited or no access to previous task data. Among such…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Vishal Thengane , Salman Khan , Munawar Hayat , Fahad Khan

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

Machine Learning · Computer Science 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Part-prototype models are explainable-by-design image classifiers, and a promising alternative to black box AI. This paper explores the applicability and potential of interpretable machine learning, in particular PIP-Net, for automated…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Meike Nauta , Johannes H. Hegeman , Jeroen Geerdink , Jörg Schlötterer , Maurice van Keulen , Christin Seifert

Continual learning aims to create artificial neural networks capable of accumulating knowledge and skills through incremental training on a sequence of tasks. The main challenge of continual learning is catastrophic interference, wherein…

Artificial Intelligence · Computer Science 2023-11-01 Anton Lee , Yaqian Zhang , Heitor Murilo Gomes , Albert Bifet , Bernhard Pfahringer

Continual learning of new knowledge over time is one desirable capability for intelligent systems to recognize more and more classes of objects. Without or with very limited amount of old data stored, an intelligent system often…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Zhuoyun Li , Changhong Zhong , Sijia Liu , Ruixuan Wang , Wei-Shi Zheng

Neural networks have achieved remarkable success across various fields. However, the lack of interpretability limits their practical use, particularly in critical decision-making scenarios. Post-hoc interpretability, which provides…

Machine Learning · Computer Science 2025-11-21 Yang Ji , Ying Sun , Yuting Zhang , Zhigaoyuan Wang , Yuanxin Zhuang , Zheng Gong , Dazhong Shen , Chuan Qin , Hengshu Zhu , Hui Xiong

To tackle interpretability in deep learning, we present a novel framework to jointly learn a predictive model and its associated interpretation model. The interpreter provides both local and global interpretability about the predictive…

Machine Learning · Computer Science 2022-02-24 Jayneel Parekh , Pavlo Mozharovskyi , Florence d'Alché-Buc

Nowadays, real-world applications often face streaming data, which requires the learning system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve this goal and meanwhile overcome the catastrophic forgetting of…

Machine Learning · Computer Science 2024-04-24 Da-Wei Zhou , Hai-Long Sun , Jingyi Ning , Han-Jia Ye , De-Chuan Zhan

After learning a concept, humans are also able to continually generalize their learned concepts to new domains by observing only a few labeled instances without any interference with the past learned knowledge. In contrast, learning…

Machine Learning · Computer Science 2019-09-10 Mohammad Rostami , Soheil Kolouri , James McClelland , Praveen Pilly

Humans are able to explain their reasoning. On the contrary, deep neural networks are not. This paper attempts to bridge this gap by introducing a new way to design interpretable neural networks for classification, inspired by physiological…

Machine Learning · Statistics 2017-11-20 Shane Barratt

Contemporary neural networks are limited in their ability to learn from evolving streams of training data. When trained sequentially on new or evolving tasks, their accuracy drops sharply, making them unsuitable for many real-world…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Sudhanshu Mittal , Silvio Galesso , Thomas Brox

Retentive Network (RetNet) represents a significant advancement in neural network architecture, offering an efficient alternative to the Transformer. While Transformers rely on self-attention to model dependencies, they suffer from high…

Computation and Language · Computer Science 2025-06-10 Haiqi Yang , Zhiyuan Li , Yi Chang , Yuan Wu

A growing body of research in continual learning focuses on the catastrophic forgetting problem. While many attempts have been made to alleviate this problem, the majority of the methods assume a single model in the continual learning…

Machine Learning · Computer Science 2023-07-06 Thang Doan , Seyed Iman Mirzadeh , Mehrdad Farajtabar

Explaining black-box Artificial Intelligence (AI) models is a cornerstone for trustworthy AI and a prerequisite for its use in safety critical applications such that AI models can reliably assist humans in critical decisions. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Poulami Sinhamahapatra , Lena Heidemann , Maureen Monnet , Karsten Roscher

Neural networks suffer from catastrophic forgetting and are unable to sequentially learn new tasks without guaranteed stationarity in data distribution. Continual learning could be achieved via replay -- by concurrently training externally…

Predictive learning ideally builds the world model of physical processes in one or more given environments. Typical setups assume that we can collect data from all environments at all times. In practice, however, different prediction tasks…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Geng Chen , Wendong Zhang , Han Lu , Siyu Gao , Yunbo Wang , Mingsheng Long , Xiaokang Yang

Previous research on code intelligence usually trains a deep learning model on a fixed dataset in an offline manner. However, in real-world scenarios, new code repositories emerge incessantly, and the carried new knowledge is beneficial for…

Software Engineering · Computer Science 2023-02-08 Shuzheng Gao , Hongyu Zhang , Cuiyun Gao , Chaozheng Wang

Classifying images with an interpretable decision-making process is a long-standing problem in computer vision. In recent years, Prototypical Part Networks has gained traction as an approach for self-explainable neural networks, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhijie Zhu , Lei Fan , Maurice Pagnucco , Yang Song

Self-driving cars increasingly rely on deep neural networks to achieve human-like driving. The opacity of such black-box planners makes it challenging for the human behind the wheel to accurately anticipate when they will fail, with…