English
Related papers

Related papers: Diffusion-based neuromodulation can eliminate cata…

200 papers

The ability of neural networks to continuously learn and adapt to new tasks while retaining prior knowledge is crucial for many applications. However, current neural networks tend to forget previously learned tasks when trained on new ones,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Sinan Özgür Özgün , Anne-Marie Rickmann , Abhijit Guha Roy , Christian Wachinger

Artificial neural networks (ANNs) continue to face challenges in continual learning, particularly due to catastrophic forgetting, the loss of previously learned knowledge when acquiring new tasks. Inspired by memory consolidation in the…

Machine Learning · Computer Science 2025-09-03 Jina Kim

Artificial neural networks (ANNs) experience catastrophic forgetting (CF) during sequential learning. In contrast, the brain can learn continuously without any signs of catastrophic forgetting. Spiking neural networks (SNNs) are the next…

Neural and Evolutionary Computing · Computer Science 2022-12-26 Dmitry Antonov , Kirill Sviatov , Sergey Sukhov

Continual learning models allow to learn and adapt to new changes and tasks over time. However, in continual and sequential learning scenarios in which the models are trained using different data with various distributions, neural networks…

Machine Learning · Computer Science 2020-08-17 HongLin Li , Payam Barnaghi , Shirin Enshaeifar , Frieder Ganz

Artificial Intelligence (AI) has achieved new levels of performance and spread in public usage with the rise of deep neural networks (DNNs). Initially inspired by human neurons and their connections, NNs have become the foundation of AI…

Artificial Intelligence · Computer Science 2025-04-28 Yupei Li , Manuel Milling , Björn W. Schuller

Although deep neural networks perform extremely well in controlled environments, they fail in real-world scenarios where data isn't available all at once, and the model must adapt to a new data distribution that may or may not follow the…

Machine Learning · Computer Science 2026-03-17 Vaishnavi Nagabhushana , Kartikay Agrawal , Ayon Borthakur

Neural networks are susceptible to catastrophic forgetting. They fail to preserve previously acquired knowledge when adapting to new tasks. Inspired by human associative memory system, we propose a brain-like approach that imitates the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Yi Gu , Jie Li , Yuting Gao , Ruoxin Chen , Chentao Wu , Feiyang Cai , Chao Wang , Zirui Zhang

A central challenge in developing versatile machine learning systems is catastrophic forgetting: a model trained on tasks in sequence will suffer significant performance drops on earlier tasks. Despite the ubiquity of catastrophic…

Machine Learning · Computer Science 2020-07-16 Vinay V. Ramasesh , Ethan Dyer , Maithra Raghu

Artificial intelligence (AI) and neuroscience share a rich history, with advancements in neuroscience shaping the development of AI systems capable of human-like knowledge retention. Leveraging insights from neuroscience and existing…

Machine Learning · Computer Science 2024-04-24 Hikmat Khan , Nidhal Carla Bouaynaya , Ghulam Rasool

Humans and animals have the ability to continually acquire, fine-tune, and transfer knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is mediated by a rich set of neurocognitive mechanisms that…

Machine Learning · Computer Science 2019-02-12 German I. Parisi , Ronald Kemker , Jose L. Part , Christopher Kanan , Stefan Wermter

One of the major limitations of deep learning models is that they face catastrophic forgetting in an incremental learning scenario. There have been several approaches proposed to tackle the problem of incremental learning. Most of these…

Machine Learning · Computer Science 2021-02-04 Vinod K Kurmi , Badri N. Patro , Venkatesh K. Subramanian , Vinay P. Namboodiri

Diffusion Models have become a cornerstone of modern generative AI for their exceptional generation quality and controllability. However, their inherent \textit{multi-step iterations} and \textit{complex backbone networks} lead to…

Deep learning models generally display catastrophic forgetting when learning new data continuously. Many incremental learning approaches address this problem by reusing data from previous tasks while learning new tasks. However, the direct…

Machine Learning · Computer Science 2024-11-12 Young Jo Choi , Min Kyoon Yoo , Yu Rang Park

Artificial neural networks face the well-known problem of catastrophic forgetting. What's worse, the degradation of previously learned skills becomes more severe as the task sequence increases, known as the long-term catastrophic…

Machine Learning · Computer Science 2021-02-03 Jian Peng , Bo Tang , Hao Jiang , Zhuo Li , Yinjie Lei , Tao Lin , Haifeng Li

Multi-center neuroimaging studies face technical variability due to batch differences across sites, which potentially hinders data aggregation and impacts study reliability.Recent efforts in neuroimaging harmonization have aimed to minimize…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Haoyu Lan , Bino A. Varghese , Nasim Sheikh-Bahaei , Farshid Sepehrband , Arthur W Toga , Jeiran Choupan

In medical imaging, technical progress or changes in diagnostic procedures lead to a continuous change in image appearance. Scanner manufacturer, reconstruction kernel, dose, other protocol specific settings or administering of contrast…

Machine Learning · Computer Science 2020-07-08 Johannes Hofmanninger , Matthias Perkonigg , James A. Brink , Oleg Pianykh , Christian Herold , Georg Langs

Continual learning is the sequential learning of different tasks by a machine learning model. Continual learning is known to be hindered by catastrophic interference or forgetting, i.e. rapid unlearning of earlier learned tasks when new…

Machine Learning · Computer Science 2024-02-14 Heinrich van Deventer , Anna Sergeevna Bosman

The creation of machine learning algorithms for intelligent agents capable of continuous, lifelong learning is a critical objective for algorithms being deployed on real-life systems in dynamic environments. Here we present an algorithm…

Machine Learning · Computer Science 2020-01-28 Andrew Brna , Ryan Brown , Patrick Connolly , Stephen Simons , Renee Shimizu , Mario Aguilar-Simon

Deep reinforcement learning methods exhibit impressive performance on a range of tasks but still struggle on hard exploration tasks in large environments with sparse rewards. To address this, intrinsic rewards can be generated using forward…

Artificial Intelligence · Computer Science 2023-10-27 Jaedong Hwang , Zhang-Wei Hong , Eric Chen , Akhilan Boopathy , Pulkit Agrawal , Ila Fiete

Contemporary deep neural networks offer state-of-the-art results when applied to visual reasoning, e.g., in the context of 3D point cloud data. Point clouds are important datatype for precise modeling of three-dimensional environments, but…

Machine Learning · Computer Science 2022-05-23 Maciej Zamorski , Michał Stypułkowski , Konrad Karanowski , Tomasz Trzciński , Maciej Zięba