English
Related papers

Related papers: LLEDA -- Lifelong Self-Supervised Domain Adaptatio…

200 papers

Unsupervised domain adaptive person re-identification (ReID) has been extensively investigated to mitigate the adverse effects of domain gaps. Those works assume the target domain data can be accessible all at once. However, for the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Zhipeng Huang , Zhizheng Zhang , Cuiling Lan , Wenjun Zeng , Peng Chu , Quanzeng You , Jiang Wang , Zicheng Liu , Zheng-jun Zha

Humans excel at continually learning from an ever-changing environment whereas it remains a challenge for deep neural networks which exhibit catastrophic forgetting. The complementary learning system (CLS) theory suggests that the interplay…

Machine Learning · Computer Science 2022-05-11 Elahe Arani , Fahad Sarfraz , Bahram Zonooz

Continual learning in large language models (LLMs) typically encounters the critical challenge of catastrophic forgetting, where previously acquired knowledge deteriorates upon exposure to new data. While techniques like replay buffers and…

Machine Learning · Computer Science 2025-04-25 Sneh Pillai

Complementary Learning Systems (CLS) theory suggests that the brain uses a 'neocortical' and a 'hippocampal' learning system to achieve complex behavior. These two systems are complementary in that the 'neocortical' system relies on slow…

Neurons and Cognition · Quantitative Biology 2019-05-08 Sam Blakeman , Denis Mareschal

Foundational Vision-Language Models (VLMs) excel across diverse tasks, but adapting them to new domains without forgetting prior knowledge remains a critical challenge. Continual Learning (CL) addresses this challenge by enabling models to…

Machine Learning · Computer Science 2026-02-03 Vaibhav Singh , Rahaf Aljundi , Eugene Belilovsky

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

Machine Learning · Computer Science 2020-12-09 Timothée Lesort

According to Complementary Learning Systems (CLS) theory~\citep{mcclelland1995there} in neuroscience, humans do effective \emph{continual learning} through two complementary systems: a fast learning system centered on the hippocampus for…

Machine Learning · Computer Science 2021-10-04 Quang Pham , Chenghao Liu , Steven Hoi

Continual learning is a process that involves training learning agents to sequentially master a stream of tasks or classes without revisiting past data. The challenge lies in leveraging previously acquired knowledge to learn new tasks…

Machine Learning · Computer Science 2024-02-21 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Chua Haoyan , Edward Yapp

According to the Complementary Learning Systems (CLS) theory~\cite{mcclelland1995there} in neuroscience, humans do effective \emph{continual learning} through two complementary systems: a fast learning system centered on the hippocampus for…

Artificial Intelligence · Computer Science 2023-07-11 Quang Pham , Chenghao Liu , Steven C. H. Hoi

Large Language Models (LLMs) suffer severe catastrophic forgetting when adapted sequentially to new tasks in a continual learning (CL) setting. Existing approaches are fundamentally limited: replay-based methods are impractical and…

Machine Learning · Computer Science 2026-01-08 Shristi Das Biswas , Yue Zhang , Anwesan Pal , Radhika Bhargava , Kaushik Roy

We introduce an algorithm for tackling the problem of unsupervised domain adaptation (UDA) in continual learning (CL) scenarios. The primary objective is to maintain model generalization under domain shift when new domains arrive…

Machine Learning · Computer Science 2024-02-02 Mohammad Rostami

Continual learning -- the ability to acquire knowledge incrementally without forgetting previous skills -- is fundamental to natural intelligence. While the human brain excels at this, artificial neural networks struggle with "catastrophic…

Machine Learning · Computer Science 2025-09-16 Aoi Otani

Deep learning (DL) has shown state-of-the-art performance in trajectory prediction, which is critical to safe navigation in autonomous driving (AD). However, most DL-based methods suffer from catastrophic forgetting, where adapting to a new…

Artificial Intelligence · Computer Science 2025-08-12 Yunlong Lin , Zirui Li , Guodong Du , Xiaocong Zhao , Cheng Gong , Xinwei Wang , Chao Lu , Jianwei Gong

Lifelong learning requires models that can continuously learn from sequential streams of data without suffering catastrophic forgetting due to shifts in data distributions. Deep learning models have thrived in the non-sequential learning…

Computation and Language · Computer Science 2021-07-27 Nithin Holla , Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova

Self-supervised learning (SSL) aims to eliminate one of the major bottlenecks in representation learning - the need for human annotations. As a result, SSL holds the promise to learn representations from data in-the-wild, i.e., without the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Senthil Purushwalkam , Pedro Morgado , Abhinav Gupta

Methods for unsupervised domain adaptation (UDA) help to improve the performance of deep neural networks on unseen domains without any labeled data. Especially in medical disciplines such as histopathology, this is crucial since large…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Kevin Thandiackal , Luigi Piccinelli , Pushpak Pati , Orcun Goksel

Humans and animals have the ability to continually acquire, fine-tune, and transfer knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is mediated by a rich set of neurocognitive mechanisms that…

Machine Learning · Computer Science 2019-02-12 German I. Parisi , Ronald Kemker , Jose L. Part , Christopher Kanan , Stefan Wermter

Semi-Supervised Learning (SSL) and Unsupervised Domain Adaptation (UDA) enhance the model performance by exploiting information from labeled and unlabeled data. The clustering assumption has proven advantageous for learning with limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Durgesh Singh , Ahcène Boubekki , Robert Jenssen , Michael Kampffmeyer

Domain adaptation (DA) is a representation learning methodology that transfers knowledge from a label-sufficient source domain to a label-scarce target domain. While most of early methods are focused on unsupervised DA (UDA), several…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Yoonhyung Kim , Changick Kim

Lifelong learning in artificial intelligence (AI) aims to mimic the biological brain's ability to continuously learn and retain knowledge, yet it faces challenges such as catastrophic forgetting. Recent neuroscience research suggests that…

Artificial Intelligence · Computer Science 2024-09-24 Jin Du , Xinhe Zhang , Hao Shen , Xun Xian , Ganghua Wang , Jiawei Zhang , Yuhong Yang , Na Li , Jia Liu , Jie Ding
‹ Prev 1 2 3 10 Next ›