中文
相关论文

相关论文: Adversarially Diversified Rehearsal Memory (ADRM):…

200 篇论文

Continual fine-tuning of large language models (LLMs) is becoming increasingly crucial as these models are deployed in dynamic environments where tasks and data distributions evolve over time. While strong adaptability enables rapid…

机器学习 · 计算机科学 2026-03-11 Yiyang Lu , Yu He , Jianlong Chen , Hongyuan Zha

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

计算机视觉与模式识别 · 计算机科学 2023-01-04 Francesco Pelosin

Class incremental learning approaches are useful as they help the model to learn new information (classes) sequentially, while also retaining the previously acquired information (classes). However, it has been shown that such approaches are…

机器学习 · 计算机科学 2023-05-01 Muhammad Umer , Robi Polikar

Unsupervised anomaly detection aims to build models to effectively detect unseen anomalies by only training on the normal data. Although previous reconstruction-based methods have made fruitful progress, their generalization ability is…

机器学习 · 计算机科学 2022-01-04 Yuxin Zhang , Jindong Wang , Yiqiang Chen , Han Yu , Tao Qin

The goal of continual learning (CL) is to learn a sequence of tasks without suffering from the phenomenon of catastrophic forgetting. Previous work has shown that leveraging memory in the form of a replay buffer can reduce performance…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Sayna Ebrahimi , Suzanne Petryk , Akash Gokul , William Gan , Joseph E. Gonzalez , Marcus Rohrbach , Trevor Darrell

Although deep learning performs really well in a wide variety of tasks, it still suffers from catastrophic forgetting -- the tendency of neural networks to forget previously learned information upon learning new tasks where previous data is…

计算机视觉与模式识别 · 计算机科学 2020-02-04 Ankur Singh

Adversarial attacks on deep-learning models pose a serious threat to their reliability and security. Existing defense mechanisms are narrow addressing a specific type of attack or being vulnerable to sophisticated attacks. We propose a new…

机器学习 · 计算机科学 2023-06-22 Mouna Rabhi , Roberto Di Pietro

Functional magnetic resonance imaging (fMRI) is widely used for studying and diagnosing brain disorders, with functional connectivity (FC) matrices providing powerful representations of large-scale neural interactions. However, existing…

组织与器官 · 定量生物学 2026-04-17 Qianyu Chen , Shujian Yu

Artificial neural networks are well-known to be susceptible to catastrophic forgetting when continually learning from sequences of tasks. Various continual (or "incremental") learning approaches have been proposed to avoid catastrophic…

机器学习 · 计算机科学 2020-02-19 Muhammad Umer , Glenn Dawson , Robi Polikar

Neural networks can achieve excellent results in a wide variety of applications. However, when they attempt to sequentially learn, they tend to learn the new task while catastrophically forgetting previous ones. We propose a model that…

机器学习 · 计算机科学 2020-12-18 Craig Atkinson , Brendan McCane , Lech Szymanski , Anthony Robins

Continual learning (CL) is a fundamental topic in machine learning, where the goal is to train a model with continuously incoming data and tasks. Due to the memory limit, we cannot store all the historical data, and therefore confront the…

机器学习 · 计算机科学 2024-07-31 Weichen Lin , Jiaxiang Chen , Ruomin Huang , Hu Ding

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

机器学习 · 计算机科学 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Machine Learning models in real-world applications must continuously learn new tasks to adapt to shifts in the data-generating distribution. Yet, for Continual Learning (CL), models often struggle to balance learning new tasks (plasticity)…

机器学习 · 计算机科学 2025-10-24 Luckeciano C. Melo , Alessandro Abate , Yarin Gal

Continual learning is the process of training machine learning models on a sequence of tasks where data distributions change over time. A well-known obstacle in this setting is catastrophic forgetting, a phenomenon in which a model…

机器学习 · 计算机科学 2025-02-18 Andrii Krutsylo

The pursuit of long-term autonomy mandates that machine learning models must continuously adapt to their changing environments and learn to solve new tasks. Continual learning seeks to overcome the challenge of catastrophic forgetting,…

机器学习 · 计算机科学 2024-07-25 Jack Foster , Alexandra Brintrup

Catastrophic forgetting is a critical challenge in training deep neural networks. Although continual learning has been investigated as a countermeasure to the problem, it often suffers from the requirements of additional network components…

机器学习 · 计算机科学 2019-10-23 Dongmin Park , Seokil Hong , Bohyung Han , Kyoung Mu Lee

Retrieval Augmented Language Models (RALMs) have gained significant attention for their ability to generate accurate answer and improve efficiency. However, RALMs are inherently vulnerable to imperfect information due to their reliance on…

计算与语言 · 计算机科学 2024-10-22 Seong-Il Park , Jay-Yoon Lee

While deep learning in the form of recurrent neural networks (RNNs) has caused a significant improvement in neural language modeling, the fact that they are extremely prone to overfitting is still a mainly unresolved issue. In this paper we…

计算与语言 · 计算机科学 2022-11-18 Sajad Movahedi , Azadeh Shakery

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

机器学习 · 计算机科学 2020-12-09 Timothée Lesort

Adversarial attacks on Face Recognition (FR) systems have demonstrated significant effectiveness against standalone FR models. However, their practicality diminishes in complete FR systems that incorporate Face Anti-Spoofing (FAS) models,…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Fengfan Zhou , Qianyu Zhou , Hefei Ling , Xuequan Lu