中文
相关论文

相关论文: Learning to Imagine: Diversify Memory for Incremen…

200 篇论文

Humans have the ability to accumulate knowledge of new tasks in varying conditions, but deep neural networks often suffer from catastrophic forgetting of previously learned knowledge after learning a new task. Many recent methods focus on…

Machine unlearning has emerged as a new paradigm to deliberately forget data samples from a given model in order to adhere to stringent regulations. However, existing machine unlearning methods have been primarily focused on classification…

机器学习 · 计算机科学 2024-02-05 Guihong Li , Hsiang Hsu , Chun-Fu Chen , Radu Marculescu

Traditional Incremental Learning (IL) targets to handle sequential fully-supervised learning problems where novel classes emerge from time to time. However, due to inherent annotation uncertainty and ambiguity, collecting high-quality…

机器学习 · 计算机科学 2025-05-08 Rui Wang , Mingxuan Xia , Chang Yao , Lei Feng , Junbo Zhao , Gang Chen , Haobo Wang

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

机器学习 · 计算机科学 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Deep learning architectures exhibit a critical drop of performance due to catastrophic forgetting when they are required to incrementally learn new tasks. Contemporary incremental learning frameworks focus on image classification and object…

计算机视觉与模式识别 · 计算机科学 2019-09-18 Umberto Michieli , Pietro Zanuttigh

Machine unlearning as an emerging research topic for data regulations, aims to adjust a trained model to approximate a retrained one that excludes a portion of training data. Previous studies showed that class-wise unlearning is successful…

机器学习 · 计算机科学 2024-06-18 Jianing Zhu , Bo Han , Jiangchao Yao , Jianliang Xu , Gang Niu , Masashi Sugiyama

The malicious use and widespread dissemination of deepfake pose a significant crisis of trust. Current deepfake detection models can generally recognize forgery images by training on a large dataset. However, the accuracy of detection…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Kun Pan , Yin Yifang , Yao Wei , Feng Lin , Zhongjie Ba , Zhenguang Liu , ZhiBo Wang , Lorenzo Cavallaro , Kui Ren

Class-incremental learning of deep networks sequentially increases the number of classes to be classified. During training, the network has only access to data of one task at a time, where each task contains several classes. In this…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Lu Yu , Bartłomiej Twardowski , Xialei Liu , Luis Herranz , Kai Wang , Yongmei Cheng , Shangling Jui , Joost van de Weijer

It has been observed that neural networks perform poorly when the data or tasks are presented sequentially. Unlike humans, neural networks suffer greatly from catastrophic forgetting, making it impossible to perform life-long learning. To…

机器学习 · 计算机科学 2023-01-31 Longhui Yu , Tianyang Hu , Lanqing Hong , Zhen Liu , Adrian Weller , Weiyang Liu

How can neural networks trained by contrastive learning extract features from the unlabeled data? Why does contrastive learning usually need much stronger data augmentations than supervised learning to ensure good representations? These…

机器学习 · 计算机科学 2021-07-06 Zixin Wen , Yuanzhi Li

Deep neural networks (DNNs) excel on fixed datasets but struggle with incremental and shifting data in real-world scenarios. Continual learning addresses this challenge by allowing models to learn from new data while retaining previously…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Lu Yu , Zhe Tao , Dipam Goswami , Hantao Yao , Bartłomiej Twardowski , Joost Van de Weijer , Changsheng Xu

In Continual learning (CL) balancing effective adaptation while combating catastrophic forgetting is a central challenge. Many of the recent best-performing methods utilize various forms of prior task data, e.g. a replay buffer, to tackle…

机器学习 · 计算机科学 2023-06-07 Nader Asadi , MohammadReza Davari , Sudhir Mudur , Rahaf Aljundi , Eugene Belilovsky

Generic Image recognition is a fundamental and fairly important visual problem in computer vision. One of the major challenges of this task lies in the fact that single image usually has multiple objects inside while the labels are still…

计算机视觉与模式识别 · 计算机科学 2019-08-23 Zhiqiang Shen , Zhankui He , Wanyun Cui , Jiahui Yu , Yutong Zheng , Chenchen Zhu , Marios Savvides

Despite huge success, deep networks are unable to learn effectively in sequential multitask learning settings as they forget the past learned tasks after learning new tasks. Inspired from complementary learning systems theory, we address…

机器学习 · 计算机科学 2019-06-04 Mohammad Rostami , Soheil Kolouri , Praveen K. Pilly

Distillation with unlabeled examples is a popular and powerful method for training deep neural networks in settings where the amount of labeled data is limited: A large ''teacher'' neural network is trained on the labeled data available,…

机器学习 · 计算机科学 2022-10-14 Fotis Iliopoulos , Vasilis Kontonis , Cenk Baykal , Gaurav Menghani , Khoa Trinh , Erik Vee

As machine learning continues to develop, and data misuse scandals become more prevalent, individuals are becoming increasingly concerned about their personal information and are advocating for the right to remove their data. Machine…

机器学习 · 计算机科学 2023-08-22 Hui Sun , Tianqing Zhu , Wenhan Chang , Wanlei Zhou

Current contrastive learning methods use random transformations sampled from a large list of transformations, with fixed hyperparameters, to learn invariance from an unannotated database. Following previous works that introduce a small…

机器学习 · 计算机科学 2023-08-21 Camille Ruppli , Pietro Gori , Roberto Ardon , Isabelle Bloch

Deep neural networks (DNNs) are vulnerable to adversarial examples, perturbations to correctly classified examples which can cause the model to misclassify. In the image domain, these perturbations are often virtually indistinguishable to…

计算与语言 · 计算机科学 2018-09-26 Moustafa Alzantot , Yash Sharma , Ahmed Elgohary , Bo-Jhang Ho , Mani Srivastava , Kai-Wei Chang

When incrementally trained on new classes, deep neural networks are subject to catastrophic forgetting which leads to an extreme deterioration of their performance on the old classes while learning the new ones. Using a small memory…

机器学习 · 计算机科学 2022-11-15 Quentin Jodelet , Xin Liu , Tsuyoshi Murata

Deep learning models often suffer from forgetting previously learned information when trained on new data. This problem is exacerbated in federated learning (FL), where the data is distributed and can change independently for each user.…

机器学习 · 计算机科学 2023-11-22 Sara Babakniya , Zalan Fabian , Chaoyang He , Mahdi Soltanolkotabi , Salman Avestimehr