中文
相关论文

相关论文: Unsupervised Continual Learning via Self-Adaptive …

200 篇论文

Supervised Continual learning involves updating a deep neural network (DNN) from an ever-growing stream of labeled data. While most work has focused on overcoming catastrophic forgetting, one of the major motivations behind continual…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Md Yousuf Harun , Jhair Gallardo , Tyler L. Hayes , Christopher Kanan

Continual learning (CL) studies the problem of learning a sequence of tasks, one at a time, such that the learning of each new task does not lead to the deterioration in performance on the previously seen ones while exploiting previously…

机器学习 · 计算机科学 2020-11-03 Ammar Shaker , Francesco Alesiani , Shujian Yu , Wenzhe Yin

The staple of human intelligence is the capability of acquiring knowledge in a continuous fashion. In stark contrast, Deep Networks forget catastrophically and, for this reason, the sub-field of Class-Incremental Continual Learning fosters…

机器学习 · 计算机科学 2022-09-20 Matteo Boschini , Lorenzo Bonicelli , Pietro Buzzega , Angelo Porrello , Simone Calderara

Continual Learning (CL, sometimes also termed incremental learning) is a flavor of machine learning where the usual assumption of stationary data distribution is relaxed or omitted. When naively applying, e.g., DNNs in CL problems, changes…

机器学习 · 计算机科学 2022-08-31 Benedikt Bagus , Alexander Gepperth , Timothée Lesort

Self-supervised learning has recently emerged as a strong alternative in document analysis. These approaches are now capable of learning high-quality image representations and overcoming the limitations of supervised methods, which require…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Marwa Dhiaf , Mohamed Ali Souibgui , Kai Wang , Yuyang Liu , Yousri Kessentini , Alicia Fornés , Ahmed Cheikh Rouhou

Humans can learn incrementally, whereas neural networks forget previously acquired information catastrophically. Continual Learning (CL) approaches seek to bridge this gap by facilitating the transfer of knowledge to both previous tasks…

Unsupervised ensemble learning emerged to address the challenge of combining multiple learners' predictions without access to ground truth labels or additional data. This paradigm is crucial in scenarios where evaluating individual…

机器学习 · 计算机科学 2026-01-29 Ariel Maymon , Yanir Buznah , Uri Shaham

Continual learning (CL) aims to learn a sequence of tasks without forgetting the previously acquired knowledge. However, recent CL advances are restricted to supervised continual learning (SCL) scenarios. Consequently, they are not scalable…

机器学习 · 计算机科学 2022-04-06 Divyam Madaan , Jaehong Yoon , Yuanchun Li , Yunxin Liu , Sung Ju Hwang

Most artificial intelligence models have limiting ability to solve new tasks faster, without forgetting previously acquired knowledge. The recently emerging paradigm of continual learning aims to solve this issue, in which the model learns…

机器学习 · 计算机科学 2018-06-01 Ju Xu , Zhanxing Zhu

Continual learning studies how models can adapt to new tasks while retaining previously acquired knowledge. Although a broad spectrum of methods has been proposed to mitigate catastrophic forgetting, the field remains predominantly…

机器学习 · 计算机科学 2026-05-19 Katarzyna Filus , Kamil Faber , Roberto Corizzo , Christopher Kanan

With the increasing demand for large amount of labeled data, crowdsourcing has been used in many large-scale data mining applications. However, most existing works in crowdsourcing mainly focus on label inference and incentive design. In…

机器学习 · 统计学 2019-01-16 Yao Zhou , Arun Reddy Nelakurthi , Jingrui He

This paper proposes Mutual Information Regularized Assignment (MIRA), a pseudo-labeling algorithm for unsupervised representation learning inspired by information maximization. We formulate online pseudo-labeling as an optimization problem…

计算机视觉与模式识别 · 计算机科学 2022-11-07 Dong Hoon Lee , Sungik Choi , Hyunwoo Kim , Sae-Young Chung

Self-supervised representation learning has achieved remarkable success in recent years. By subverting the need for supervised labels, such approaches are able to utilize the numerous unlabeled images that exist on the Internet and in…

计算机视觉与模式识别 · 计算机科学 2021-09-01 Yilun Du , Chuang Gan , Phillip Isola

We propose a novel framework and a solution to tackle the continual learning (CL) problem with changing network architectures. Most CL methods focus on adapting a single architecture to a new task/class by modifying its weights. However,…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Divyam Madaan , Hongxu Yin , Wonmin Byeon , Jan Kautz , Pavlo Molchanov

Growing concerns surrounding AI safety and data privacy have driven the development of Machine Unlearning as a potential solution. However, current machine unlearning algorithms are designed to complement the offline training paradigm. The…

机器学习 · 计算机科学 2025-09-23 Sayanta Adhikari , Vishnuprasadh Kumaravelu , P. K. Srijith

Catastrophic forgetting means that a trained neural network model gradually forgets the previously learned tasks when being retrained on new tasks. Overcoming the forgetting problem is a major problem in machine learning. Numerous continual…

机器学习 · 计算机科学 2021-07-19 Yujiang He , Bernhard Sick

This paper outlines our approach to the 5th CLVision challenge at CVPR, which addresses the Class-Incremental with Repetition (CIR) scenario. In contrast to traditional class incremental learning, this novel setting introduces unique…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Panagiota Moraiti , Efstathios Karypidis

Self-supervised features are the cornerstone of modern machine learning systems. They are typically pre-trained on data collections whose construction and curation typically require extensive human effort. This manual process has some…

Continual learning is the ability to acquire new knowledge without forgetting the previously learned one, assuming no further access to past training data. Neural network approximators trained with gradient descent are known to fail in this…

机器学习 · 计算机科学 2021-11-05 Rodrigue Siry

Currently, the divergence in distributions of design and operational data, and large computational complexity are limiting factors in the adoption of CNNs in real-world applications. For instance, person re-identification systems typically…

机器学习 · 计算机科学 2020-05-19 Le Thanh Nguyen-Meidine , Eric Granger , Madhu Kiran , Jose Dolz , Louis-Antoine Blais-Morin