English
Related papers

Related papers: Accelerating Batch Active Learning Using Continual…

200 papers

Reinforcement Learning (RL) is an important machine learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in this field due to the rapid development of deep neural networks.…

Machine Learning · Computer Science 2026-04-08 Chaofan Pan , Xin Yang , Yanhua Li , Wei Wei , Tianrui Li , Bo An , Jiye Liang

Active learning (AL) for multiple target models aims to reduce labeled data querying while effectively training multiple models concurrently. Existing AL algorithms often rely on iterative model training, which can be computationally…

Machine Learning · Computer Science 2024-10-03 Sheng-Jun Huang , Yi Li , Yiming Sun , Ying-Peng Tang

Growing concerns surrounding AI safety and data privacy have driven the development of Machine Unlearning as a potential solution. However, current machine unlearning algorithms are designed to complement the offline training paradigm. The…

Machine Learning · Computer Science 2025-09-23 Sayanta Adhikari , Vishnuprasadh Kumaravelu , P. K. Srijith

The goal of continual learning is to find a model that solves multiple learning tasks which are presented sequentially to the learner. A key challenge in this setting is that the learner may forget how to solve a previous task when learning…

Machine Learning · Computer Science 2023-06-09 Liangzu Peng , Paris V. Giampouras , René Vidal

Artificial neural networks have exceeded human-level performance in accomplishing several individual tasks (e.g. voice recognition, object recognition, and video games). However, such success remains modest compared to human intelligence…

Machine Learning · Computer Science 2019-10-21 Rahaf Aljundi

Active learning (AL) techniques optimally utilize a labeling budget by iteratively selecting instances that are most valuable for learning. However, they lack ``prerequisite checks'', i.e., there are no prescribed criteria to pick an AL…

Machine Learning · Computer Science 2024-10-07 Abhishek Ghose , Emma Thuong Nguyen

Continual Learning (CL) aims to develop agents emulating the human ability to sequentially learn new tasks while being able to retain knowledge obtained from past experiences. In this paper, we introduce the novel problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Enrico Fini , Stéphane Lathuilière , Enver Sangineto , Moin Nabi , Elisa Ricci

We introduce a neural network architecture that logarithmically reduces the number of self-rehearsal steps in the generative rehearsal of continually learned models. In continual learning (CL), training samples come in subsequent tasks, and…

Machine Learning · Computer Science 2022-01-19 Wojciech Masarczyk , Paweł Wawrzyński , Daniel Marczak , Kamil Deja , Tomasz Trzciński

Continual learning (CL) is a learning paradigm that emulates the human capability of learning and accumulating knowledge continually without forgetting the previously learned knowledge and also transferring the learned knowledge to help…

Computation and Language · Computer Science 2023-05-12 Zixuan Ke , Bing Liu

With the digitization of modern cities, large data volumes and powerful computational resources facilitate the rapid update of intelligent models deployed in smart cities. Continual learning (CL) is a novel machine learning paradigm that…

Machine Learning · Computer Science 2024-04-02 Li Yang , Zhipeng Luo , Shiming Zhang , Fei Teng , Tianrui Li

Current evaluations of Continual Learning (CL) methods typically assume that there is no constraint on training time and computation. This is an unrealistic assumption for any real-world setting, which motivates us to propose: a practical…

In recent years, deep learning has become a breakthrough technique in assisting medical image diagnosis. Supervised learning using convolutional neural networks (CNN) provides state-of-the-art performance and has served as a benchmark for…

Image and Video Processing · Electrical Eng. & Systems 2023-06-30 Tao Wang , Xinlin Zhang , Yuanbo Zhou , Junlin Lan , Tao Tan , Min Du , Qinquan Gao , Tong Tong

Active Learning (AL) is a user-interactive approach aimed at reducing annotation costs by selecting the most crucial examples to label. Although AL has been extensively studied for image classification tasks, the specific scenario of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Leah Bar , Boaz Lerner , Nir Darshan , Rami Ben-Ari

Continual learning (CL) aims to learn a sequence of tasks without forgetting prior knowledge, but gradient updates for a new task often overwrite the weights learned earlier, causing catastrophic forgetting (CF). We propose…

Machine Learning · Computer Science 2025-05-19 Neil De La Fuente , Maria Pilligua , Daniel Vidal , Albin Soutiff , Cecilia Curreli , Daniel Cremers , Andrey Barsky

Active learning (AL) is a sequential learning scheme aiming to select the most informative data. AL reduces data consumption and avoids the cost of labeling large amounts of data. However, AL trains the model and solves an acquisition…

Machine Learning · Computer Science 2025-01-13 Cen-You Li , Marc Toussaint , Barbara Rakitsch , Christoph Zimmer

Human annotation of training samples is expensive, laborious, and sometimes challenging, especially for Natural Language Processing (NLP) tasks. To reduce the labeling cost and enhance the sample efficiency, Active Learning (AL) technique…

Computation and Language · Computer Science 2024-01-17 Xuesong Wang

Despite the great success of pre-trained language models, it is still a challenge to use these models for continual learning, especially for the class-incremental learning (CIL) setting due to catastrophic forgetting (CF). This paper…

Computation and Language · Computer Science 2023-07-21 Yijia Shao , Yiduo Guo , Dongyan Zhao , Bing Liu

Building a question answering (QA) model with less annotation costs can be achieved by utilizing active learning (AL) training strategy. It selects the most informative unlabeled training data to update the model effectively. Acquisition…

Computation and Language · Computer Science 2023-11-07 Fan Luo , Mihai Surdeanu

Active learning (AL) has shown promise for being a particularly data-efficient machine learning approach. Yet, its performance depends on the application and it is not clear when AL practitioners can expect computational savings. Here, we…

Machine Learning · Computer Science 2024-08-22 Kunal Ghosh , Milica Todorović , Aki Vehtari , Patrick Rinke

We introduce Neuro-Symbolic Continual Learning, where a model has to solve a sequence of neuro-symbolic tasks, that is, it has to map sub-symbolic inputs to high-level concepts and compute predictions by reasoning consistently with prior…

Machine Learning · Computer Science 2023-12-20 Emanuele Marconato , Gianpaolo Bontempo , Elisa Ficarra , Simone Calderara , Andrea Passerini , Stefano Teso