English
Related papers

Related papers: International Workshop on Continual Semi-Supervise…

200 papers

Continual learning aims to learn new tasks incrementally using less computation and memory resources instead of retraining the model from scratch whenever new task arrives. However, existing approaches are designed in supervised fashion…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Jiangpeng He , Fengqing Zhu

Continual learning aims to improve the ability of modern learning systems to deal with non-stationary distributions, typically by attempting to learn a series of tasks sequentially. Prior art in the field has largely considered supervised…

Machine Learning · Computer Science 2019-11-01 Dushyant Rao , Francesco Visin , Andrei A. Rusu , Yee Whye Teh , Razvan Pascanu , Raia Hadsell

Continual Learning (CL) poses a significant challenge in Artificial Intelligence, aiming to mirror the human ability to incrementally acquire knowledge and skills. While extensive research has focused on CL within the context of…

Machine Learning · Computer Science 2024-06-10 Haotian Zhang , Junting Zhou , Haowei Lin , Hang Ye , Jianhua Zhu , Zihao Wang , Liangcai Gao , Yizhou Wang , Yitao Liang

In this paper, we introduce the concept of collective learning (CL) which exploits the notion of collective intelligence in the field of distributed semi-supervised learning. The proposed framework draws inspiration from the learning…

Machine Learning · Computer Science 2021-05-27 Francesco Farina

Annotating large-scale LiDAR point clouds for 3D semantic segmentation is costly and time-consuming, which motivates the use of semi-supervised learning (SemiSL). Standard LiDAR SemiSL methods typically adopt a two-step training paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Bin Yang , Alexandru Paul Condurache

Non-Centralized Continual Learning (NCCL) has become an emerging paradigm for enabling distributed devices such as vehicles and servers to handle streaming data from a joint non-stationary environment. To achieve high reliability and…

Machine Learning · Computer Science 2025-05-07 Yichen Li , Haozhao Wang , Wenchao Xu , Tianzhe Xiao , Hong Liu , Minzhu Tu , Yuying Wang , Xin Yang , Rui Zhang , Shui Yu , Song Guo , Ruixuan Li

Continual Learning (CL, sometimes also termed incremental learning) is a flavor of machine learning where the usual assumption of stationary data distribution is relaxed or omitted. When naively applying, e.g., DNNs in CL problems, changes…

Machine Learning · Computer Science 2022-08-31 Benedikt Bagus , Alexander Gepperth , Timothée Lesort

Growing concerns surrounding AI safety and data privacy have driven the development of Machine Unlearning as a potential solution. However, current machine unlearning algorithms are designed to complement the offline training paradigm. The…

Machine Learning · Computer Science 2025-09-23 Sayanta Adhikari , Vishnuprasadh Kumaravelu , P. K. Srijith

There has been significant recent interest in understanding the capacity of Transformers for in-context learning (ICL), yet most theory focuses on supervised settings with explicitly labeled pairs. In practice, Transformers often perform…

Machine Learning · Computer Science 2026-02-02 Jiashuo Fan , Paul Rosu , Aaron T. Wang , Zeyu Michael Li , Lawrence Carin , Xiang Cheng

Aiming at improving performance of visual classification in a cost-effective manner, this paper proposes an incremental semi-supervised learning paradigm called Deep Co-Space (DCS). Unlike many conventional semi-supervised learning methods…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Ziliang Chen , Keze Wang , Xiao Wang , Pai Peng , Ebroul Izquierdo , Liang Lin

Humans can learn incrementally, whereas neural networks forget previously acquired information catastrophically. Continual Learning (CL) approaches seek to bridge this gap by facilitating the transfer of knowledge to both previous tasks…

A novel semi-supervised learning technique is introduced based on a simple iterative learning cycle together with learned thresholding techniques and an ensemble decision support system. State-of-the-art model performance and increased…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Robert Dupre , Jiri Fajtl , Vasileios Argyriou , Paolo Remagnin

Continual learning (CL) is under-explored in the video domain. The few existing works contain splits with imbalanced class distributions over the tasks, or study the problem in unsuitable datasets. We introduce vCLIMB, a novel video…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Andrés Villa , Kumail Alhamoud , Juan León Alcázar , Fabian Caba Heilbron , Victor Escorcia , Bernard Ghanem

Self-supervised learning (SSL) aims to eliminate one of the major bottlenecks in representation learning - the need for human annotations. As a result, SSL holds the promise to learn representations from data in-the-wild, i.e., without the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Senthil Purushwalkam , Pedro Morgado , Abhinav Gupta

Despite significant advances, the performance of state-of-the-art continual learning approaches hinges on the unrealistic scenario of fully labeled data. In this paper, we tackle this challenge and propose an approach for continual…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Zhiqi Kang , Enrico Fini , Moin Nabi , Elisa Ricci , Karteek Alahari

This work proposes an overview of the recent semi-supervised learning approaches and related works. Despite the remarkable success of neural networks in various applications, there exist a few formidable constraints, including the need for…

Machine Learning · Computer Science 2024-08-09 Gyeongho Kim

Most existing works on continual learning (CL) focus on overcoming the catastrophic forgetting (CF) problem, with dynamic models and replay methods performing exceptionally well. However, since current works tend to assume exclusivity or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Sijia Wang , Yoojin Choi , Junya Chen , Mostafa El-Khamy , Ricardo Henao

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Deep learning approaches achieve state-of-the-art performance for classifying radiology images, but rely on large labelled datasets that require resource-intensive annotation by specialists. Both semi-supervised learning and active learning…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Shafa Balaram , Cuong M. Nguyen , Ashraf Kassim , Pavitra Krishnaswamy

Disease diagnosis from medical images via supervised learning is usually dependent on tedious, error-prone, and costly image labeling by medical experts. Alternatively, semi-supervised learning and self-supervised learning offer…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Attiano Purpura-Pontoniere , Demetri Terzopoulos , Adam Wang , Abdullah-Al-Zubaer Imran