English
Related papers

Related papers: Continual Learning on a Diet: Learning from Sparse…

200 papers

Previous LLMs-based RL studies typically follow either supervised learning with high annotation costs, or unsupervised paradigms using voting or entropy-based rewards. However, their performance remains far from satisfactory due to the…

Machine Learning · Computer Science 2026-04-22 Zhiyin Yu , Bo Zhang , Qibin Hou , Zhonghai Wu , Xiao Luo , Lei Bai

The use of machine learning methods helps to improve decision making in different fields. In particular, the idea of bridging predictions (machine learning models) and prescriptions (optimization problems) is gaining attention within the…

Optimization and Control · Mathematics 2022-11-22 Antonio Alcántara , Carlos Ruiz

Data labeling in supervised learning is considered an expensive and infeasible tool in some conditions. The self-supervised learning method is proposed to tackle the learning effectiveness with fewer labeled data, however, there is a lack…

Machine Learning · Computer Science 2021-08-18 Hilal AlQuabeh , Ameera Bawazeer , Abdulateef Alhashmi

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-08-09 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Continual learning on edge devices poses unique challenges due to stringent resource constraints. This paper introduces a novel method that leverages stochastic competition principles to promote sparsity, significantly reducing deep network…

Machine Learning · Computer Science 2024-07-16 Theodoros Christophides , Kyriakos Tolias , Sotirios Chatzis

Online Active Learning (OAL) aims to manage unlabeled datastream by selectively querying the label of data. OAL is applicable to many real-world problems, such as anomaly detection in health-care and finance. In these problems, there are…

Machine Learning · Computer Science 2019-11-19 Yifan Zhang , Peilin Zhao , Shuaicheng Niu , Qingyao Wu , Jiezhang Cao , Junzhou Huang , Mingkui Tan

Federated Continual Learning (FCL) aims to enable sequentially privacy-preserving model training on streams of incoming data that vary in edge devices by preserving previous knowledge while adapting to new data. Current FCL literature…

Machine Learning · Computer Science 2025-10-15 Yichen Li , Yuying Wang , Jiahua Dong , Haozhao Wang , Yining Qi , Rui Zhang , Ruixuan Li

In Continual Learning (CL), a neural network is trained on a stream of data whose distribution changes over time. In this context, the main problem is how to learn new information without forgetting old knowledge (i.e., Catastrophic…

Complementary-label learning (CLL) is a weakly supervised paradigm where instances are labeled with classes they do not belong to. Despite a decade of research, CLL methods remain competitive mainly on 10-class classification, with scaling…

Machine Learning · Computer Science 2026-05-19 Tan-Ha Mai , Chao-Kai Chiang , Han-Hwa Shih , Gang Niu , Masashi Sugiyama , Hsuan-Tien Lin

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to learning spurious,…

Machine Learning · Computer Science 2026-05-18 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel

Semi-supervised action recognition aims to improve spatio-temporal reasoning ability with a few labeled data in conjunction with a large amount of unlabeled data. Albeit recent advancements, existing powerful methods are still prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Yu Wang , Sanping Zhou , Kun Xia , Le Wang

The problem of learning from few labeled examples while using large amounts of unlabeled data has been approached by various semi-supervised methods. Although these methods can achieve superior performance, the models are often not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Sahil Khose , Shruti Jain , V Manushree

Clustered Federated Multi-task Learning (CFL) has emerged as a promising technique to address statistical challenges, particularly with non-independent and identically distributed (non-IID) data across users. However, existing CFL studies…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-24 Moqbel Hamood , Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha

Pre-training a recognition model with contrastive learning on a large dataset of unlabeled data has shown great potential to boost the performance of a downstream task, e.g., image classification. However, in domains such as medical…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jizong Peng , Ping Wang , Chrisitian Desrosiers , Marco Pedersoli

Learning with reduced labeling standards, such as noisy label, partial label, and multiple label candidates, which we generically refer to as \textit{imprecise} labels, is a commonplace challenge in machine learning tasks. Previous methods…

Machine Learning · Computer Science 2024-10-31 Hao Chen , Ankit Shah , Jindong Wang , Ran Tao , Yidong Wang , Xing Xie , Masashi Sugiyama , Rita Singh , Bhiksha Raj

Semi-supervised 3D medical image segmentation aims to achieve accurate segmentation using few labelled data and numerous unlabelled data. The main challenge in the design of semi-supervised learning methods consists in the effective use of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yanyan Wang , Kechen Song , Yuyuan Liu , Shuai Ma , Yunhui Yan , Gustavo Carneiro

Deep learning methodologies have been employed in several different fields, with an outstanding success in image recognition applications, such as material quality control, medical imaging, autonomous driving, etc. Deep learning models rely…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Saul Calderon-Ramirez , Shengxiang Yang , David Elizondo

Supervised learning usually requires a large amount of labelled data. However, attaining ground-truth labels is costly for many tasks. Alternatively, weakly supervised methods learn with cheap weak signals that only approximately label some…

Machine Learning · Computer Science 2024-11-26 You Lu , Wenzhuo Song , Chidubem Arachie , Bert Huang

Despite the critical importance of the medical domain in Deep Learning, most of the research in this area solely focuses on training models in static environments. It is only in recent years that research has begun to address dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Marina Ceccon , Davide Dalle Pezze , Alessandro Fabris , Gian Antonio Susto

In-context learning (ICL) is the ability of a large language model (LLM) to learn a new task from a few demonstrations presented as part of the context. Past studies have attributed a large portion of the success of ICL to the way these…

Computation and Language · Computer Science 2025-10-10 Ioana Marinescu , Kyunghyun Cho , Eric Karl Oermann