English
Related papers

Related papers: Compensating Distribution Drifts in Class-incremen…

200 papers

Despite rapid progress in Vision-Language-Action (VLA) models for robotic control, instruction drift remains a persistent failure mode in long-horizon tasks. This paper reconceptualizes this phenomenon, positing that instruction drift is…

Robotics · Computer Science 2026-05-12 Kewei Chen , Yayu Long , Mingsheng Shang

In class-incremental learning, the model is expected to learn new classes continually while maintaining knowledge on previous classes. The challenge here lies in preserving the model's ability to effectively represent prior classes in the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Arjun Ashok , K J Joseph , Vineeth Balasubramanian

With the development of deep learning, the field of face anti-spoofing (FAS) has witnessed great progress. FAS is usually considered a classification problem, where each class is assumed to contain a single cluster optimized by softmax…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Qinghong Sun , Zhenfei Yin , Yichao Wu , Yuanhan Zhang , Jing Shao

Real-world visual search systems involve deployments on multiple platforms with different computing and storage resources. Deploying a unified model that suits the minimal-constrain platforms leads to limited accuracy. It is expected to…

Artificial Intelligence · Computer Science 2023-03-24 Shengsen Wu , Yan Bai , Yihang Lou , Xiongkun Linghu , Jianzhong He , Ling-Yu Duan

Online Learning (OL) is a field of research that is increasingly gaining attention both in academia and industry. One of the main challenges of OL is the inherent presence of concept drifts, which are commonly defined as unforeseeable…

Machine Learning · Computer Science 2024-07-01 Mauro Dalle Lucca Tosi , Martin Theobald

In applied machine learning, concept drift, which is either gradual or abrupt changes in data distribution, can significantly reduce model performance. Typical detection methods,such as statistical tests or reconstruction-based models,are…

Machine Learning · Computer Science 2025-08-12 N Harshit , K Mounvik

In Continual Learning (CL) contexts, concept drift typically refers to the analysis of changes in data distribution. A drift in the input data can have negative consequences on a learning predictor and the system's stability. The majority…

Machine Learning · Computer Science 2024-10-23 Sebastian Basterrech

Multi-label classification (MLC) refers to the problem of tagging a given instance with a set of relevant labels. Most existing MLC methods are based on the assumption that the correlation of two labels in each label pair is symmetric,…

Machine Learning · Computer Science 2024-10-04 Xingyu Zhao , Yuexuan An , Lei Qi , Xin Geng

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

Machine Learning · Statistics 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

Classifier predictions often rely on the assumption that new observations come from the same distribution as training data. When the underlying distribution changes, so does the optimal classification rule, and performance may degrade. We…

Methodology · Statistics 2021-09-01 Ciaran Evans , Max G'Sell

The success of self-supervised learning (SSL) in vision and NLP has motivated its rapid adoption for time series. However, research has focused primarily on Generative paradigms and forecasting tasks, leaving the broader utility of learned…

Machine Learning · Computer Science 2026-05-20 Noam Major , Kathy Razmadze , Yoli Shavit

Handling distribution shifts from training data, known as out-of-distribution (OOD) generalization, poses a significant challenge in the field of machine learning. While a pre-trained vision-language model like CLIP has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux , Lukas Mauch , Marzieh Edraki , Aaron Courville

The unsupervised visual inspection of defects in industrial products poses a significant challenge due to substantial variations in product surfaces. Current unsupervised models struggle to strike a balance between detecting texture and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Peng Wang , Haiming Yao , Wenyong Yu

Accurate and stable feature matching is critical for computer vision tasks, particularly in applications such as Simultaneous Localization and Mapping (SLAM). While recent learning-based feature matching methods have demonstrated promising…

Robotics · Computer Science 2025-04-08 Yuqing Wang , Yan Wang , Hailiang Tang , Xiaoji Niu

Label distribution learning (LDL) is an emerging learning paradigm designed to capture the relative importance of labels for each instance. Label-specific features (LSFs), constructed by LIFT, have proven effective for learning tasks with…

Machine Learning · Computer Science 2025-12-04 Suping Xu , Chuyi Dai , Lin Shang , Changbin Shao , Xibei Yang , Witold Pedrycz

Continual learning from data streams is among the most important topics in contemporary machine learning. One of the biggest challenges in this domain lies in creating algorithms that can continuously adapt to arriving data. However,…

Machine Learning · Computer Science 2021-04-22 Łukasz Korycki , Bartosz Krawczyk

Post-training large language models (LLMs) often suffers from catastrophic forgetting, where improvements on a target objective degrade previously acquired capabilities. Recent evidence suggests that this phenomenon is primarily driven by…

Machine Learning · Computer Science 2026-05-07 Xinyu Wang , Changzhi Sun , Yuanbin Wu , Xiaoling Wang

Work on continual learning (CL) has thus far largely focused on the problems arising from shifts in the data distribution. However, CL can be decomposed into two sub-problems: (a) shifts in the data distribution, and (b) dealing with the…

Machine Learning · Computer Science 2024-07-12 Thomas L. Lee , Amos Storkey

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

Machine Learning · Computer Science 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to learning spurious,…

Machine Learning · Computer Science 2026-05-18 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel