English
Related papers

Related papers: Open-World Dynamic Prompt and Continual Visual Rep…

200 papers

Continual learning (CL) aims to help deep neural networks learn new knowledge while retaining what has been learned. Owing to their powerful generalizability, pre-trained vision-language models such as Contrastive Language-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Saurav Jha , Dong Gong , Lina Yao

Class-incremental learning (CIL) enables models to learn new classes progressively while preserving knowledge of previously learned ones. Recent advances in this field have shifted towards parameter-efficient fine-tuning techniques, with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Haoran Chen , Ping Wang , Zihan Zhou , Xu Zhang , Zuxuan Wu , Yu-Gang Jiang

Continual Learning (CL) aims to incrementally acquire new knowledge while mitigating catastrophic forgetting. Within this setting, Online Continual Learning (OCL) focuses on updating models promptly and incrementally from single or small…

Machine Learning · Computer Science 2025-12-19 Giovanni Donghi , Luca Pasa , Daniele Zambon , Cesare Alippi , Nicolò Navarin

This paper presents Prototypical Contrastive Learning (PCL), an unsupervised representation learning method that addresses the fundamental limitations of instance-wise contrastive learning. PCL not only learns low-level features for the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Junnan Li , Pan Zhou , Caiming Xiong , Steven C. H. Hoi

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

Machine Learning · Computer Science 2020-12-09 Timothée Lesort

How to adapt a pre-trained model continuously for sequential tasks with different prediction class labels and domains and finally learn a generalizable model across diverse tasks is a long-lasting challenge. Continual learning (CL) has…

Machine Learning · Computer Science 2025-04-15 Xiaobing Yu , Jin Yang , Xiao Wu , Peijie Qiu , Xiaofeng Liu

Conventional representation learning methods learn a universal representation that primarily captures dominant semantics, which may not always align with customized downstream tasks. For instance, in animal habitat analysis, researchers…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Honglin Liu , Chao Sun , Peng Hu , Yunfan Li , Xi Peng

Graph Prompt Learning (GPL) has emerged as a promising paradigm that bridges graph pretraining models and downstream scenarios, mitigating label dependency and the misalignment between upstream pretraining and downstream tasks. Although…

Machine Learning · Computer Science 2025-10-15 Yongqi Huang , Jitao Zhao , Dongxiao He , Xiaobao Wang , Yawen Li , Yuxiao Huang , Di Jin , Zhiyong Feng

The performance of Visio-Language Transformers drops sharply when an input modality (e.g., image) is missing, because the model is forced to make predictions using incomplete information. Existing missing-aware prompt methods help reduce…

Machine Learning · Computer Science 2025-11-18 Jueqing Lu , Yuanyuan Qi , Xiaohao Yang , Shuaicheng Niu , Fucai Ke , Shujie Zhou , Wei Tan , Jionghao Lin , Wray Buntine , Hamid Rezatofighi , Lan Du

Meta continual learning algorithms seek to train a model when faced with similar tasks observed in a sequential manner. Despite promising methodological advancements, there is a lack of theoretical frameworks that enable analysis of…

Machine Learning · Computer Science 2020-10-12 R. Krishnan , Prasanna Balaprakash

Continual learning (CL) aims to train deep neural networks efficiently on streaming data while limiting the forgetting caused by new tasks. However, learning transferable knowledge with less interference between tasks is difficult, and…

Machine Learning · Computer Science 2023-10-31 Saurav Jha , Dong Gong , He Zhao , Lina Yao

In-context reinforcement learning (ICRL) leverages the in-context learning capabilities of transformer models (TMs) to efficiently generalize to unseen sequential decision-making tasks without parameter updates. However, existing ICRL…

Machine Learning · Computer Science 2026-02-10 Juncheng Dong , Bowen He , Moyang Guo , Ethan X. Fang , Zhuoran Yang , Vahid Tarokh

Modern action-conditioned video world models achieve strong short-horizon visual realism, yet remain unreliable on rare, interaction-critical transitions that dominate downstream planning and policy performance. Because passive…

Reinforcement Learning (RL) faces significant challenges in adaptive healthcare interventions, such as dementia care, where data is scarce, decisions require interpretability, and underlying patient-state dynamic are complex and causal in…

Robotics · Computer Science 2025-12-02 Wenzheng Zhao , Ran Zhang , Ruth Palan Lopez , Shu-Fen Wung , Fengpei Yuan

Prompt learning has been designed as an alternative to fine-tuning for adapting Vision-language (V-L) models to the downstream tasks. Previous works mainly focus on text prompt while visual prompt works are limited for V-L models. The…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Chen Xu , Yuhan Zhu , Haocheng Shen , Boheng Chen , Yixuan Liao , Xiaoxin Chen , Limin Wang

Effective planning in model-based reinforcement learning (MBRL) and model-predictive control (MPC) relies on the accuracy of the learned dynamics model. In many instances of MBRL and MPC, this model is assumed to be stationary and is…

Machine Learning · Computer Science 2026-05-27 Yizhou Huang , Kevin Xie , Homanga Bharadhwaj , Florian Shkurti

Providing a suitable reward function to reinforcement learning can be difficult in many real world applications. While inverse reinforcement learning (IRL) holds promise for automatically learning reward functions from demonstrations,…

Machine Learning · Computer Science 2019-10-29 Lantao Yu , Tianhe Yu , Chelsea Finn , Stefano Ermon

Domain generalization (DG) is a difficult transfer learning problem aiming to learn a generalizable model for unseen domains. Recent foundation models (FMs) are robust to many distribution shifts and, therefore, should substantially improve…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Xin Zhang , Shixiang Shane Gu , Yutaka Matsuo , Yusuke Iwasawa

A continual learning (CL) algorithm learns from a non-stationary data stream. The non-stationarity is modeled by some schedule that determines how data is presented over time. Most current methods make strong assumptions on the schedule and…

Machine Learning · Computer Science 2022-10-17 Ruohan Wang , Marco Ciccone , Giulia Luise , Andrew Yapp , Massimiliano Pontil , Carlo Ciliberto

Large Language Models (LLMs) have achieved remarkable performance across various reasoning tasks, yet post-training is constrained by inefficient sample utilization and inflexible difficulty samples processing. To address these limitations,…