English
Related papers

Related papers: Open-World Dynamic Prompt and Continual Visual Rep…

200 papers

With the explosion of digital data in recent years, continuously learning new tasks from a stream of data without forgetting previously acquired knowledge has become increasingly important. In this paper, we propose a new continual learning…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Shixiang Tang , Dapeng Chen , Hakan Bilen , Rui Zhao

Continual learning (CL) provides a framework for training models in ever-evolving environments. Although re-occurrence of previously seen objects or tasks is common in real-world problems, the concept of repetition in the data stream is not…

Predictive learning ideally builds the world model of physical processes in one or more given environments. Typical setups assume that we can collect data from all environments at all times. In practice, however, different prediction tasks…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Geng Chen , Wendong Zhang , Han Lu , Siyu Gao , Yunbo Wang , Mingsheng Long , Xiaokang Yang

Causal reasoning can be considered a cornerstone of intelligent systems. Having access to an underlying causal graph comes with the promise of cause-effect estimation and the identification of efficient and safe interventions. However,…

Machine Learning · Computer Science 2023-11-10 Amir Mohammad Karimi Mamaghan , Andrea Dittadi , Stefan Bauer , Karl Henrik Johansson , Francesco Quinzan

Recent advances in multimodal learning has resulted in powerful vision-language models, whose representations are generalizable across a variety of downstream tasks. Recently, their generalization ability has been further extended by…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Koustava Goswami , Srikrishna Karanam , Prateksha Udhayanan , K J Joseph , Balaji Vasan Srinivasan

Building robust and real-time classifiers with diverse datasets are one of the most significant challenges to deep learning researchers. It is because there is a considerable gap between a model built with training (seen) data and real…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Mayanka Chandrashekar , Yugyung Lee

Place recognition is an essential and challenging task in loop closing and global localization for robotics and autonomous driving applications. Benefiting from the recent advances in deep learning techniques, the performance of LiDAR place…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Jiafeng Cui , Xieyuanli Chen

Continual learning aims to provide intelligent agents that are capable of learning continually a sequence of tasks, building on previously learned knowledge. A key challenge in this learning paradigm is catastrophically forgetting…

Machine Learning · Computer Science 2021-01-18 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

Continual learning (CL) is a branch of machine learning that aims to enable agents to adapt and generalise previously learned abilities so that these can be reapplied to new tasks or environments. This is particularly useful in multi-task…

Machine Learning · Computer Science 2025-11-20 Kim N. Nolle , Ivana Dusparic , Rhodri Cusack , Vinny Cahill

A major open problem on the road to artificial intelligence is the development of incrementally learning systems that learn about more and more concepts over time from a stream of data. In this work, we introduce a new training strategy,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Sylvestre-Alvise Rebuffi , Alexander Kolesnikov , Georg Sperl , Christoph H. Lampert

Differentiable Search Index (DSI) utilizes pre-trained language models to perform indexing and document retrieval via end-to-end learning without relying on external indexes. However, DSI requires full re-training to index new documents,…

Information Retrieval · Computer Science 2025-07-01 Tuan-Luc Huynh , Thuy-Trang Vu , Weiqing Wang , Yinwei Wei , Trung Le , Dragan Gasevic , Yuan-Fang Li , Thanh-Toan Do

Existing continual learning literature relies heavily on a strong assumption that tasks arrive with a balanced data stream, which is often unrealistic in real-world applications. In this work, we explore task-imbalanced continual learning…

Machine Learning · Computer Science 2024-07-30 Chenxing Hong , Yan Jin , Zhiqi Kang , Yizhou Chen , Mengke Li , Yang Lu , Hanzi Wang

Reinforcement Learning (RL) is an important machine learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in this field due to the rapid development of deep neural networks.…

Machine Learning · Computer Science 2026-04-08 Chaofan Pan , Xin Yang , Yanhua Li , Wei Wei , Tianrui Li , Bo An , Jiye Liang

Prompt-tuning methods for Continual Learning (CL) freeze a large pre-trained model and train a few parameter vectors termed prompts. Most of these methods organize these vectors in a pool of key-value pairs and use the input image as query…

Continual learning (CL) has attracted increasing attention in the recent past. It aims to mimic the human ability to learn new concepts without catastrophic forgetting. While existing CL methods accomplish this to some extent, they are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhiyuan Hu , Jiancheng Lyu , Dashan Gao , Nuno Vasconcelos

Continual learning (CL) is a major challenge of machine learning (ML) and describes the ability to learn several tasks sequentially without catastrophic forgetting (CF). Recent works indicate that CL is a complex topic, even more so when…

Machine Learning · Computer Science 2022-06-09 Benedikt Bagus , Alexander Gepperth

Dynamic state representation learning is an important task in robot learning. Latent space that can capture dynamics related information has wide application in areas such as accelerating model free reinforcement learning, closing the…

Robotics · Computer Science 2022-07-27 Sirui Chen , Yunhao Liu , Jialong Li , Shang Wen Yao , Tingxiang Fan , Jia Pan

Class Incremental Learning (CIL) based on pre-trained models offers a promising direction for open-world continual learning. Existing methods typically rely on correlation-based strategies, where an image's classification feature is used as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Libo Huang , Zhulin An , Chuanguang Yang , Boyu Diao , Fei Wang , Yan Zeng , Zhifeng Hao , Yongjun Xu

Existing open set recognition (OSR) methods are typically designed for static scenarios, where models aim to classify known classes and identify unknown ones within fixed scopes. This deviates from the expectation that the model should…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Runqing Yang , Yimin Fu , Changyuan Wu , Zhunga Liu

Designing effective task sequences is crucial for curriculum reinforcement learning (CRL), where agents must gradually acquire skills by training on intermediate tasks. A key challenge in CRL is to identify tasks that promote exploration,…

Machine Learning · Computer Science 2025-07-08 Geonwoo Cho , Jaegyun Im , Doyoon Kim , Sundong Kim