English
Related papers

Related papers: Continual Learning, Not Training: Online Adaptatio…

200 papers

Class-incremental learning (CIL) aims to learn new classes while retaining previous knowledge. Although pre-trained model (PTM) based approaches show strong performance, directly fine-tuning PTMs on incremental task streams often causes…

Machine Learning · Computer Science 2025-12-02 Zhiming Xu , Suorong Yang , Baile Xu , Furao Shen , Jian Zhao

Large language models show promise for financial decision-making, yet deploying them as autonomous trading agents raises fundamental challenges: how to adapt instructions when rewards arrive late and obscured by market noise, how to…

Trading and Market Microstructure · Quantitative Finance 2026-05-21 Charidimos Papadakis , Angeliki Dimitriou , Giorgos Filandrianos , Maria Lymperaiou , Konstantinos Thomas , Giorgos Stamou

High-dimensional, heterogeneous data with complex feature interactions pose significant challenges for traditional predictive modeling approaches. While Projection to Latent Structures (PLS) remains a popular technique, it struggles to…

Machine Learning · Computer Science 2025-10-21 Farwa Abbas , Hussain Ahmad , Claudia Szabo

Continual learning (CL) is a new online learning technique over sequentially generated streaming data from different tasks, aiming to maintain a small forgetting loss on previously-learned tasks. Existing work focuses on reducing the…

Machine Learning · Computer Science 2024-12-25 Shugang Hao , Lingjie Duan

We propose an adaptive multi-agent clustering recognition system that can be self-supervised driven, based on a temporal sequences continuous learning mechanism with adaptability. The system is designed to use some different functional…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Xingyu Qian , Aximu Yuemaier , Longfei Liang , Wen-Chi Yang , Xiaogang Chen , Shunfen Li , Weibang Dai , Zhitang Song

Large language models (LLMs) can adapt to new tasks via in-context learning (ICL) without parameter updates, making them powerful learning engines for fast adaptation. While extensive research has examined ICL as a few-shot learner, whether…

Machine Learning · Computer Science 2025-09-30 Liuwang Kang , Fan Wang , Shaoshan Liu , Hung-Chyun Chou , Chuan Lin , Ning Ding

Continual Learning (CL) is a process in which there is still huge gap between human and deep learning model efficiency. Recently, many CL algorithms were designed. Most of them have many problems with learning in dynamic and complex…

Machine Learning · Computer Science 2023-10-03 Marcin Pietroń , Dominik Żurek , Kamil Faber , Roberto Corizzo

In this paper, we introduce an alternative approach to enhancing Multi-Agent Reinforcement Learning (MARL) through the integration of domain knowledge and attention-based policy mechanisms. Our methodology focuses on the incorporation of…

Machine Learning · Computer Science 2025-04-04 Andre R Kuroswiski , Annie S Wu , Angelo Passaro

Offline Reinforcement Learning (RL), which operates solely on static datasets without further interactions with the environment, provides an appealing alternative to learning a safe and promising control policy. The prevailing methods…

Machine Learning · Computer Science 2025-03-18 Kun Wu , Yinuo Zhao , Zhiyuan Xu , Zhengping Che , Chengxiang Yin , Chi Harold Liu , Feiferi Feng , Jian Tang

Traditional online continual learning (OCL) research has primarily focused on mitigating catastrophic forgetting with fixed and limited storage allocation throughout an agent's lifetime. However, a broad range of real-world applications are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Ameya Prabhu , Zhipeng Cai , Puneet Dokania , Philip Torr , Vladlen Koltun , Ozan Sener

Multi-agent systems (MASs) can autonomously learn to solve previously unknown tasks by means of each agent's individual intelligence as well as by collaborating and exploiting collective intelligence. This article considers a group of…

Systems and Control · Electrical Eng. & Systems 2021-11-29 Michael Meindl , Fabio Molinari , Dustin Lehmann , Thomas Seel

Continual learning (CL) -- the ability to continuously learn, building on previously acquired knowledge -- is a natural requirement for long-lived autonomous reinforcement learning (RL) agents. While building such agents, one needs to…

Machine Learning · Computer Science 2021-10-29 Maciej Wołczyk , Michał Zając , Razvan Pascanu , Łukasz Kuciński , Piotr Miłoś

Continual learning (or class incremental learning) is a realistic learning scenario for computer vision systems, where deep neural networks are trained on episodic data, and the data from previous episodes are generally inaccessible to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aditya R. Bhattacharya , Debanjan Goswami , Shayok Chakraborty

Continual learning (CL) studies the problem of learning a sequence of tasks, one at a time, such that the learning of each new task does not lead to the deterioration in performance on the previously seen ones while exploiting previously…

Machine Learning · Computer Science 2020-11-03 Ammar Shaker , Francesco Alesiani , Shujian Yu , Wenzhe Yin

Continual learning, also known as lifelong learning, is an emerging research topic that has been attracting increasing interest in the field of machine learning. With human activity recognition (HAR) playing a key role in enabling numerous…

Machine Learning · Computer Science 2022-11-18 Rebecca Adaimi , Edison Thomaz

Real-world digital environments are highly diverse and dynamic. These characteristics cause agents to frequently encounter unseen environments and distribution shifts, making continual learning in such environments essential for…

Computation and Language · Computer Science 2026-05-12 Tianci Xue , Zeyi Liao , Tianneng Shi , Zilu Wang , Kai Zhang , Dawn Song , Yu Su , Huan Sun

To cope with real-world dynamics, an intelligent system needs to incrementally acquire, update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as continual learning, provides a foundation for AI systems to…

Machine Learning · Computer Science 2024-02-07 Liyuan Wang , Xingxing Zhang , Hang Su , Jun Zhu

Existing literature in Continual Learning (CL) has focused on overcoming catastrophic forgetting, the inability of the learner to recall how to perform tasks observed in the past. There are however other desirable properties of a CL system,…

Machine Learning · Computer Science 2021-02-15 Tom Veniat , Ludovic Denoyer , Marc'Aurelio Ranzato

Language agents have become a promising solution to complex interactive tasks. One of the key ingredients to the success of language agents is the reward model on the trajectory of the agentic workflow, which provides valuable guidance…

Machine Learning · Computer Science 2025-02-05 Zongyu Lin , Yao Tang , Xingcheng Yao , Da Yin , Ziniu Hu , Yizhou Sun , Kai-Wei Chang

Continual learning (CL) aims to learn new tasks without erasing previous knowledge. However, current CL methods primarily emphasize improving accuracy while often neglecting training efficiency, which consequently restricts their practical…

Machine Learning · Computer Science 2026-01-30 RuiQi Liu , Boyu Diao , Libo Huang , Zijia An , Hangda Liu , Zhulin An , Yongjun Xu