English
Related papers

Related papers: Beyond Single-Model Optimization: Preserving Plast…

200 papers

Despite ample motivation from costly exploration and limited trajectory data, rapidly adapting to new environments with few-shot reinforcement learning (RL) can remain a challenging task, especially with respect to personalized settings.…

Machine Learning · Computer Science 2020-10-13 Michael Zhang

The difficulty of identifying the physical model of complex systems has led to exploring methods that do not rely on such complex modeling of the systems. Deep reinforcement learning has been the pioneer for solving this problem without the…

Artificial Intelligence · Computer Science 2023-10-31 Ammar N. Abbas , Georgios C. Chasparis , John D. Kelleher

Unconstrained fine-tuning of flow-matching Vision-Language-Action (VLA) models drives dense parameter overwrites, degrading pre-trained capabilities. We present Conservative Supervised Fine-Tuning (ConSFT), an optimization objective that…

Robotics · Computer Science 2026-05-20 Tianyi Zhang , Shaopeng Zhai , Haoran Zhang , Fuxian Huang , Qi Zhang

Continual offline reinforcement learning (CORL) aims to learn a sequence of tasks from datasets collected over time while preserving performance on previously learned tasks. This setting corresponds to domains where new tasks arise over…

Machine Learning · Computer Science 2026-04-29 Dominik Żurek , Kamil Faber , Marcin Pietron , Paweł Gajewski , Roberto Corizzo

Continuous-time reinforcement learning (CTRL) provides a natural framework for sequential decision-making in dynamic environments where interactions evolve continuously over time. While CTRL has shown growing empirical success, its ability…

Machine Learning · Computer Science 2025-12-04 Runze Zhao , Yue Yu , Ruhan Wang , Chunfeng Huang , Dongruo Zhou

Meta-reinforcement learning (Meta-RL) has attracted attention due to its capability to enhance reinforcement learning (RL) algorithms, in terms of data efficiency and generalizability. In this paper, we develop a bilevel optimization…

Machine Learning · Computer Science 2024-10-15 Siyuan Xu , Minghui Zhu

Reinforcement learning (RL) has been successfully applied to solve the problem of finding obstacle-free paths for autonomous agents operating in stochastic and uncertain environments. However, when the underlying stochastic dynamics of the…

Machine Learning · Computer Science 2024-10-29 Sheryl Paul , Jyotirmoy V. Deshmukh

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. In this work, we focus on continual text classification under the class-incremental setting. Recent CL studies…

Computation and Language · Computer Science 2023-05-15 Yifan Song , Peiyi Wang , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

Deep Reinforcement Learning (Deep RL) has had incredible achievements on high dimensional problems, yet its learning process remains unstable even on the simplest tasks. Deep RL uses neural networks as function approximators. These neural…

Machine Learning · Computer Science 2022-10-18 Riccardo Della Vecchia , Alena Shilova , Philippe Preux , Riad Akrour

This paper introduces a deep reinforcement learning (RL) framework for optimizing the operations of power plants pairing renewable energy with storage. The objective is to maximize revenue from energy markets while minimizing storage…

Machine Learning · Computer Science 2023-06-16 Lucien Werner , Peeyush Kumar

When Reinforcement Learning (RL) agents are deployed in practice, they might impact their environment and change its dynamics. We propose a new framework to model this phenomenon, where the current environment depends on the deployed policy…

Machine Learning · Computer Science 2024-06-03 Ben Rank , Stelios Triantafyllou , Debmalya Mandal , Goran Radanovic

Reinforcement learning (RL) is a promising avenue for post-training vision-language-action (VLA) models, but practical deployment is hindered by sparse rewards and unstable training. This work mitigates these challenges by introducing an…

Vision-Language-Action (VLA) models show strong potential for general-purpose robotic manipulation, yet their closed-loop reliability often degrades under local deployment conditions. Existing evaluations typically treat test episodes as…

Robotics · Computer Science 2026-05-13 Jianchao Zhao , Huoren Yang , Yusong Hu , Yuyang Gao , Qiguan Ou , Cong Wan , SongLin Dong , Zhiheng Ma , Yihong Gong

The aim of multi-task reinforcement learning is two-fold: (1) efficiently learn by training against multiple tasks and (2) quickly adapt, using limited samples, to a variety of new tasks. In this work, the tasks correspond to reward…

Machine Learning · Computer Science 2019-11-05 Nicholas C. Landolfi , Garrett Thomas , Tengyu Ma

Continual Learning requires the model to learn from a stream of dynamic, non-stationary data without forgetting previous knowledge. Several approaches have been developed in the literature to tackle the Continual Learning challenge. Among…

Machine Learning · Computer Science 2022-11-30 Gabriele Merlin , Vincenzo Lomonaco , Andrea Cossu , Antonio Carta , Davide Bacciu

Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In particular the online or "single-pass through the data" setting…

Machine Learning · Computer Science 2019-10-31 Rahaf Aljundi , Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Min Lin , Laurent Charlin , Tinne Tuytelaars

Recent advances in LLM agents enable systems that autonomously refine workflows, accumulate reusable skills, self-train their underlying models, and maintain persistent memory. However, we show that such self-evolution is often…

Artificial Intelligence · Computer Science 2026-05-12 Ye Yu , Xiaopeng Yuan , Haibo Jin , Heming Liu , Yaoning Yu , Haohan Wang

Problem definition: Supply chains are constantly evolving networks. Reinforcement learning is increasingly proposed as a solution to provide optimal control of these networks. Academic/practical: However, learning in continuously varying…

Systems and Control · Electrical Eng. & Systems 2023-12-27 Wan Wang , Haiyan Wang , Adam J. Sobey

In the pursuit of finding an optimal policy, reinforcement learning (RL) methods generally ignore the properties of learned policies apart from their expected return. Thus, even when successful, it is difficult to characterize which…

Machine Learning · Computer Science 2025-10-10 Yash Jhaveri , Harley Wiltzer , Patrick Shafto , Marc G. Bellemare , David Meger

Continual Learning (CL) is a powerful tool that enables agents to learn a sequence of tasks, accumulating knowledge learned in the past and using it for problem-solving or future task learning. However, existing CL methods often assume that…

Machine Learning · Computer Science 2025-06-09 Chaofan Pan , Jiafen Liu , Yanhua Li , Linbo Xiong , Fan Min , Wei Wei , Xin Yang