中文
相关论文

相关论文: Residual-MPPI: Online Policy Customization for Con…

200 篇论文

This paper investigates a hybrid learning framework for reinforcement learning (RL) in which the agent can leverage both an offline dataset and online interactions to learn the optimal policy. We present a unified algorithm and analysis and…

机器学习 · 计算机科学 2025-07-01 Ruiquan Huang , Donghao Li , Chengshuai Shi , Cong Shen , Jing Yang

Continual learning, the setting where a learning agent is faced with a never ending stream of data, continues to be a great challenge for modern machine learning systems. In particular the online or "single-pass through the data" setting…

机器学习 · 计算机科学 2019-10-31 Rahaf Aljundi , Lucas Caccia , Eugene Belilovsky , Massimo Caccia , Min Lin , Laurent Charlin , Tinne Tuytelaars

Model Predictive Control (MPC) is widely used in robot control by optimizing a sequence of control outputs over a finite-horizon. Computational approaches for MPC include deterministic methods (e.g., iLQR and COBYLA), as well as…

机器人学 · 计算机科学 2025-11-03 Zhaoxin Li , Xiaoke Wang , Letian Chen , Rohan Paleja , Subramanya Nageshrao , Matthew Gombolay

Most offline reinforcement learning (RL) algorithms return a target policy maximizing a trade-off between (1) the expected performance gain over the behavior policy that collected the dataset, and (2) the risk stemming from the…

机器学习 · 计算机科学 2023-06-23 Zhang-Wei Hong , Pulkit Agrawal , Rémi Tachet des Combes , Romain Laroche

Model predictive control (MPC) is a powerful, optimization-based approach for controlling dynamical systems. However, the computational complexity of online optimization can be problematic on embedded devices. Especially, when we need to…

Roll-to-roll (R2R) manufacturing is a continuous processing technology essential for scalable production of thin-film materials and printed electronics, but precise control remains challenging due to subsystem interactions, nonlinearities,…

系统与控制 · 电气工程与系统科学 2026-01-21 Christopher Martin , Apurva Patil , Wei Li , Takashi Tanaka , Dongmei Chen

Reinforcement learning (RL) post-training has become a trending paradigm for enhancing the capabilities of large language models (LLMs). Most existing RL systems for LLMs operate in a fully synchronous manner, where training must wait for…

机器学习 · 计算机科学 2025-11-11 Zekai Qu , Yinxu Pan , Ao Sun , Chaojun Xiao , Xu Han

Offline reinforcement-learning (RL) algorithms learn to make decisions using a given, fixed training dataset without online data collection. This problem setting is captivating because it holds the promise of utilizing previously collected…

机器学习 · 计算机科学 2022-12-07 Dan Elbaz , Gal Novik , Oren Salzman

We consider the problem of learning in adversarial Markov decision processes [MDPs] with an oblivious adversary in a full-information setting. The agent interacts with an environment during $T$ episodes, each of which consists of $H$…

机器学习 · 计算机科学 2025-03-06 Daniil Tiapkin , Evgenii Chzhen , Gilles Stoltz

Deep reinforcement learning (DRL) has been demonstrated to be effective for several complex decision-making applications such as autonomous driving and robotics. However, DRL is notoriously limited by its high sample complexity and its lack…

机器人学 · 计算机科学 2022-05-19 Raphael Chekroun , Marin Toromanoff , Sascha Hornauer , Fabien Moutarde

On-policy reinforcement learning methods, like Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), often demand extensive data per update, leading to sample inefficiency. This paper introduces Reflective Policy…

机器学习 · 计算机科学 2024-06-07 Yaozhong Gan , Renye Yan , Zhe Wu , Junliang Xing

Autonomous self-improving robots that interact and improve with experience are key to the real-world deployment of robotic systems. In this paper, we propose an online learning method, SELFI, that leverages online robot experience to…

机器人学 · 计算机科学 2024-10-08 Noriaki Hirose , Dhruv Shah , Kyle Stachowicz , Ajay Sridhar , Sergey Levine

Inverse reinforcement learning (IRL) aims to recover the reward function and the associated optimal policy that best fits observed sequences of states and actions implemented by an expert. Many algorithms for IRL have an inherently nested…

机器学习 · 计算机科学 2022-11-02 Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

The combination of policy search and deep neural networks holds the promise of automating a variety of decision-making tasks. Model Predictive Control (MPC) provides robust solutions to robot control tasks by making use of a dynamical model…

机器人学 · 计算机科学 2021-05-11 Yunlong Song , Davide Scaramuzza

Recent research on vulnerabilities of deep reinforcement learning (RL) has shown that adversarial policies adopted by an adversary agent can influence a target RL agent (victim agent) to perform poorly in a multi-agent environment. In…

机器学习 · 计算机科学 2022-11-01 The Viet Bui , Tien Mai , Thanh H. Nguyen

Offline reinforcement learning (RL) learns effective policies from pre-collected datasets, offering a practical solution for applications where online interactions are risky or costly. Model-based approaches are particularly advantageous…

机器学习 · 计算机科学 2026-05-14 Xuyang Chen , Keyu Yan , Guojian Wang , Lin Zhao

Both entropy-minimizing and entropy-maximizing (curiosity) objectives for unsupervised reinforcement learning (RL) have been shown to be effective in different environments, depending on the environment's level of natural entropy. However,…

机器学习 · 计算机科学 2024-08-19 Adriana Hugessen , Roger Creus Castanyer , Faisal Mohamed , Glen Berseth

We develop a new continual meta-learning method to address challenges in sequential multi-task learning. In this setting, the agent's goal is to achieve high reward over any sequence of tasks quickly. Prior meta-reinforcement learning…

机器学习 · 计算机科学 2021-12-09 Glen Berseth , Zhiwei Zhang , Grace Zhang , Chelsea Finn , Sergey Levine

Offline reinforcement learning, by learning from a fixed dataset, makes it possible to learn agent behaviors without interacting with the environment. However, depending on the quality of the offline dataset, such pre-trained agents may…

机器学习 · 计算机科学 2022-10-26 Yi Zhao , Rinu Boney , Alexander Ilin , Juho Kannala , Joni Pajarinen

Search missions require motion planning and navigation methods for information gathering that continuously replan based on new observations of the robot's surroundings. Current methods for information gathering, such as Monte Carlo Tree…

机器人学 · 计算机科学 2026-04-01 Max Lodel , Bruno Brito , Álvaro Serra-Gómez , Laura Ferranti , Robert Babuška , Javier Alonso-Mora