English
Related papers

Related papers: Trust the Model When It Is Confident: Masked Model…

200 papers

Reinforcement learning (RL) algorithms for real-world robotic applications need a data-efficient learning process and the ability to handle complex, unknown dynamical systems. These requirements are handled well by model-based and…

Robotics · Computer Science 2017-06-20 Yevgen Chebotar , Karol Hausman , Marvin Zhang , Gaurav Sukhatme , Stefan Schaal , Sergey Levine

Reinforcement learning (RL) is a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, and deep neural networks further enhance its learning power. However, centralized RL is infeasible…

Machine Learning · Computer Science 2019-03-13 Tianshu Chu , Jie Wang , Lara Codecà , Zhaojian Li

Simulation-to-decision learning enables safe policy training in digital environments without risking real-world deployment, and has become essential in mission-critical domains such as supply chains and industrial systems. However,…

Machine Learning · Computer Science 2026-03-11 Hongyu Cao , Jinghan Zhang , Kunpeng Liu , Dongjie Wang , Feng Xia , Haifeng Chen , Xiaohua Hu , Yanjie Fu

Model-Free Reinforcement Learning has achieved meaningful results in stable environments but, to this day, it remains problematic in regime changing environments like financial markets. In contrast, model-based RL is able to capture some…

Machine Learning · Computer Science 2021-04-23 Eric Benhamou , David Saltiel , Serge Tabachnik , Sui Kai Wong , François Chareyron

In this paper we study a model-based approach to calculating approximately optimal policies in Markovian Decision Processes. In particular, we derive novel bounds on the loss of using a policy derived from a factored linear model, a class…

Machine Learning · Statistics 2016-09-22 Bernardo Ávila Pires , Csaba Szepesvári

Soft Actor-Critic (SAC) is an off-policy actor-critic reinforcement learning algorithm, essentially based on entropy regularization. SAC trains a policy by maximizing the trade-off between expected return and entropy (randomness in the…

Machine Learning · Computer Science 2021-09-27 Chayan Banerjee , Zhiyong Chen , Nasimul Noman

We apply recent advances in deep generative modeling to the task of imitation learning from biological agents. Specifically, we apply variations of the variational recurrent neural network model to a multi-agent setting where we learn…

Machine Learning · Computer Science 2020-07-02 Michael Teng , Tuan Anh Le , Adam Scibior , Frank Wood

Communication is essential in coordinating the behaviors of multiple agents. However, existing methods primarily emphasize content, timing, and partners for information sharing, often neglecting the critical aspect of integrating shared…

Multiagent Systems · Computer Science 2025-01-03 Chuxiong Sun , Peng He , Qirui Ji , Zehua Zang , Jiangmeng Li , Rui Wang , Wei Wang

In safety-critical robotic tasks, potential failures must be reduced, and multiple constraints must be met, such as avoiding collisions, limiting energy consumption, and maintaining balance. Thus, applying safe reinforcement learning (RL)…

Machine Learning · Computer Science 2023-12-27 Dohyeong Kim , Kyungjae Lee , Songhwai Oh

Model mismatch and process noise are two frequently occurring phenomena that can drastically affect the performance of model predictive control (MPC) in practical applications. We propose a principled way to tune the cost function and the…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Riccardo Zuliani , Efe C. Balta , John Lygeros

A robust adaptive model predictive control (MPC) algorithm is presented for linear, time invariant systems with unknown dynamics and subject to bounded measurement noise. The system is characterized by an impulse response model, which is…

Systems and Control · Electrical Eng. & Systems 2019-11-21 Anilkumar Parsi , Andrea Iannelli , Mingzhou Yin , Mohammad Khosravi , Roy S. Smith

In modern ML Ops environments, model deployment is a critical process that traditionally relies on static heuristics such as validation error comparisons and A/B testing. However, these methods require human intervention to adapt to…

Machine Learning · Computer Science 2025-03-31 S. Aaron McClendon , Vishaal Venkatesh , Juan Morinelli

Model-based Reinforcement Learning (RL) is a popular learning paradigm due to its potential sample efficiency compared to model-free RL. However, existing empirical model-based RL approaches lack the ability to explore. This work studies a…

Machine Learning · Computer Science 2021-07-16 Yuda Song , Wen Sun

Solving chance-constrained optimal control problems for systems subject to non-stationary uncertainties is a significant challenge.Conventional robust model predictive control (MPC) often yields excessive conservatism by relying on static…

Systems and Control · Electrical Eng. & Systems 2025-07-16 Mingcong Li

Model-based reinforcement learning (RL) has demonstrated remarkable successes on a range of continuous control tasks due to its high sample efficiency. To save the computation cost of conducting planning online, recent practices tend to…

Artificial Intelligence · Computer Science 2023-07-25 Chuming Li , Ruonan Jia , Jie Liu , Yinmin Zhang , Yazhe Niu , Yaodong Yang , Yu Liu , Wanli Ouyang

An often neglected issue in multi-agent reinforcement learning (MARL) is the potential presence of unreliable agents in the environment whose deviations from expected behavior can prevent a system from accomplishing its intended tasks. In…

Multiagent Systems · Computer Science 2024-05-31 Ho Long Fung , Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

We propose a new algorithm, Mean Actor-Critic (MAC), for discrete-action continuous-state reinforcement learning. MAC is a policy gradient algorithm that uses the agent's explicit representation of all action values to estimate the gradient…

Partially-observable problems pose a trade-off between reducing costs and gathering information. They can be solved optimally by planning in belief space, but that is often prohibitively expensive. Model-predictive control (MPC) takes the…

Machine Learning · Computer Science 2023-04-21 Baris Kayalibay , Atanas Mirchev , Ahmed Agha , Patrick van der Smagt , Justin Bayer

Multi-agent adversarial inverse reinforcement learning (MA-AIRL) is a recent approach that applies single-agent AIRL to multi-agent problems where we seek to recover both policies for our agents and reward functions that promote expert-like…

Multiagent Systems · Computer Science 2020-02-26 Wonseok Jeon , Paul Barde , Derek Nowrouzezahrai , Joelle Pineau

In current model-free reinforcement learning (RL) algorithms, stability criteria based on sampling methods are commonly utilized to guide policy optimization. However, these criteria only guarantee the infinite-time convergence of the…

Robotics · Computer Science 2023-10-16 Shengjie Wang , Fengbo Lan , Xiang Zheng , Yuxue Cao , Oluwatosin Oseni , Haotian Xu , Tao Zhang , Yang Gao