中文
相关论文

相关论文: Learning to Combat Compounding-Error in Model-Base…

200 篇论文

In imitation learning, an agent learns how to behave in an environment with an unknown cost function by mimicking expert demonstrations. Existing imitation learning algorithms typically involve solving a sequence of planning or…

机器学习 · 计算机科学 2016-06-17 Jonathan Ho , Jayesh K. Gupta , Stefano Ermon

We investigate model-based reinforcement learning in contextual Markov decision processes (C-MDPs) in which the context is unobserved and induces confounding in the offline dataset. In such settings, conventional model-learning methods are…

机器学习 · 计算机科学 2025-12-09 Nishanth Venkatesh , Andreas A. Malikopoulos

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

机器人学 · 计算机科学 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

World models learn the consequences of actions in vision-based interactive systems. However, in practical scenarios like autonomous driving, noncontrollable dynamics that are independent or sparsely dependent on action signals often exist,…

机器学习 · 计算机科学 2023-11-20 Minting Pan , Xiangming Zhu , Yitao Zheng , Yunbo Wang , Xiaokang Yang

Hierarchical Reinforcement Learning (HRL) approaches have shown successful results in solving a large variety of complex, structured, long-horizon problems. Nevertheless, a full theoretical understanding of this empirical evidence is…

机器学习 · 计算机科学 2025-02-05 Gianluca Drappo , Alberto Maria Metelli , Marcello Restelli

Machine Learning models in real-world applications must continuously learn new tasks to adapt to shifts in the data-generating distribution. Yet, for Continual Learning (CL), models often struggle to balance learning new tasks (plasticity)…

机器学习 · 计算机科学 2025-10-24 Luckeciano C. Melo , Alessandro Abate , Yarin Gal

Identifying uncertainty and taking mitigating actions is crucial for safe and trustworthy reinforcement learning agents, especially when deployed in high-risk environments. In this paper, risk sensitivity is promoted in a model-based…

机器学习 · 计算机科学 2021-11-10 Stefan Radic Webster , Peter Flach

Dyna-style model-based reinforcement learning contains two phases: model rollouts to generate sample for policy learning and real environment exploration using current policy for dynamics model learning. However, due to the complex…

机器学习 · 计算机科学 2024-01-02 Xiyao Wang , Ruijie Zheng , Yanchao Sun , Ruonan Jia , Wichayaporn Wongkamjan , Huazhe Xu , Furong Huang

Reinforcement learning is a powerful approach to learn behaviour through interactions with an environment. However, behaviours are usually learned in a purely reactive fashion, where an appropriate action is selected based on an…

机器学习 · 计算机科学 2021-06-10 André Biedenkapp , Raghu Rajan , Frank Hutter , Marius Lindauer

Thompson Sampling is one of the most effective methods for contextual bandits and has been generalized to posterior sampling for certain MDP settings. However, existing posterior sampling methods for reinforcement learning are limited by…

机器学习 · 计算机科学 2022-08-24 Christoph Dann , Mehryar Mohri , Tong Zhang , Julian Zimmert

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

系统与控制 · 电气工程与系统科学 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart

Inverse reinforcement learning (IRL) algorithms often rely on (forward) reinforcement learning or planning, over a given time horizon, to compute an approximately optimal policy for a hypothesized reward function; they then match this…

机器学习 · 计算机科学 2025-02-21 Yiqing Xu , Finale Doshi-Velez , David Hsu

The success of reinforcement learning (RL) crucially depends on effective function approximation when dealing with complex ground-truth models. Existing sample-efficient RL algorithms primarily employ three approaches to function…

机器学习 · 计算机科学 2024-01-09 Yunfan Li , Lin Yang

Applying reinforcement learning to robotic systems poses a number of challenging problems. A key requirement is the ability to handle continuous state and action spaces while remaining within a limited time and resource budget.…

机器学习 · 计算机科学 2020-06-29 Benjamin van Niekerk , Andreas Damianou , Benjamin Rosman

A self-learning optimal control algorithm for episodic fixed-horizon manufacturing processes with time-discrete control actions is proposed and evaluated on a simulated deep drawing process. The control model is built during consecutive…

系统与控制 · 计算机科学 2020-01-07 Johannes Dornheim , Norbert Link , Peter Gumbsch

A model among many may only be best under certain states of the world. Switching from a model to another can also be costly. Finding a procedure to dynamically choose a model in these circumstances requires to solve a complex estimation…

机器学习 · 计算机科学 2023-10-10 Francesco Cordoni , Alessio Sancetta

When training autoregressive models to forecast dynamical systems, a critical question arises: how far into the future should the model be trained to predict? Too short a horizon may miss long-term trends, while too long a horizon can…

机器学习 · 计算机科学 2025-06-23 Pau Vilimelis Aceituno , Jack William Miller , Noah Marti , Youssef Farag , Victor Boussange

This work investigates the formal policy synthesis of continuous-state stochastic dynamic systems given high-level specifications in linear temporal logic. To learn an optimal policy that maximizes the satisfaction probability, we take a…

人工智能 · 计算机科学 2023-04-21 Lening Li , Zhentian Qian

Temporal-Difference (TD) learning is a standard and very successful reinforcement learning approach, at the core of both algorithms that learn the value of a given policy, as well as algorithms which learn how to improve policies.…

机器学习 · 计算机科学 2020-06-17 Mingde Zhao

Model-based reinforcement learning (MBRL) aims to learn a dynamic model to reduce the number of interactions with real-world environments. However, due to estimation error, rollouts in the learned model, especially those of long horizons,…

机器学习 · 计算机科学 2020-03-17 Yueh-Hua Wu , Ting-Han Fan , Peter J. Ramadge , Hao Su