中文
相关论文

相关论文: Offline Action-Free Learning of Ex-BMDPs by Compar…

200 篇论文

Autonomous robots operating in complex, unstructured environments face significant challenges due to latent, unobserved factors that obscure their understanding of both their internal state and the external world. Addressing this challenge…

机器人学 · 计算机科学 2026-04-02 Alejandro Murillo-Gonzalez , Lantao Liu

Effective contact-rich manipulation requires robots to synergistically leverage vision, force, and proprioception. However, Reinforcement Learning agents struggle to learn in such multisensory settings, especially amidst sensory noise and…

机器人学 · 计算机科学 2026-04-27 Rickmer Krohn , Vignesh Prasad , Gabriele Tiboni , Georgia Chalvatzaki

Offline reinforcement learning (RL) algorithms can acquire effective policies by utilizing previously collected experience, without any online interaction. It is widely understood that offline RL is able to extract good policies even from…

机器学习 · 计算机科学 2022-04-13 Aviral Kumar , Joey Hong , Anikait Singh , Sergey Levine

A fundamental assumption of reinforcement learning in Markov decision processes (MDPs) is that the relevant decision process is, in fact, Markov. However, when MDPs have rich observations, agents typically learn by way of an abstract state…

机器学习 · 计算机科学 2024-03-18 Cameron Allen , Neev Parikh , Omer Gottesman , George Konidaris

In the reinforcement learning literature, there are many algorithms developed for either Contextual Bandit (CB) or Markov Decision Processes (MDP) environments. However, when deploying reinforcement learning algorithms in the real world,…

机器学习 · 计算机科学 2022-08-02 Kelly W. Zhang , Omer Gottesman , Finale Doshi-Velez

We present BRIEE (Block-structured Representation learning with Interleaved Explore Exploit), an algorithm for efficient reinforcement learning in Markov Decision Processes with block-structured dynamics (i.e., Block MDPs), where rich…

机器学习 · 计算机科学 2022-10-12 Xuezhou Zhang , Yuda Song , Masatoshi Uehara , Mengdi Wang , Alekh Agarwal , Wen Sun

Our research investigates the challenges Deep Reinforcement Learning (DRL) faces in complex, Partially Observable Markov Decision Processes (POMDP) such as autonomous driving (AD), and proposes a solution for vision-based navigation in…

计算机视觉与模式识别 · 计算机科学 2024-09-18 Shawan Mohammed , Alp Argun , Nicolas Bonnotte , Gerd Ascheid

Motivated by the goal of endowing robots with a means for focusing attention in order to operate reliably in complex, uncertain, and time-varying environments, we consider how a robot can (i) determine which portions of its environment to…

机器人学 · 计算机科学 2022-11-14 Meghan Booker , Anirudha Majumdar

Many control tasks exhibit similar dynamics that can be modeled as having common latent structure. Hidden-Parameter Markov Decision Processes (HiP-MDPs) explicitly model this structure to improve sample efficiency in multi-task settings.…

机器学习 · 计算机科学 2021-02-15 Amy Zhang , Shagun Sodhani , Khimya Khetarpal , Joelle Pineau

Real-world autonomous systems operate under uncertainty about both their pose and dynamics. Autonomous control systems must simultaneously perform estimation and control tasks to maintain robustness to changing dynamics or modeling errors.…

系统与控制 · 计算机科学 2018-08-03 Patrick Slade , Zachary N. Sunberg , Mykel J. Kochenderfer

We consider an agent interacting with an environment in a single stream of actions, observations, and rewards, with no reset. This process is not assumed to be a Markov Decision Process (MDP). Rather, the agent has several representations…

机器学习 · 计算机科学 2013-03-19 Odalric-Ambrym Maillard , Phuong Nguyen , Ronald Ortner , Daniil Ryabko

In partially observable reinforcement learning, offline training gives access to latent information which is not available during online training and/or execution, such as the system state. Asymmetric actor-critic methods exploit such…

机器学习 · 计算机科学 2022-08-08 Andrea Baisero , Christopher Amato

Robust Markov decision processes (r-MDPs) extend MDPs by explicitly modelling epistemic uncertainty about transition dynamics. Learning r-MDPs from interactions with an unknown environment enables the synthesis of robust policies with…

机器学习 · 计算机科学 2025-11-21 Yannik Schnitzer , Alessandro Abate , David Parker

Presence of bias (in datasets or tasks) is inarguably one of the most critical challenges in machine learning applications that has alluded to pivotal debates in recent years. Such challenges range from spurious associations between…

计算机视觉与模式识别 · 计算机科学 2020-11-23 Ehsan Adeli , Qingyu Zhao , Adolf Pfefferbaum , Edith V. Sullivan , Li Fei-Fei , Juan Carlos Niebles , Kilian M. Pohl

The goal of offline reinforcement learning is to learn a policy from a fixed dataset, without further interactions with the environment. This setting will be an increasingly more important paradigm for real-world applications of…

机器人学 · 计算机科学 2020-11-17 Wenxuan Zhou , Sujay Bajracharya , David Held

Real-world reinforcement learning (RL) environments, whether in robotics or industrial settings, often involve non-visual observations and require not only efficient but also reliable and thus interpretable and flexible RL approaches. To…

机器学习 · 计算机科学 2024-02-19 Moritz Lange , Noah Krystiniak , Raphael C. Engelhardt , Wolfgang Konen , Laurenz Wiskott

Offline meta reinforcement learning (OMRL) has emerged as a promising approach for interaction avoidance and strong generalization performance by leveraging pre-collected data and meta-learning techniques. Previous context-based approaches…

机器学习 · 计算机科学 2025-02-04 Hai Zhang , Boyuan Zheng , Tianying Ji , Jinhang Liu , Anqi Guo , Junqiao Zhao , Lanqing Li

We develop model free PAC performance guarantees for multiple concurrent MDPs, extending recent works where a single learner interacts with multiple non-interacting agents in a noise free environment. Our framework allows noisy and resource…

机器学习 · 计算机科学 2019-10-11 Or Raveh , Ron Meir

Model-based Reinforcement Learning and Control have demonstrated great potential in various sequential decision making problem domains, including in robotics settings. However, real-world robotics systems often present challenges that limit…

机器学习 · 计算机科学 2023-10-24 Achkan Salehi , Steffen Rühl , Stephane Doncieux

In reinforcement learning (RL) for robotic manipulation, the Decision Transformer (DT) has emerged as an effective framework for addressing long-horizon tasks. However, DT's performance depends heavily on the coverage of collected…

机器人学 · 计算机科学 2026-05-04 Kaiyan Zhao , Borong Zhang , Yiming Wang , Xingyu Liu , Xuetao Li , Yuyang Chen , Xiaoguang Niu