中文
相关论文

相关论文: POPGym: Benchmarking Partially Observable Reinforc…

200 篇论文

How should we analyze memory in deep RL? We introduce tools for analyzing policies under partial observability and revealing how agents use memory to make decisions. To utilize these tools, we present POPGym Arcade, a collection of…

机器学习 · 计算机科学 2026-05-28 Zekang Wang , Zhe He , Borong Zhang , Edan Toledo , Steven Morad

Mitigating partial observability is a necessary but challenging task for general reinforcement learning algorithms. To improve an algorithm's ability to mitigate partial observability, researchers need comprehensive benchmarks to gauge…

机器学习 · 计算机科学 2025-08-04 Ruo Yu Tao , Kaicheng Guo , Cameron Allen , George Konidaris

Due to recent breakthroughs, reinforcement learning (RL) has demonstrated impressive performance in challenging sequential decision-making problems. However, an open question is how to make RL cope with partial observability which is…

机器学习 · 计算机科学 2021-04-23 Stephan Weigand , Pascal Klink , Jan Peters , Joni Pajarinen

In practical applications, we can rarely assume full observability of a system's environment, despite such knowledge being important for determining a reactive control system's precise interaction with its environment. Therefore, we propose…

机器学习 · 计算机科学 2022-06-24 Edi Muskardin , Martin Tappler , Bernhard K. Aichernig , Ingo Pill

Recent advances in reinforcement learning (RL) have increased the promise of introducing cognitive assistance and automation to robot-assisted laparoscopic surgery (RALS). However, progress in algorithms and methods depends on the…

While Vision-Language Models (VLMs) have achieved remarkable progress in static visual understanding, their deployment in complex 3D embodied environments remains severely limited. Existing benchmarks suffer from four critical deficiencies:…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Ruizhi Zhang , Ye Huang , Yuangang Pan , Chuanfu Shen , Zhilin Liu , Ting Xie , Wen Li , Lixin Duan

We introduce controlgym, a library of thirty-six industrial control settings, and ten infinite-dimensional partial differential equation (PDE)-based control problems. Integrated within the OpenAI Gym/Gymnasium (Gym) framework, controlgym…

系统与控制 · 电气工程与系统科学 2024-04-25 Xiangyuan Zhang , Weichao Mao , Saviz Mowlavi , Mouhacine Benosman , Tamer Başar

Recent benchmarks for memory-augmented reinforcement learning (RL) have introduced partially observable Markov decision process (POMDP) environments in which agents must use historical observations to make decisions. However, these…

人工智能 · 计算机科学 2026-04-15 Yongyi Wang , Lingfeng Li , Bozhou Chen , Ang Li , Hanyu Liu , Qirui Zheng , Xionghui Yang , Wenxin Li

Effective visual representation learning is crucial for reinforcement learning (RL) agents to extract task-relevant information from raw sensory inputs and generalize across diverse environments. However, existing RL benchmarks lack the…

Real-world sequential decision making problems commonly involve partial observability, which requires the agent to maintain a memory of history in order to infer the latent states, plan and make good decisions. Coping with partial…

机器学习 · 计算机科学 2022-02-09 Yonathan Efroni , Chi Jin , Akshay Krishnamurthy , Sobhan Miryoosefi

Manipulating deformable objects has long been a challenge in robotics due to its high dimensional state representation and complex dynamics. Recent success in deep reinforcement learning provides a promising direction for learning to…

机器人学 · 计算机科学 2021-03-09 Xingyu Lin , Yufei Wang , Jake Olkin , David Held

We study Reinforcement Learning for partially observable dynamical systems using function approximation. We propose a new \textit{Partially Observable Bilinear Actor-Critic framework}, that is general enough to include models such as…

机器学习 · 计算机科学 2022-06-27 Masatoshi Uehara , Ayush Sekhari , Jason D. Lee , Nathan Kallus , Wen Sun

In recent years, \emph{Reinforcement Learning} (RL) has made remarkable progress, achieving superhuman performance in a wide range of simulated environments. As research moves toward deploying RL in real-world applications, the field faces…

In partially observable (PO) environments, deep reinforcement learning (RL) agents often suffer from unsatisfactory performance, since two problems need to be tackled together: how to extract information from the raw observations to solve…

机器学习 · 计算机科学 2019-12-25 Dongqi Han , Kenji Doya , Jun Tani

Applications of Reinforcement Learning (RL), in which agents learn to make a sequence of decisions despite lacking complete information about the latent states of the controlled system, that is, they act under partial observability of the…

机器学习 · 计算机科学 2022-05-26 Qinghua Liu , Alan Chung , Csaba Szepesvári , Chi Jin

We introduce a biologically plausible RL framework for solving tasks in partially observable Markov decision processes (POMDPs). The proposed algorithm combines three integral parts: (1) A Meta-RL architecture, resembling the mammalian…

机器学习 · 计算机科学 2025-04-17 Julian Lemmel , Radu Grosu

In most real-world reinforcement learning applications, state information is only partially observable, which breaks the Markov decision process assumption and leads to inferior performance for algorithms that conflate observations with…

机器学习 · 计算机科学 2024-06-12 Hongming Zhang , Tongzheng Ren , Chenjun Xiao , Dale Schuurmans , Bo Dai

This work pioneers regret analysis of risk-sensitive reinforcement learning in partially observable environments with hindsight observation, addressing a gap in theoretical exploration. We introduce a novel formulation that integrates…

机器学习 · 计算机科学 2024-02-29 Tonghe Zhang , Yu Chen , Longbo Huang

We study provable multi-agent reinforcement learning (RL) in the general framework of partially observable stochastic games (POSGs). To circumvent the known hardness results and the use of computationally intractable oracles, we advocate…

机器学习 · 计算机科学 2026-03-16 Xiangyu Liu , Kaiqing Zhang

Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment -- where the optimal behaviour is defined…

‹ 上一页 1 2 3 10 下一页 ›