中文
相关论文

相关论文: POPGym: Benchmarking Partially Observable Reinforc…

200 篇论文

Reinforcement Learning (RL), among other learning-based methods, represents powerful tools to solve complex robotic tasks (e.g., actuation, manipulation, navigation, etc.), with the need for real-world data to train these systems as one of…

机器人学 · 计算机科学 2020-07-28 Kenzo Lobos-Tsunekawa , Tatsuya Harada

Multi-agent reinforcement learning (MARL) has received increasing attention for its applications in various domains. Researchers have paid much attention on its partially observable and cooperative settings for meeting real-world…

多智能体系统 · 计算机科学 2021-12-08 Meng Yao , Qiyue Yin , Jun Yang , Tongtong Yu , Shengqi Shen , Junge Zhang , Bin Liang , Kaiqi Huang

Partially observable environments present a considerable computational challenge in reinforcement learning due to the need to consider long histories. Learning with a finite window of observations quickly becomes intractable as the window…

机器学习 · 计算机科学 2025-06-04 Onno Eberhard , Michael Muehlebach , Claire Vernade

Multimodal Large Language Models (MLLMs) may memorize sensitive cross-modal information during pretraining. However, existing MLLM unlearning benchmarks rely on synthetic knowledge injection or complete subject-level deletion, which fail to…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Jiahui Guang , Zexun Zhan , Zhenlin Xu , Cuiyun Gao , Haiyan Wang , Jing Li , Zhaoquan Gu , Yanchun Zhang

This paper studies the fundamental limits of reinforcement learning (RL) in the challenging \emph{partially observable} setting. While it is well-established that learning in Partially Observable Markov Decision Processes (POMDPs) requires…

机器学习 · 计算机科学 2023-02-03 Fan Chen , Huan Wang , Caiming Xiong , Song Mei , Yu Bai

Reinforcement Learning (RL) is one of the most dynamic research areas in Game AI and AI as a whole, and a wide variety of games are used as its prominent test problems. However, it is subject to the replicability crisis that currently…

机器学习 · 计算机科学 2022-03-03 Matthias Müller-Brockhausen , Aske Plaat , Mike Preuss

Partial observability presents a significant challenge for Safe Reinforcement Learning (Safe RL), as it impedes the identification of potential risks and rewards. Leveraging specific types of privileged information during training to…

机器学习 · 计算机科学 2025-09-24 Dongchi Huang , Jiaqi Wang , Yang Li , Chunhe Xia , Tianle Zhang , Kaige Zhang

In continual reinforcement learning (CRL), good performance requires never-ending learning, acting, and exploration in a big, partially observable world. Most CRL experiments have focused on loss of plasticity -- the inability to keep…

Reinforcement Learning faces an important challenge in partial observable environments that has long-term dependencies. In order to learn in an ambiguous environment, an agent has to keep previous perceptions in a memory. Earlier memory…

机器学习 · 计算机科学 2023-02-22 Alper Demir

Most existing safe reinforcement learning (RL) benchmarks focus on robotics and control tasks, offering limited relevance to high-stakes domains that involve structured constraints, mixed-integer decisions, and industrial complexity. This…

Recommender Systems are becoming ubiquitous in many settings and take many forms, from product recommendation in e-commerce stores, to query suggestions in search engines, to friend recommendation in social networks. Current research…

信息检索 · 计算机科学 2018-09-17 David Rohde , Stephen Bonner , Travis Dunlop , Flavian Vasile , Alexandros Karatzoglou

Penetration testing, the simulation of cyberattacks to identify security vulnerabilities, presents a sequential decision-making problem well-suited for reinforcement learning (RL) automation. Like many applications of RL to real-world…

机器学习 · 计算机科学 2025-09-25 Raphael Simon , Pieter Libin , Wim Mees

Deep reinforcement learning has demonstrated remarkable achievements across diverse domains such as video games, robotic control, autonomous driving, and drug discovery. Common methodologies in partially-observable domains largely lean on…

机器学习 · 计算机科学 2024-02-15 Michael Lanier , Ying Xu , Nathan Jacobs , Chongjie Zhang , Yevgeniy Vorobeychik

Memory Gym presents a suite of 2D partially observable environments, namely Mortar Mayhem, Mystery Path, and Searing Spotlights, designed to benchmark memory capabilities in decision-making agents. These environments, originally with finite…

机器学习 · 计算机科学 2025-01-22 Marco Pleines , Matthias Pallasch , Frank Zimmer , Mike Preuss

Partial observability of the underlying states generally presents significant challenges for reinforcement learning (RL). In practice, certain \emph{privileged information}, e.g., the access to states from simulators, has been exploited in…

机器学习 · 计算机科学 2025-02-24 Yang Cai , Xiangyu Liu , Argyris Oikonomou , Kaiqing Zhang

Due to the empirical success of reinforcement learning, an increasing number of students study the subject. However, from our practical teaching experience, we see students entering the field (bachelor, master and early PhD) often struggle.…

Modern Vision-Language Models (VLMs) remain poorly characterized in multi-step visual interactions, particularly in how they integrate perception, memory, and action over long horizons. We introduce VisGym, a gymnasium of 17 environments…

计算机视觉与模式识别 · 计算机科学 2026-01-26 Zirui Wang , Junyi Zhang , Jiaxin Ge , Long Lian , Letian Fu , Lisa Dunlap , Ken Goldberg , XuDong Wang , Ion Stoica , David M. Chan , Sewon Min , Joseph E. Gonzalez

Partially observable Markov decision processes (POMDPs) are a general framework for sequential decision-making under latent state uncertainty, yet learning in POMDPs is intractable in the worst case. Motivated by sensing and probing…

机器学习 · 计算机科学 2026-01-27 Ming Shi , Yingbin Liang , Ness B. Shroff

Exploration in reinforcement learning (RL) remains an open challenge. RL algorithms rely on observing rewards to train the agent, and if informative rewards are sparse the agent learns slowly or may not learn at all. To improve exploration…

机器学习 · 计算机科学 2024-11-12 Simone Parisi , Alireza Kazemipour , Michael Bowling

Memory is a critical component of robotic intelligence, as robots must rely on past observations and actions to accomplish long-horizon tasks in partially observable environments. However, existing robotic memory benchmarks still lack…