中文
相关论文

相关论文: POPGym: Benchmarking Partially Observable Reinforc…

200 篇论文

Reinforcement Learning (RL) trains agents to learn optimal behavior by maximizing reward signals from experience datasets. However, RL training often faces memory limitations, leading to execution latencies and prolonged training times. To…

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

机器学习 · 计算机科学 2024-09-23 Narendra Patwardhan , Zequn Wang

Reinforcement learning (RL) has garnered significant attention for developing decision-making agents that aim to maximize rewards, specified by an external supervisor, within fully observable environments. However, many real-world problems…

机器学习 · 计算机科学 2024-06-03 Parvin Malekzadeh , Konstantinos N. Plataniotis

Partially Observable Markov Decision Processes (POMDPs) model decision making under uncertainty. While there are many approaches to approximately solving POMDPs, we aim to address the problem of learning such models. In particular, we are…

We study reinforcement learning for partially observed Markov decision processes (POMDPs) with infinite observation and state spaces, which remains less investigated theoretically. To this end, we make the first attempt at bridging partial…

机器学习 · 计算机科学 2024-04-02 Qi Cai , Zhuoran Yang , Zhaoran Wang

In applications of offline reinforcement learning to observational data, such as in healthcare or education, a general concern is that observed actions might be affected by unobserved factors, inducing confounding and biasing estimates…

机器学习 · 计算机科学 2023-03-24 Andrew Bennett , Nathan Kallus

We study reinforcement learning with linear function approximation and finite-memory approximations for partially observed Markov decision processes (POMDPs). We first present an algorithm for the value evaluation of finite-memory feedback…

最优化与控制 · 数学 2025-05-22 Ali Devran Kara

Task offloading, crucial for balancing computational loads across devices in networks such as the Internet of Things, poses significant optimization challenges, including minimizing latency and energy usage under strict communication and…

机器学习 · 计算机科学 2024-10-10 Frederico Metelo , Stevo Racković , Pedro Ákos Costa , Cláudia Soares

As interest grows in world models that predict future states from current observations and actions, accurately modeling part-level dynamics has become increasingly relevant for various applications. Existing approaches, such as…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Mingju Gao , Yike Pan , Huan-ang Gao , Zongzheng Zhang , Wenyi Li , Hao Dong , Hao Tang , Li Yi , Hao Zhao

Over the last decade, data-driven methods have surged in popularity, emerging as valuable tools for control theory. As such, neural network approximations of control feedback laws, system dynamics, and even Lyapunov functions have attracted…

系统与控制 · 电气工程与系统科学 2024-05-27 Luke Bhan , Yuexin Bian , Miroslav Krstic , Yuanyuan Shi

Real-world decision-making tasks are usually partially observable Markov decision processes (POMDPs), where the state is not fully observable. Recent progress has demonstrated that recurrent reinforcement learning (RL), which consists of a…

机器学习 · 计算机科学 2024-05-27 Fan-Ming Luo , Zuolin Tu , Zefang Huang , Yang Yu

Developing lifelong learning agents is crucial for artificial general intelligence (AGI). However, deep reinforcement learning (RL) systems often suffer from plasticity loss, where neural networks gradually lose their ability to adapt…

机器学习 · 计算机科学 2026-02-11 Mingqi Yuan , Qi Wang , Guozheng Ma , Caihao Sun , Bo Li , Xin Jin , Yunbo Wang , Xiaokang Yang , Wenjun Zeng , Dacheng Tao , Jiayu Chen

This paper proposes an observer-based framework for solving Partially Observable Markov Decision Processes (POMDPs) when an accurate model is not available. We first propose to use a Moving Horizon Estimation-Model Predictive Control…

系统与控制 · 电气工程与系统科学 2021-03-23 Hossein Nejatbakhsh Esfahani , Arash Bahari Kordabad , Sebastien Gros

The primary obstacle for applying reinforcement learning (RL) to real-world robotics is the design of effective reward functions. While recently learning-based Process Reward Models (PRMs) are a promising direction, they are often hindered…

Nowadays, realistic simulation environments are essential to validate and build reliable robotic solutions. This is particularly true when using Reinforcement Learning (RL) based control policies. To this end, both robotics and RL…

机器人学 · 计算机科学 2023-10-12 Matteo El-Hariry , Antoine Richard , Miguel Olivares-Mendez

Simulated virtual environments serve as one of the main driving forces behind developing and evaluating skill learning algorithms. However, existing environments typically only simulate rigid body physics. Additionally, the simulation…

机器学习 · 计算机科学 2021-04-08 Zhiao Huang , Yuanming Hu , Tao Du , Siyuan Zhou , Hao Su , Joshua B. Tenenbaum , Chuang Gan

Despite the significant progress made by existing retrieval augmented language models (RALMs) in providing trustworthy responses and grounding in reliable sources, they often overlook effective alignment with human preferences. In the…

计算与语言 · 计算机科学 2024-12-19 Zhuoran Jin , Hongbang Yuan , Tianyi Men , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Incremental Learning (IL) has been a long-standing problem in both vision and Natural Language Processing (NLP) communities. In recent years, as Pre-trained Language Models (PLMs) have achieved remarkable progress in various NLP downstream…

计算与语言 · 计算机科学 2024-08-09 Junhao Zheng , Shengjie Qiu , Qianli Ma

Photonic computing chips have made significant progress in accelerating linear computations, but nonlinear computations are usually implemented in the digital domain, which introduces additional system latency and power consumption, and…

Despite the low dimensionalities of dissipative viscous fluids, reinforcement learning (RL) requires many observables in fluid control problems. This is because the observables are assumed to follow a policy-independent Markov decision…

流体动力学 · 物理学 2021-04-30 Akira Kubo , Masaki Shimizu