English
Related papers

Related papers: Adaptive Reinforcement Learning for Unobservable R…

200 papers

Efforts in this paper seek to combine graph theory with adaptive dynamic programming (ADP) as a reinforcement learning (RL) framework to determine forward-in-time, real-time, approximate optimal controllers for distributed multi-agent…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Huyen Dinh , Patrick Walters , Warren Dixon

This paper proposes a multi-agent reinforcement learning based medium access framework for wireless networks. The access problem is formulated as a Markov Decision Process (MDP), and solved using reinforcement learning with every network…

Machine Learning · Computer Science 2021-04-30 Hrishikesh Dutta , Subir Biswas

A Markov Decision Process (MDP) is a popular model for reinforcement learning. However, its commonly used assumption of stationary dynamics and rewards is too stringent and fails to hold in adversarial, nonstationary, or multi-agent…

Machine Learning · Computer Science 2019-08-22 Tiancheng Yu , Suvrit Sra

An in-depth understanding of the particular environment is crucial in reinforcement learning (RL). To address this challenge, the decision-making process of a mobile collaborative robotic assistant modeled by the Markov decision process…

Machine Learning · Computer Science 2021-06-29 Mónika Farsang , Luca Szegletes

The standard Markov Decision Process (MDP) formulation hinges on the assumption that an action is executed immediately after it was chosen. However, assuming it is often unrealistic and can lead to catastrophic failures in applications such…

Machine Learning · Computer Science 2023-12-14 Esther Derman , Gal Dalal , Shie Mannor

Dynamic mechanism design studies how mechanism designers should allocate resources among agents in a time-varying environment. We consider the problem where the agents interact with the mechanism designer according to an unknown Markov…

Machine Learning · Computer Science 2024-12-19 Shuang Qiu , Boxiang Lyu , Qinglin Meng , Zhaoran Wang , Zhuoran Yang , Michael I. Jordan

In real-world multi-agent systems (MASs), observation delays are ubiquitous, preventing agents from making decisions based on the environment's true state. An individual agent's local observation typically comprises multiple components from…

Multiagent Systems · Computer Science 2025-11-13 Songchen Fu , Siang Chen , Shaojing Zhao , Letian Bai , Ta Li , Yonghong Yan

We investigate model-based reinforcement learning in contextual Markov decision processes (C-MDPs) in which the context is unobserved and induces confounding in the offline dataset. In such settings, conventional model-learning methods are…

Machine Learning · Computer Science 2025-12-09 Nishanth Venkatesh , Andreas A. Malikopoulos

In standard reinforcement learning settings, agents typically assume immediate feedback about the effects of their actions after taking them. However, in practice, this assumption may not hold true due to physical constraints and can…

Machine Learning · Computer Science 2024-06-27 Armin Karamzade , Kyungmin Kim , Montek Kalsi , Roy Fox

Due to limited resources and public safety concerns, deep reinforcement learning (RL) agents for many cyber-physical systems (e.g., autonomous vehicles) are first trained in simulators. However, when deployed in real world environments,…

Machine Learning · Computer Science 2026-05-28 Gengyue Han , Yiheng Feng

Inverse Reinforcement Learning (IRL) describes the problem of learning an unknown reward function of a Markov Decision Process (MDP) from observed behavior of an agent. Since the agent's behavior originates in its policy and MDP policies…

Artificial Intelligence · Computer Science 2016-04-14 Michael Herman , Tobias Gindele , Jörg Wagner , Felix Schmitt , Wolfram Burgard

A common setting of reinforcement learning (RL) is a Markov decision process (MDP) in which the environment is a stochastic discrete-time dynamical system. Whereas MDPs are suitable in such applications as video-games or puzzles, physical…

Robotics · Computer Science 2022-11-29 Pavel Osinenko , Dmitrii Dobriborsci , Grigory Yaremenko , Georgiy Malaniya

Modeling of real-world biological multi-agents is a fundamental problem in various scientific and engineering fields. Reinforcement learning (RL) is a powerful framework to generate flexible and diverse behaviors in cyberspace; however,…

Artificial Intelligence · Computer Science 2023-12-20 Keisuke Fujii , Kazushi Tsutsui , Atom Scott , Hiroshi Nakahara , Naoya Takeishi , Yoshinobu Kawahara

A fundamental (and largely open) challenge in sequential decision-making is dealing with non-stationary environments, where exogenous environmental conditions change over time. Such problems are traditionally modeled as non-stationary…

Artificial Intelligence · Computer Science 2024-01-23 Baiting Luo , Yunuo Zhang , Abhishek Dubey , Ayan Mukhopadhyay

Classic reinforcement learning (RL) frequently confronts challenges in tasks involving delays, which cause a mismatch between received observations and subsequent actions, thereby deviating from the Markov assumption. Existing methods…

Machine Learning · Computer Science 2024-06-06 Bo Xia , Yilun Kong , Yongzhe Chang , Bo Yuan , Zhiheng Li , Xueqian Wang , Bin Liang

As a robot senses and selects actions, the world keeps changing. This inference delay creates a gap of tens to hundreds of milliseconds between the observed state and the state at execution. In this work, we take the natural generalization…

Robotics · Computer Science 2026-03-25 Aileen Liao , Dong-Ki Kim , Max Olan Smith , Ali-akbar Agha-mohammadi , Shayegan Omidshafiei

Reinforcement learning algorithms typically rely on the assumption that the environment dynamics and value function can be expressed in terms of a Markovian state representation. However, when state information is only partially observable,…

Multi-agent systems often operate under feedback, adaptation, and non-stationarity, yet many simulation studies retain static decision rules and fixed control parameters. This paper introduces a general adaptive multi-agent learning…

Multiagent Systems · Computer Science 2025-11-26 Roberto Garrone

A major component of overfitting in model-free reinforcement learning (RL) involves the case where the agent may mistakenly correlate reward with certain spurious features from the observations generated by the Markov Decision Process…

Machine Learning · Computer Science 2020-01-01 Xingyou Song , Yiding Jiang , Stephen Tu , Yilun Du , Behnam Neyshabur

We consider a two-agent MDP framework where agents repeatedly solve a task in a collaborative setting. We study the problem of designing a learning algorithm for the first agent (A1) that facilitates a successful collaboration even in cases…

Machine Learning · Computer Science 2019-06-21 Goran Radanovic , Rati Devidze , David C. Parkes , Adish Singla