中文
相关论文

相关论文: Market-Based Reinforcement Learning in Partially O…

200 篇论文

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

机器人学 · 计算机科学 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

This work pioneers regret analysis of risk-sensitive reinforcement learning in partially observable environments with hindsight observation, addressing a gap in theoretical exploration. We introduce a novel formulation that integrates…

机器学习 · 计算机科学 2024-02-29 Tonghe Zhang , Yu Chen , Longbo Huang

Reinforcement learning (RL) is a technique to learn the control policy for an agent that interacts with a stochastic environment. In any given state, the agent takes some action, and the environment determines the probability distribution…

机器学习 · 计算机科学 2021-07-30 Gaurav Gupta , Chenzhong Yin , Jyotirmoy V. Deshmukh , Paul Bogdan

Markov Decision Processes (MDPs), the mathematical framework underlying most algorithms in Reinforcement Learning (RL), are often used in a way that wrongfully assumes that the state of an agent's environment does not change during action…

机器学习 · 计算机科学 2019-12-13 Simon Ramstedt , Christopher Pal

The integration of physiological computing into mixed-initiative human-robot interaction systems offers valuable advantages in autonomous task allocation by incorporating real-time features as human state observations into the…

Measuring states in reinforcement learning (RL) can be costly in real-world settings and may negatively influence future outcomes. We introduce the Actively Observable Markov Decision Process (AOMDP), where an agent not only selects control…

机器学习 · 计算机科学 2025-10-17 Daiqi Gao , Ziping Xu , Aseel Rawashdeh , Predrag Klasnja , Susan A. Murphy

Model-based Reinforcement Learning (RL) is a popular learning paradigm due to its potential sample efficiency compared to model-free RL. However, existing empirical model-based RL approaches lack the ability to explore. This work studies a…

机器学习 · 计算机科学 2021-07-16 Yuda Song , Wen Sun

We propose a new reinforcement learning algorithm for partially observable Markov decision processes (POMDP) based on spectral decomposition methods. While spectral methods have been previously employed for consistent learning of (passive)…

人工智能 · 计算机科学 2017-06-20 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

The interactive partially observable Markov decision process (I-POMDP) is a recently developed framework which extends the POMDP to the multi-agent setting by including agent models in the state space. This paper argues for formulating the…

机器人学 · 计算机科学 2012-04-03 Mark P. Woodward , Robert J. Wood

Reinforcement Learning (RL) agents typically learn memoryless policies---policies that only consider the last observation when selecting actions. Learning memoryless policies is efficient and optimal in fully observable environments.…

We propose a new reinforcement learning algorithm for partially observable Markov decision processes (POMDP) based on spectral decomposition methods. While spectral methods have been previously employed for consistent learning of (passive)…

人工智能 · 计算机科学 2017-06-20 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

Model-based offline reinforcement learning (RL) aims to find highly rewarding policy, by leveraging a previously collected static dataset and a dynamics model. While the dynamics model learned through reuse of the static dataset, its…

机器学习 · 计算机科学 2022-11-01 Kaiyang Guo , Yunfeng Shao , Yanhui Geng

In this paper, we consider reinforcement learning of Markov Decision Processes (MDP) with peak constraints, where an agent chooses a policy to optimize an objective and at the same time satisfy additional constraints. The agent has to take…

最优化与控制 · 数学 2019-12-09 Ather Gattami

We are interested in enabling autonomous agents to learn and reason about systems with hidden states, such as locking mechanisms. We cast this problem as learning the parameters of a discrete Partially Observable Markov Decision Process…

机器学习 · 计算机科学 2026-02-04 Seiji Shaw , Travis Manderson , Chad Kessens , Nicholas Roy

In typical reinforcement learning (RL), the environment is assumed given and the goal of the learning is to identify an optimal policy for the agent taking actions through its interactions with the environment. In this paper, we extend this…

人工智能 · 计算机科学 2019-10-25 Haifeng Zhang , Jun Wang , Zhiming Zhou , Weinan Zhang , Ying Wen , Yong Yu , Wenxin Li

This paper is concerned with multi-view reinforcement learning (MVRL), which allows for decision making when agents share common dynamics but adhere to different observation models. We define the MVRL framework by extending partially…

机器学习 · 计算机科学 2019-10-21 Minne Li , Lisheng Wu , Haitham Bou Ammar , Jun Wang

Market makers play an important role in providing liquidity to markets by continuously quoting prices at which they are willing to buy and sell, and managing inventory risk. In this paper, we build a multi-agent simulation of a dealer…

交易与市场微观结构 · 定量金融 2019-11-15 Sumitra Ganesh , Nelson Vadori , Mengda Xu , Hua Zheng , Prashant Reddy , Manuela Veloso

Policy Mirror Descent (PMD) is a powerful and theoretically sound methodology for sequential decision-making. However, it is not directly applicable to Reinforcement Learning (RL) due to the inaccessibility of explicit action-value…

机器学习 · 计算机科学 2024-11-01 Pietro Novelli , Marco Pratticò , Massimiliano Pontil , Carlo Ciliberto

In real-world reinforcement learning (RL) scenarios, agents often encounter partial observability, where incomplete or noisy information obscures the true state of the environment. Partially Observable Markov Decision Processes (POMDPs) are…

机器学习 · 计算机科学 2025-05-19 Ashok Arora , Neetesh Kumar

Investors and regulators can greatly benefit from a realistic market simulator that enables them to anticipate the consequences of their decisions in real markets. However, traditional rule-based market simulators often fall short in…

交易与市场微观结构 · 定量金融 2024-04-01 Zhiyuan Yao , Zheng Li , Matthew Thomas , Ionut Florescu