中文
相关论文

相关论文: Harnessing Causality in Reinforcement Learning Wit…

200 篇论文

In this paper we consider the basic version of Reinforcement Learning (RL) that involves computing optimal data driven (adaptive) policies for Markovian decision process with unknown transition probabilities. We provide a brief survey of…

机器学习 · 计算机科学 2019-09-16 Wesley Cowan , Michael N. Katehakis , Daniel Pirutinsky

In many practical applications of RL, it is expensive to observe state transitions from the environment. For example, in the problem of plasma control for nuclear fusion, computing the next state for a given state-action pair requires…

机器学习 · 计算机科学 2022-03-16 Viraj Mehta , Biswajit Paria , Jeff Schneider , Stefano Ermon , Willie Neiswanger

The Markov decision process (MDP) formulation used to model many real-world sequential decision making problems does not efficiently capture the setting where the set of available decisions (actions) at each time step is stochastic.…

机器学习 · 计算机科学 2020-01-22 Yash Chandak , Georgios Theocharous , Blossom Metevier , Philip S. Thomas

Traditionally, Reinforcement Learning (RL) aims at deciding how to act optimally for an artificial agent. We argue that deciding when to act is equally important. As humans, we drift from default, instinctive or memorized behaviors to…

机器学习 · 计算机科学 2022-03-17 Alexis Jacq , Johan Ferret , Olivier Pietquin , Matthieu Geist

The exponential growth of Internet of Things (IoT) devices, smart vehicles, and latency-sensitive applications has created an urgent demand for efficient distributed computing paradigms. Multi-Fog Computing (MFC), as an extension of fog and…

网络与互联网体系结构 · 计算机科学 2025-11-04 Mohammad Hadi Akbarzadeh , Mahmood Ahmadi , Mohammad Saeed Jahangiry , Jae Young Hur

Mediation analysis learns the causal effect transmitted via mediator variables between treatments and outcomes and receives increasing attention in various scientific domains to elucidate causal relations. Most existing works focus on…

机器学习 · 统计学 2023-09-06 Lin Ge , Jitao Wang , Chengchun Shi , Zhenke Wu , Rui Song

Reinforcement Learning (RL) is a computational approach to reward-driven learning in sequential decision problems. It implements the discovery of optimal actions by learning from an agent interacting with an environment rather than from…

统计方法学 · 统计学 2022-10-06 Mauricio Tec , Yunshan Duan , Peter Müller

Dynamic mechanism design has garnered significant attention from both computer scientists and economists in recent years. By allowing agents to interact with the seller over multiple rounds, where agents' reward functions may change with…

机器学习 · 计算机科学 2022-06-22 Boxiang Lyu , Zhaoran Wang , Mladen Kolar , Zhuoran Yang

In this paper we model basketball plays as episodes from team-specific non-stationary Markov decision processes (MDPs) with shot clock dependent transition probabilities. Bayesian hierarchical models are employed in the modeling and…

应用统计 · 统计学 2021-04-19 Nathan Sandholtz , Luke Bornn

Model-based reinforcement learning (MBRL) provides a way to learn a transition model of the environment, which can then be used to plan personalized policies for different patient cohorts and to understand the dynamics involved in the…

机器学习 · 计算机科学 2024-11-22 Abhishek Sharma , Sonali Parbhoo , Omer Gottesman , Finale Doshi-Velez

We generalise the problem of reward modelling (RM) for reinforcement learning (RL) to handle non-Markovian rewards. Existing work assumes that human evaluators observe each step in a trajectory independently when providing feedback on agent…

机器学习 · 计算机科学 2022-10-11 Joseph Early , Tom Bewley , Christine Evers , Sarvapali Ramchurn

Decision-making under distribution shift is a central challenge in reinforcement learning (RL), where training and deployment environments differ. We study this problem through the lens of robust Markov decision processes (RMDPs), which…

机器学习 · 计算机科学 2025-10-17 Jingwen Gu , Yiting He , Zhishuai Liu , Pan Xu

Learning directed acyclic graph (DAG) that describes the causality of observed data is a very challenging but important task. Due to the limited quantity and quality of observed data, and non-identifiability of causal graph, it is almost…

机器学习 · 计算机科学 2022-11-23 Dezhi Yang , Guoxian Yu , Jun Wang , Zhengtian Wu , Maozu Guo

This work tackles the problem of robust zero-shot planning in non-stationary stochastic environments. We study Markov Decision Processes (MDPs) evolving over time and consider Model-Based Reinforcement Learning algorithms in this setting.…

机器学习 · 计算机科学 2020-01-16 Erwan Lecarpentier , Emmanuel Rachelson

In the rapidly changing healthcare landscape, the implementation of offline reinforcement learning (RL) in dynamic treatment regimes (DTRs) presents a mix of unprecedented opportunities and challenges. This position paper offers a critical…

机器学习 · 计算机科学 2024-06-05 Zhiyao Luo , Yangchen Pan , Peter Watkinson , Tingting Zhu

Most reinforcement learning algorithms are based on a key assumption that Markov decision processes (MDPs) are stationary. However, non-stationary MDPs with dynamic action space are omnipresent in real-world scenarios. Yet problems of…

机器学习 · 计算机科学 2023-04-04 Jiaqi Ye , Xiaodong Li , Pangjing Wu , Feng Wang

With the fast development of quantitative portfolio optimization in financial engineering, lots of AI-based algorithmic trading strategies have demonstrated promising results, among which reinforcement learning begins to manifest…

数理金融 · 定量金融 2023-03-10 Huifang Huang , Ting Gao , Pengbo Li , Jin Guo , Peng Zhang , Nan Du

Modern large-scale computing deployments consist of complex applications running over machine clusters. An important issue in these is the offering of elasticity, i.e., the dynamic allocation of resources to applications to meet fluctuating…

分布式、并行与集群计算 · 计算机科学 2017-02-13 Konstantinos Lolos , Ioannis Konstantinou , Verena Kantere , Nectarios Koziris

We study the estimation of risk-sensitive policies in reinforcement learning problems defined by a Markov Decision Process (MDPs) whose state and action spaces are countably finite. Prior efforts are predominately afflicted by computational…

机器学习 · 统计学 2020-03-02 Junyu Zhang , Amrit Singh Bedi , Mengdi Wang , Alec Koppel

Reinforcement learning (RL) has gained increasing attraction in the academia and tech industry with launches to a variety of impactful applications and products. Although research is being actively conducted on many fronts (e.g., offline…

机器学习 · 计算机科学 2021-12-13 Ruiyang Xu , Zhengxing Chen