中文
相关论文

相关论文: Optimal Actor-Critic Policy with Optimized Trainin…

200 篇论文

Decision makers often aim to learn a treatment assignment policy under a capacity constraint on the number of agents that they can treat. When agents can respond strategically to such policies, competition arises, complicating estimation of…

机器学习 · 统计学 2025-03-31 Roshni Sahoo , Stefan Wager

We study the global convergence and global optimality of actor-critic, one of the most popular families of reinforcement learning algorithms. While most existing works on actor-critic employ bi-level or two-timescale updates, we focus on…

机器学习 · 计算机科学 2021-06-15 Zuyue Fu , Zhuoran Yang , Zhaoran Wang

In real-world decision making tasks, it is critical for data-driven reinforcement learning methods to be both stable and sample efficient. On-policy methods typically generate reliable policy improvement throughout training, while…

机器学习 · 计算机科学 2021-11-02 James Queeney , Ioannis Ch. Paschalidis , Christos G. Cassandras

The ability to act in multiple environments and transfer previous knowledge to new situations can be considered a critical aspect of any intelligent agent. Towards this goal, we define a novel method of multitask and transfer learning that…

机器学习 · 计算机科学 2016-02-23 Emilio Parisotto , Jimmy Lei Ba , Ruslan Salakhutdinov

Deep reinforcement learning (RL) has proven a powerful technique in many sequential decision making domains. However, Robotics poses many challenges for RL, most notably training on a physical system can be expensive and dangerous, which…

机器人学 · 计算机科学 2017-10-19 Lerrel Pinto , Marcin Andrychowicz , Peter Welinder , Wojciech Zaremba , Pieter Abbeel

Multi-agent deep reinforcement learning makes optimal decisions dependent on system states observed by agents, but any uncertainty on the observations may mislead agents to take wrong actions. The Mean-Field Actor-Critic reinforcement…

机器学习 · 计算机科学 2023-06-01 Ziyuan Zhou , Guanjun Liu

The note studies the problem of selecting a good enough subset out of a finite number of alternatives under a fixed simulation budget. Our work aims to maximize the posterior probability of correctly selecting a good subset. We formulate…

最优化与控制 · 数学 2023-05-09 Gongbo Zhang , Bin Chen , Qing-shan Jia , Yijie Peng

In this paper, we consider the problem of actor-critic reinforcement learning. Firstly, we extend the actor-critic architecture to actor-critic-N architecture by introducing more critics beyond rewards. Secondly, we combine the reward-based…

机器学习 · 计算机科学 2020-06-15 Weiya Ren

We present a novel extension to the family of Soft Actor-Critic (SAC) algorithms. We argue that based on the Maximum Entropy Principle, discrete SAC can be further improved via additional statistical constraints derived from a surrogate…

机器学习 · 计算机科学 2025-06-24 Dexter Neo , Tsuhan Chen

Most reinforcement learning algorithms are based on a key assumption that Markov decision processes (MDPs) are stationary. However, non-stationary MDPs with dynamic action space are omnipresent in real-world scenarios. Yet problems of…

机器学习 · 计算机科学 2023-04-04 Jiaqi Ye , Xiaodong Li , Pangjing Wu , Feng Wang

Practitioners often use data from a randomized controlled trial to learn a treatment assignment policy that can be deployed on a target population. A recurring concern in doing so is that, even if the randomized trial was well-executed…

计量经济学 · 经济学 2023-04-25 Lihua Lei , Roshni Sahoo , Stefan Wager

Reinforcement learning (RL) provides an appealing formalism for learning control policies from experience. However, the classic active formulation of RL necessitates a lengthy active exploration process for each behavior, making it…

机器学习 · 计算机科学 2021-04-27 Ashvin Nair , Abhishek Gupta , Murtaza Dalal , Sergey Levine

When deploying artificial agents in real-world environments where they interact with humans, it is crucial that their behavior is aligned with the values, social norms or other requirements of that environment. However, many environments…

机器学习 · 计算机科学 2023-05-05 Mattijs Baert , Pietro Mazzaglia , Sam Leroux , Pieter Simoens

Due to their complex nonlinear dynamics and batch-to-batch variability, batch processes pose a challenge for process control. Due to the absence of accurate models and resulting plant-model mismatch, these problems become harder to address…

机器学习 · 计算机科学 2022-05-03 Tanuja Joshi , Hariprasad Kodamana , Harikumar Kandath , Niket Kaisare

We focus on developing efficient and reliable policy optimization strategies for robot learning with real-world data. In recent years, policy gradient methods have emerged as a promising paradigm for training control policies in simulation.…

机器学习 · 计算机科学 2023-11-07 Tyler Westenbroek , Jacob Levy , David Fridovich-Keil

We consider a simulation optimization problem for a context-dependent decision-making, which aims to determine the top-m designs for all contexts. Under a Bayesian framework, we formulate the optimal dynamic sampling decision as a…

机器学习 · 统计学 2023-06-12 Gongbo Zhang , Sihua Chen , Kuihua Huang , Yijie Peng

Off-policy reinforcement learning enables near-optimal policy from suboptimal experience, thereby provisions opportunity for artificial intelligence applications in healthcare. Previous works have mainly framed patient-clinician…

人工智能 · 计算机科学 2018-06-05 Luchen Li , Matthieu Komorowski , Aldo A. Faisal

Compared to on-policy counterparts, off-policy model-free deep reinforcement learning can improve data efficiency by repeatedly using the previously gathered data. However, off-policy learning becomes challenging when the discrepancy…

机器学习 · 计算机科学 2023-09-27 Baturay Saglam , Dogan C. Cicek , Furkan B. Mutlu , Suleyman S. Kozat

Recent developments in sequential experimental design look to construct a policy that can efficiently navigate the design space, in a way that maximises the expected information gain. Whilst there is work on achieving tractable policies for…

机器学习 · 计算机科学 2025-08-20 Yasir Zubayr Barlas , Kizito Salako

This work develops a fully decentralized multi-agent algorithm for policy evaluation. The proposed scheme can be applied to two distinct scenarios. In the first scenario, a collection of agents have distinct datasets gathered following…

机器学习 · 计算机科学 2019-08-13 Lucas Cassano , Kun Yuan , Ali H. Sayed