中文
相关论文

相关论文: Safe Learning Under Irreversible Dynamics via Aski…

200 篇论文

We study online learning settings in which experts act strategically to maximize their influence on the learning algorithm's predictions by potentially misreporting their beliefs about a sequence of binary events. Our goal is twofold.…

机器学习 · 计算机科学 2020-07-02 Rupert Freeman , David M. Pennock , Chara Podimata , Jennifer Wortman Vaughan

We consider reinforcement learning for continuous-time Markov decision processes (MDPs) in the infinite-horizon, average-reward setting. In contrast to discrete-time MDPs, a continuous-time process moves to a state and stays there for a…

机器学习 · 计算机科学 2024-07-03 Xuefeng Gao , Xun Yu Zhou

Multitask learning is a powerful framework that enables one to simultaneously learn multiple related tasks by sharing information between them. Quantifying uncertainty in the estimated tasks is of pivotal importance for many downstream…

机器学习 · 计算机科学 2023-08-04 Pier Giuseppe Sessa , Pierre Laforgue , Nicolò Cesa-Bianchi , Andreas Krause

Online reinforcement learning (RL) has been widely applied in information processing scenarios, which usually exhibit much uncertainty due to the intrinsic randomness of channels and service demands. In this paper, we consider an…

机器学习 · 计算机科学 2021-06-17 Rongpeng Li

Modern tasks in reinforcement learning have large state and action spaces. To deal with them efficiently, one often uses predefined feature mapping to represent states and actions in a low-dimensional space. In this paper, we study…

机器学习 · 计算机科学 2021-02-24 Dongruo Zhou , Jiafan He , Quanquan Gu

In reinforcement learning, an agent interacts sequentially with an environment to maximize a reward, receiving only partial, probabilistic feedback. This creates a fundamental exploration-exploitation trade-off: the agent must explore to…

量子物理 · 物理学 2026-03-27 Josep Lumbreras , Ruo Cheng Huang , Yanglin Hu , Marco Fanizza , Mile Gu

We consider reinforcement learning (RL) in episodic MDPs with adversarial full-information reward feedback and unknown fixed transition kernels. We propose two model-free policy optimization algorithms, POWER and POWER++, and establish…

机器学习 · 计算机科学 2020-07-02 Yingjie Fei , Zhuoran Yang , Zhaoran Wang , Qiaomin Xie

We provide improved gap-dependent regret bounds for reinforcement learning in finite episodic Markov decision processes. Compared to prior work, our bounds depend on alternative definitions of gaps. These definitions are based on the…

机器学习 · 计算机科学 2021-10-27 Christoph Dann , Teodor V. Marinov , Mehryar Mohri , Julian Zimmert

Understanding emerging behaviors of reinforcement learning (RL) agents may be difficult since such agents are often trained in complex environments using highly complex decision making procedures. This has given rise to a variety of…

We consider reinforcement learning (RL) in Markov Decision Processes in which an agent repeatedly interacts with an environment that is modeled by a controlled Markov process. At each time step $t$, it earns a reward, and also incurs a…

机器学习 · 计算机科学 2023-03-16 Rahul Singh , Abhishek Gupta , Ness B. Shroff

We study agents acting in an unknown environment where the agent's goal is to find a robust policy. We consider robust policies as policies that achieve high cumulative rewards for all possible environments. To this end, we consider agents…

We study the problem of online learning with dynamics, where a learner interacts with a stateful environment over multiple rounds. In each round of the interaction, the learner selects a policy to deploy and incurs a cost that depends on…

机器学习 · 计算机科学 2020-12-04 Kush Bhatia , Karthik Sridharan

Reinforcement learning algorithms are widely used in domains where it is desirable to provide a personalized service. In these domains it is common that user data contains sensitive information that needs to be protected from third parties.…

机器学习 · 计算机科学 2021-10-28 Evrard Garcelon , Vianney Perchet , Ciara Pike-Burke , Matteo Pirotta

We consider an online learning problem where the learner interacts with a Markov decision process in a sequence of episodes, where the reward function is allowed to change between episodes in an adversarial manner and the learner only gets…

机器学习 · 计算机科学 2021-06-15 Gergely Neu , Julia Olkhovskaya

We study lifelong reinforcement learning (RL) in a regret minimization setting of linear contextual Markov decision process (MDP), where the agent needs to learn a multi-task policy while solving a streaming sequence of tasks. We propose an…

机器学习 · 计算机科学 2022-06-02 Sanae Amani , Lin F. Yang , Ching-An Cheng

The online Markov decision process (MDP) is a generalization of the classical Markov decision process that incorporates changing reward functions. In this paper, we propose practical online MDP algorithms with policy iteration and…

机器学习 · 计算机科学 2015-10-16 Yao Ma , Hao Zhang , Masashi Sugiyama

In this paper, we study the learning of safe policies in the setting of reinforcement learning problems. This is, we aim to control a Markov Decision Process (MDP) of which we do not know the transition probabilities, but we have access to…

系统与控制 · 电气工程与系统科学 2022-01-14 Santiago Paternain , Miguel Calvo-Fullana , Luiz F. O. Chamon , Alejandro Ribeiro

We study the repeated principal-agent bandit game, where the principal indirectly interacts with the unknown environment by proposing incentives for the agent to play arms. Most existing work assumes the agent has full knowledge of the…

机器学习 · 计算机科学 2025-06-03 Junyan Liu , Lillian J. Ratliff

We study reinforcement learning for continuous-time Markov decision processes (MDPs) in the finite-horizon episodic setting. In contrast to discrete-time MDPs, the inter-transition times of a continuous-time MDP are exponentially…

机器学习 · 计算机科学 2023-10-04 Xuefeng Gao , Xun Yu Zhou

Reinforcement learning agents have been mostly developed and evaluated under the assumption that they will operate in a fully autonomous manner -- they will take all actions. In this work, our goal is to develop algorithms that, by learning…

机器学习 · 计算机科学 2023-07-04 Vahid Balazadeh , Abir De , Adish Singla , Manuel Gomez-Rodriguez