English
Related papers

Related papers: Eliciting Risk Aversion with Inverse Reinforcement…

200 papers

The application of machine learning models can be significantly impeded by the occurrence of distributional shifts, as the assumption of homogeneity between the population of training and testing samples in machine learning and statistics…

Machine Learning · Statistics 2023-06-06 Wenlu Tang , Zicheng Liu

Deep reinforcement learning enables an agent to capture user's interest through interactions with the environment dynamically. It has attracted great interest in the recommendation research. Deep reinforcement learning uses a reward…

Information Retrieval · Computer Science 2020-11-05 Xiaocong Chen , Lina Yao , Aixin Sun , Xianzhi Wang , Xiwei Xu , Liming Zhu

This paper focuses on the development of an online inverse reinforcement learning (IRL) technique for a class of nonlinear systems. The developed approach utilizes observed state and input trajectories, and determines the unknown cost…

Systems and Control · Computer Science 2018-11-27 Ryan Self , Michael Harlan , Rushikesh Kamalapurkar

This study provides a solution of the equity premium puzzle. Questioning the validity of the Arrow-Pratt measure of relative risk aversion for detecting the risk behavior of investors under all conditions, a new tool, that is, the…

General Finance · Quantitative Finance 2023-01-27 Atilla Aras

Value-based methods for reinforcement learning lack generally applicable ways to derive behavior from a value function. Many approaches involve approximate value iteration (e.g., $Q$-learning), and acting greedily with respect to the…

Machine Learning · Computer Science 2020-08-27 Alan Chan , Kris de Asis , Richard S. Sutton

This paper focuses on reinforcement learning (RL) with limited prior knowledge. In the domain of swarm robotics for instance, the expert can hardly design a reward function or demonstrate the target behavior, forbidding the use of both…

Machine Learning · Computer Science 2012-08-07 Riad Akrour , Marc Schoenauer , Michèle Sebag

A long-term goal of reinforcement learning is to design agents that can autonomously interact and learn in the world. A critical challenge to such autonomy is the presence of irreversible states which require external assistance to recover…

Machine Learning · Computer Science 2022-10-20 Annie Xie , Fahim Tajwar , Archit Sharma , Chelsea Finn

We propose risk-sensitive reinforcement learning algorithms catering to three families of risk measures, namely expectiles, utility-based shortfall risk and optimized certainty equivalent risk. For each risk measure, in the context of a…

Machine Learning · Computer Science 2026-02-11 Sumedh Gupte , Shrey Rakeshkumar Patel , Soumen Pachal , Prashanth L. A. , Sanjay P. Bhat

We study risk-sensitive multi-agent reinforcement learning under general-sum Markov games, where agents optimize the entropic risk measure of rewards with possibly diverse risk preferences. We show that using the regret naively adapted from…

Machine Learning · Computer Science 2024-05-07 Yingjie Fei , Ruitu Xu

In many sequential decision-making problems one is interested in minimizing an expected cumulative cost while taking into account \emph{risk}, i.e., increased awareness of events of small probability and high consequences. Accordingly, the…

Artificial Intelligence · Computer Science 2017-04-07 Yinlam Chow , Mohammad Ghavamzadeh , Lucas Janson , Marco Pavone

We study online learning settings in which experts act strategically to maximize their influence on the learning algorithm's predictions by potentially misreporting their beliefs about a sequence of binary events. Our goal is twofold.…

Machine Learning · Computer Science 2020-07-02 Rupert Freeman , David M. Pennock , Chara Podimata , Jennifer Wortman Vaughan

When deploying Reinforcement Learning (RL) agents into a physical system, we must ensure that these agents are well aware of the underlying constraints. In many real-world problems, however, the constraints are often hard to specify…

Machine Learning · Computer Science 2023-03-03 Guiliang Liu , Yudong Luo , Ashish Gaurav , Kasra Rezaee , Pascal Poupart

We present a reinforcement learning (RL) approach for robust optimisation of risk-aware performance criteria. To allow agents to express a wide variety of risk-reward profiles, we assess the value of a policy using rank dependent expected…

Machine Learning · Computer Science 2021-12-16 Sebastian Jaimungal , Silvana Pesenti , Ye Sheng Wang , Hariom Tatsat

Inverse reinforcement learning (IRL) learns a reward function and a corresponding policy that best fit the demonstration data of an expert. However, in the current IRL setting, the learner is isolated from the expert and can only passively…

Machine Learning · Computer Science 2026-05-12 Yue Mao , Shicheng Liu , Siyuan Xu , Minghui Zhu

Traditional reinforcement learning methods optimize agents without considering safety, potentially resulting in unintended consequences. In this paper, we propose an optimal actor-free policy that optimizes a risk-sensitive criterion based…

Machine Learning · Computer Science 2023-07-04 Ruoqi Zhang , Jens Sjölund

We introduce a novel framework to account for sensitivity to rewards uncertainty in sequential decision-making problems. While risk-sensitive formulations for Markov decision processes studied so far focus on the distribution of the…

Machine Learning · Computer Science 2020-09-16 Nelson Vadori , Sumitra Ganesh , Prashant Reddy , Manuela Veloso

The article's aim is to provide a solution to the equity premium puzzle with a derived model. The derived model which depends on Consumption Capital Asset Pricing Model gives a solution to the puzzle with the values of coefficient of…

General Finance · Quantitative Finance 2026-04-03 Atilla Aras

Active learning is a paradigm of machine learning which aims at reducing the amount of labeled data needed to train a classifier. Its overall principle is to sequentially select the most informative data points, which amounts to determining…

Statistics Theory · Mathematics 2022-09-01 Christophe Denis , Mohamed Hebiri , Boris Ndjia Njike , Xavier Siebert

We study lifelong reinforcement learning (RL) in a regret minimization setting of linear contextual Markov decision process (MDP), where the agent needs to learn a multi-task policy while solving a streaming sequence of tasks. We propose an…

Machine Learning · Computer Science 2022-06-02 Sanae Amani , Lin F. Yang , Ching-An Cheng

We consider the problem of reinforcement learning when provided with (1) a baseline control policy and (2) a set of constraints that the learner must satisfy. The baseline policy can arise from demonstration data or a teacher agent and may…

Machine Learning · Computer Science 2021-07-13 Tsung-Yen Yang , Justinian Rosca , Karthik Narasimhan , Peter J. Ramadge