English
Related papers

Related papers: Online Risk-Averse Planning in POMDPs Using Iterat…

200 papers

Conditional value at risk (CVaR) is a popular measure for quantifying portfolio risk. Sensitivity analysis of CVaR is very useful in risk management and gradient-based optimization algorithms. In this paper, we study the infinitesimal…

Numerical Analysis · Mathematics 2020-09-22 Zhijian He

This paper proposes a safety analysis method that facilitates a tunable balance between the worst-case and risk-neutral perspectives. First, we define a risk-sensitive safe set to specify the degree of safety attained by a stochastic…

Systems and Control · Electrical Eng. & Systems 2020-07-28 Margaret P. Chapman , Jonathan P. Lacotte , Kevin M. Smith , Insoon Yang , Yuxi Han , Marco Pavone , Claire J. Tomlin

Online planning for partially observable Markov decision processes (POMDPs) provides efficient techniques for robot decision-making under uncertainty. However, existing methods fall short of preventing safety violations in dynamic…

Robotics · Computer Science 2024-09-10 Shili Sheng , Pian Yu , David Parker , Marta Kwiatkowska , Lu Feng

Conditional Value at Risk (CVaR) is a prominent risk measure that is being used extensively in various domains. We develop a new formula for the gradient of the CVaR in the form of a conditional expectation. Based on this formula, we…

Machine Learning · Statistics 2014-11-25 Aviv Tamar , Yonatan Glassner , Shie Mannor

CoVaR (conditional value-at-risk) is a crucial measure for assessing financial systemic risk, which is defined as a conditional quantile of a random variable, conditioned on other random variables reaching specific quantiles. It enables the…

Risk Management · Quantitative Finance 2023-10-31 Weihuan Huang

This paper presents sensitivity analyses of resilience-based active distribution system planning solutions with respect to different parameters. The distribution system planning problem is formulated as a two-stage risk-averse stochastic…

Systems and Control · Electrical Eng. & Systems 2022-11-28 Abodh Poudyal , Anamika Dubey

Safety is a core challenge of autonomous robot motion planning, especially in the presence of dynamic and uncertain obstacles. Many recent results use learning and deep learning-based motion planners and prediction modules to predict…

Robotics · Computer Science 2023-09-19 Sleiman Safaoui , Tyler H. Summers

In this paper we present an algorithm to compute risk averse policies in Markov Decision Processes (MDP) when the total cost criterion is used together with the average value at risk (AVaR) metric. Risk averse policies are needed when large…

Optimization and Control · Mathematics 2016-02-17 Stefano Carpin , Yin-Lam Chow , Marco Pavone

We consider the problem of designing policies for partially observable Markov decision processes (POMDPs) with dynamic coherent risk objectives. Synthesizing risk-averse optimal policies for POMDPs requires infinite memory and thus…

Robotics · Computer Science 2019-09-30 Mohamadreza Ahmadi , Masahiro Ono , Michel D. Ingham , Richard M. Murray , Aaron D. Ames

We present the conditional value-at-risk (CVaR) in the context of Markov chains and Markov decision processes with reachability and mean-payoff objectives. CVaR quantifies risk by means of the expectation of the worst p-quantile. As such it…

Logic in Computer Science · Computer Science 2018-05-09 Jan Křetínský , Tobias Meggendorfer

The conditional value-at-risk (CVaR) is a useful risk measure in fields such as machine learning, finance, insurance, energy, etc. When measuring very extreme risk, the commonly used CVaR estimation method of sample averaging does not work…

Methodology · Statistics 2021-03-10 Dylan Troop , Frédéric Godin , Jia Yuan Yu

While maximizing expected return is the goal in most reinforcement learning approaches, risk-sensitive objectives such as conditional value at risk (CVaR) are more suitable for many high-stakes applications. However, relatively little is…

Machine Learning · Computer Science 2020-04-06 Ramtin Keramati , Christoph Dann , Alex Tamkin , Emma Brunskill

In robotic planetary surface exploration, strategic mobility planning is an important task that involves finding candidate long-distance routes on orbital maps and identifying segments with uncertain traversability. Then, expert human…

Robotics · Computer Science 2026-05-08 Olivier Lamarre , Jonathan Kelly

Online portfolio selection research has so far focused mainly on minimizing regret defined in terms of wealth growth. Practical financial decision making, however, is deeply concerned with both wealth and risk. We consider online learning…

Mathematical Finance · Quantitative Finance 2017-05-30 Guy Uziel , Ran El-Yaniv

In this work, we address risk-averse Bayes-adaptive reinforcement learning. We pose the problem of optimising the conditional value at risk (CVaR) of the total return in Bayes-adaptive Markov decision processes (MDPs). We show that a policy…

Machine Learning · Computer Science 2021-10-27 Marc Rigter , Bruno Lacerda , Nick Hawes

Value-at-risk (VaR) has been playing the role of a standard risk measure since its introduction. In practice, the delta-normal approach is usually adopted to approximate the VaR of portfolios with option positions. Its effectiveness,…

Methodology · Statistics 2019-04-22 Junyao Chen , Tony Sit , Hoi Ying Wong

In many real-world planning tasks, agents must tackle uncertainty about the environment's state and variability in the outcomes induced by stochastic dynamics and rewards. Motivated by recent progress in world model approaches, where latent…

Artificial Intelligence · Computer Science 2026-05-07 Larry Preuett , Qiuyi Zhang , Muhammad Aurangzeb Ahmad

In active perception tasks, an agent aims to select sensory actions that reduce its uncertainty about one or more hidden variables. While partially observable Markov decision processes (POMDPs) provide a natural model for such problems,…

Artificial Intelligence · Computer Science 2020-09-22 Yash Satsangi , Shimon Whiteson , Frans A. Oliehoek , Matthijs T. J. Spaan

This paper investigates the use of retrospective approximation solution paradigm in solving risk-averse optimization problems effectively via importance sampling (IS). While IS serves as a prominent means for tackling the large sample…

Risk Management · Quantitative Finance 2022-06-28 Anand Deo , Karthyek Murthy , Tirtho Sarker

This thesis presents the Conditional Value-at-Risk concept and combines an analysis that covers its application as a risk measure and as a vector norm. For both areas of application the theory is revised in detail and examples are given to…

Risk Management · Quantitative Finance 2015-11-03 Jakob Kisiala