English
Related papers

Related papers: Risk-Sensitive Markov Decision Processes with Long…

200 papers

We consider large-scale Markov decision processes (MDPs) with a risk measure of variability in cost, under the risk-aware MDPs paradigm. Previous studies showed that risk-aware MDPs, based on a minimax approach to handling risk, can be…

Systems and Control · Computer Science 2017-05-17 Pengqian Yu , William B. Haskell , Huan Xu

In this paper we discuss a general methodology to compute the market risk measure over long time horizons and at extreme percentiles, which are the typical conditions needed for estimating Economic Capital. The proposed approach extends the…

Risk Management · Quantitative Finance 2014-08-12 Luca Spadafora , Marco Dubrovich , Marcello Terraneo

Keeping risk under control is often more crucial than maximizing expected rewards in real-world decision-making situations, such as finance, robotics, autonomous driving, etc. The most natural choice of risk measures is variance, which…

Machine Learning · Computer Science 2023-03-09 Xiaoteng Ma , Shuai Ma , Li Xia , Qianchuan Zhao

Conditional Value-at-Risk (CVaR) is a leading tail-risk measure in finance, central to both regulatory and portfolio optimization frameworks. Classical estimation of CVaR and its gradients relies on Monte Carlo simulation, incurring…

Quantum Physics · Physics 2026-05-19 Vasilis Skarlatos , Nikos Konofaos

Conditional value-at-risk (CVaR) and value-at-risk (VaR) are popular tail-risk measures in finance and insurance industries as well as in highly reliable, safety-critical uncertain environments where often the underlying probability…

Machine Learning · Computer Science 2021-06-23 Shubhada Agrawal , Wouter M. Koolen , Sandeep Juneja

The development of Distributional Reinforcement Learning (DRL) has introduced a natural way to incorporate risk sensitivity into value-based and actor-critic methods by employing risk measures other than expectation in the value function.…

Machine Learning · Computer Science 2025-07-08 Mehrdad Moghimi , Hyejin Ku

In this paper, we present a novel Model Predictive Control method for autonomous robots subject to arbitrary forms of uncertainty. The proposed Risk-Aware Model Predictive Path Integral (RA-MPPI) control utilizes the Conditional…

Robotics · Computer Science 2022-09-27 Ji Yin , Zhiyuan Zhang , Panagiotis Tsiotras

Worst-case risk measures refer to the calculation of the largest value for risk measures when only partial information of the underlying distribution is available. For the popular risk measures such as Value-at-Risk (VaR) and Conditional…

Risk Management · Quantitative Finance 2016-09-15 Jonathan Yu-Meng Li

The problem of data uncertainty has motivated the incorporation of robust optimization in various arenas, beyond the Markowitz portfolio optimization. This work presents the extension of the robust optimization framework for the…

Portfolio Management · Quantitative Finance 2019-08-15 Mohammed Bilal Girach , Shashank Oberoi , Siddhartha P. Chakrabarty

Constrained decision-making is essential for designing safe policies in real-world control systems, yet simulated environments often fail to capture real-world adversities. We consider the problem of learning a policy that will maximize the…

Machine Learning · Computer Science 2026-02-10 Sourav Ganguly , Kishan Panaganti , Arnob Ghosh , Adam Wierman

We introduce two quantum algorithms to compute the Value at Risk (VaR) and Conditional Value at Risk (CVaR) of financial derivatives using quantum computers: the first by applying existing ideas from quantum risk analysis to derivative…

Quantum Physics · Physics 2024-04-17 Nikitas Stamatopoulos , B. David Clader , Stefan Woerner , William J. Zeng

We consider an online stochastic game with risk-averse agents whose goal is to learn optimal decisions that minimize the risk of incurring significantly high costs. Specifically, we use the Conditional Value at Risk (CVaR) as a risk measure…

Machine Learning · Computer Science 2022-06-17 Zifan Wang , Yi Shen , Michael M. Zavlanos

Risk-sensitive planning aims to identify policies maximizing some tail-focused metrics in Markov Decision Processes (MDPs). Such an optimization task can be very costly for the most widely used and interpretable metrics such as threshold…

Machine Learning · Statistics 2025-07-09 Alexandre Marthe , Samuel Bounan , Aurélien Garivier , Claire Vernade

In many sequential decision-making problems one is interested in minimizing an expected cumulative cost while taking into account \emph{risk}, i.e., increased awareness of events of small probability and high consequences. Accordingly, the…

Artificial Intelligence · Computer Science 2017-04-07 Yinlam Chow , Mohammad Ghavamzadeh , Lucas Janson , Marco Pavone

This paper studies mean-risk portfolio optimization models using the conditional value-at-risk (CVaR) as a risk measure. We also employ a cardinality constraint for limiting the number of invested assets. Solving such a…

Optimization and Control · Mathematics 2020-08-10 Ken Kobayashi , Yuichi Takano , Kazuhide Nakata

We account for time-varying parameters in the conditional expectile-based value at risk (EVaR) model. The EVaR downside risk is more sensitive to the magnitude of portfolio losses compared to the quantile-based value at risk (QVaR). Rather…

Statistical Finance · Quantitative Finance 2020-09-29 Xiu Xu , Andrija Mihoci , Wolfgang Karl Härdle

Value-at-risk (VaR) has been playing the role of a standard risk measure since its introduction. In practice, the delta-normal approach is usually adopted to approximate the VaR of portfolios with option positions. Its effectiveness,…

Methodology · Statistics 2019-04-22 Junyao Chen , Tony Sit , Hoi Ying Wong

We propose a distributionally robust index tracking model with the conditional value-at-risk (CVaR) penalty. The model combines the idea of distributionally robust optimization for data uncertainty and the CVaR penalty to avoid large…

Optimization and Control · Mathematics 2023-09-12 Ruyu Wang , Yaozhong Hu , Chao Zhang

Robust estimators for linear regression require non-convex objective functions to shield against adverse affects of outliers. This non-convexity brings challenges, particularly when combined with penalization in high-dimensional settings.…

Computation · Statistics 2025-08-08 David Kepplinger , Siqi Wei

CoVaR (conditional value-at-risk) is a crucial measure for assessing financial systemic risk, which is defined as a conditional quantile of a random variable, conditioned on other random variables reaching specific quantiles. It enables the…

Risk Management · Quantitative Finance 2023-10-31 Weihuan Huang