English
Related papers

Related papers: Boosting CVaR Policy Optimization with Quantile Gr…

200 papers

Optimizing risk measures such as Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR) of a general loss distribution is usually difficult, because 1) the loss function might lack structural properties such as convexity or…

Optimization and Control · Mathematics 2016-08-03 Helin Zhu , Joshua Hale , Enlu Zhou

CVaR (Conditional Value at Risk) is a risk metric widely used in finance. However, dynamically optimizing CVaR is difficult since it is not a standard Markov decision process (MDP) and the principle of dynamic programming fails. In this…

Optimization and Control · Mathematics 2022-10-18 Li Xia , Peter W. Glynn

We study a continuous-time portfolio optimization problem under an explicit constraint on the Deviation Conditional Value-at-Risk (DCVaR), defined as the difference between the CVaR and the expected terminal wealth. While the mean-CVaR…

Optimization and Control · Mathematics 2025-10-01 Jérôme Lelong , Véronique Maume-Deschamps , William Thevenot

We study a risk-constrained version of the stochastic shortest path (SSP) problem, where the risk measure considered is Conditional Value-at-Risk (CVaR). We propose two algorithms that obtain a locally risk-optimal policy by employing four…

Machine Learning · Statistics 2018-10-23 Prashanth L. A.

Financial portfolios are often optimized for maximum profit while subject to a constraint formulated in terms of the Conditional Value-at-Risk (CVaR). This amounts to solving a linear problem. However, in its original formulation this…

Optimization and Control · Mathematics 2014-08-13 Georg Hofmann

Many modern machine learning tasks require models with high tail performance, i.e. high performance over the worst-off samples in the dataset. This problem has been widely studied in fields such as algorithmic fairness, class imbalance, and…

Machine Learning · Computer Science 2021-11-11 Runtian Zhai , Chen Dan , Arun Sai Suggala , Zico Kolter , Pradeep Ravikumar

Options are generally learned by using an inaccurate environment model (or simulator), which contains uncertain model parameters. While there are several methods to learn options that are robust against the uncertainty of model parameters,…

Machine Learning · Computer Science 2019-11-01 Takuya Hiraoka , Takahisa Imagawa , Tatsuya Mori , Takashi Onishi , Yoshimasa Tsuruoka

In this work, we tackle the problem of minimising the Conditional-Value-at-Risk (CVaR) of output quantities of complex differential models with random input data, using gradient-based approaches in combination with the Multi-Level Monte…

Numerical Analysis · Mathematics 2023-10-16 Sundar Ganesh , Fabio Nobile

Risk measures are important key figures to measure the adequacy of the reserves of a company. The most common risk measures in practice are Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR). Recently, quantum-based algorithms are…

Quantum Physics · Physics 2025-01-29 Christian Laudagé , Ivica Turkalj

The problem of finding the optimal portfolio for investors is called the portfolio optimization problem. Such problem mainly concerns the expectation and variability of return (i.e., mean and variance). Although the variance would be the…

Portfolio Management · Quantitative Finance 2020-07-21 Kei Nakagawa , Shuhei Noma , Masaya Abe

We study risk-sensitive Reinforcement Learning (RL), where we aim to maximize the Conditional Value at Risk (CVaR) with a fixed risk tolerance $\tau$. Prior theoretical work studying risk-sensitive RL focuses on the tabular Markov Decision…

Machine Learning · Computer Science 2023-11-21 Yulai Zhao , Wenhao Zhan , Xiaoyan Hu , Ho-fung Leung , Farzan Farnia , Wen Sun , Jason D. Lee

We study the optimal portfolio allocation problem from a Bayesian perspective using value at risk (VaR) and conditional value at risk (CVaR) as risk measures. By applying the posterior predictive distribution for the future portfolio…

Portfolio Management · Quantitative Finance 2020-12-04 Taras Bodnar , Mathias Lindholm , Vilhelm Niklasson , Erik Thorsén

We study a linear-quadratic, optimal control problem on a discrete, finite time horizon with distributional ambiguity, in which the cost is assessed via Conditional Value-at-Risk (CVaR). We take steps toward deriving a scalable dynamic…

Systems and Control · Electrical Eng. & Systems 2022-06-28 Margaret P. Chapman , Laurent Lessard

Conditional Value at Risk (CVaR) is a family of "coherent risk measures" which generalize the traditional mathematical expectation. Widely used in mathematical finance, it is garnering increasing interest in machine learning, e.g., as an…

Machine Learning · Computer Science 2020-11-17 Zakaria Mhammedi , Benjamin Guedj , Robert C. Williamson

Mainstream approximate action-value iteration reinforcement learning (RL) algorithms suffer from overestimation bias, leading to suboptimal policies in high-variance stochastic environments. Quantile-based action-value iteration methods…

Machine Learning · Computer Science 2025-12-09 Clinton Enwerem , Aniruddh G. Puranic , John S. Baras , Calin Belta

Policy gradient methods have demonstrated success in reinforcement learning tasks that have high-dimensional continuous state and action spaces. However, policy gradient methods are also notoriously sample inefficient. This can be…

Machine Learning · Computer Science 2019-08-12 Ching-An Cheng , Xinyan Yan , Byron Boots

The conditional value-at-risk (CVaR) is a useful risk measure in fields such as machine learning, finance, insurance, energy, etc. When measuring very extreme risk, the commonly used CVaR estimation method of sample averaging does not work…

Methodology · Statistics 2021-03-10 Dylan Troop , Frédéric Godin , Jia Yuan Yu

In a wide variety of sequential decision making problems, it can be important to estimate the impact of rare events in order to minimize risk exposure. A popular risk measure is the conditional value-at-risk (CVaR), which is commonly…

Machine Learning · Statistics 2020-12-11 Dylan Troop , Frédéric Godin , Jia Yuan Yu

Data in the real-world classification problems are always imbalanced or long-tailed, wherein the majority classes have the most of the samples that dominate the model training. In such setting, the naive model tends to have poor performance…

Machine Learning · Computer Science 2023-08-30 Hong Zhu , Runpeng Yu , Xing Tang , Yifei Wang , Yuan Fang , Yisen Wang

This thesis presents the Conditional Value-at-Risk concept and combines an analysis that covers its application as a risk measure and as a vector norm. For both areas of application the theory is revised in detail and examples are given to…

Risk Management · Quantitative Finance 2015-11-03 Jakob Kisiala