English
Related papers

Related papers: Online Risk-Averse Planning in POMDPs Using Iterat…

200 papers

Risk-averse decision-making under uncertainty in partially observable domains is a central challenge in artificial intelligence and is essential for developing reliable autonomous agents. The formal framework for such problems is the…

Statistics Theory · Mathematics 2026-02-27 Yaacov Pariente , Vadim Indelman

Risk averse decision making under uncertainty in partially observable domains is a fundamental problem in AI and essential for reliable autonomous agents. In our case, the problem is modeled using partially observable Markov decision…

Artificial Intelligence · Computer Science 2024-06-11 Yaacov Pariente , Vadim Indelman

In many sequential decision-making problems we may want to manage risk by minimizing some measure of variability in costs in addition to minimizing a standard criterion. Conditional value-at-risk (CVaR) is a relatively new risk measure that…

Artificial Intelligence · Computer Science 2014-07-14 Yinlam Chow , Mohammad Ghavamzadeh

In safety-critical decision-making, the environment may evolve over time, and the learner adjusts its risk level accordingly. This work investigates risk-averse online optimization in dynamic environments with varying risk levels, employing…

Optimization and Control · Mathematics 2025-12-30 Siyi Wang , Zifan Wang , Karl H. Johansson

Although risk awareness is fundamental to an online operating agent, it has received less attention in the challenging continuous domain and under partial observability. This paper presents a novel formulation and solution for risk-averse…

Artificial Intelligence · Computer Science 2023-02-22 Andrey Zhitnikov , Vadim Indelman

Considering non-stationary environments in online optimization enables decision-maker to effectively adapt to changes and improve its performance over time. In such cases, it is favorable to adopt a strategy that minimizes the negative…

Systems and Control · Electrical Eng. & Systems 2024-04-05 Siyi Wang , Zifan Wang , Xinlei Yi , Michael M. Zavlanos , Karl H. Johansson , Sandra Hirche

CVaR (Conditional Value at Risk) is a risk metric widely used in finance. However, dynamically optimizing CVaR is difficult since it is not a standard Markov decision process (MDP) and the principle of dynamic programming fails. In this…

Optimization and Control · Mathematics 2022-10-18 Li Xia , Peter W. Glynn

In this paper we address the problem of decision making within a Markov decision process (MDP) framework where risk and modeling errors are taken into account. Our approach is to minimize a risk-sensitive conditional-value-at-risk (CVaR)…

Artificial Intelligence · Computer Science 2015-06-09 Yinlam Chow , Aviv Tamar , Shie Mannor , Marco Pavone

Risk sensitive decision making finds important applications in current day use cases. Existing risk measures consider a single or finite collection of random variables, which do not account for the asymptotic behaviour of underlying…

Risk Management · Quantitative Finance 2024-05-24 Shivam Patel , Vivek Borkar

Conditional value-at-risk (CVaR) is a prominent risk measure in financial engineering, energy systems, and supply chain management. In these domains, Markov decision processes (MDPs) with a long-run CVaR criterion effectively mitigate cost…

Optimization and Control · Mathematics 2026-03-11 Qixin Wang , Hao Cao , Jian-Qiang Hu , Mingjie Hu , Li Xia

Risk management is very important for individual investors or companies. There are many ways to measure the risk of investment. Prices of risky assets vary rapidly and randomly due to the complexity of finance market. Random interval is a…

Portfolio Management · Quantitative Finance 2022-07-26 Jinping Zhang , Keming Zhang

Planning in Markov decision processes (MDPs) typically optimises the expected cost. However, optimising the expectation does not consider the risk that for any given run of the MDP, the total cost received may be unacceptably high. An…

Artificial Intelligence · Computer Science 2022-03-11 Marc Rigter , Paul Duckworth , Bruno Lacerda , Nick Hawes

The entropic value-at-risk (EVaR) is a new coherent risk measure, which is an upper bound for both the value-at-risk (VaR) and conditional value-at-risk (CVaR). As important properties, the EVaR is strongly monotone over its domain and…

Portfolio Management · Quantitative Finance 2020-04-17 Amir Ahmadi-Javid , Malihe Fallah-Tafti

We propose a risk-averse statistical learning framework wherein the performance of a learning algorithm is evaluated by the conditional value-at-risk (CVaR) of losses rather than the expected loss. We devise algorithms based on stochastic…

Machine Learning · Computer Science 2020-02-17 Tasuku Soma , Yuichi Yoshida

Decision-making under uncertainty is a crucial ability for autonomous systems. In its most general form, this problem can be formulated as a Partially Observable Markov Decision Process (POMDP). The solution policy of a POMDP can be…

Robotics · Computer Science 2019-04-09 Sung-Kyun Kim , Rohan Thakker , Ali-akbar Agha-mohammadi

We consider the problem of risk-sensitive motion planning in the presence of randomly moving obstacles. To this end, we adopt a model predictive control (MPC) scheme and pose the obstacle avoidance constraint in the MPC problem as a…

Systems and Control · Electrical Eng. & Systems 2021-07-20 Anushri Dixit , Mohamadreza Ahmadi , Joel W. Burdick

We consider an online stochastic game with risk-averse agents whose goal is to learn optimal decisions that minimize the risk of incurring significantly high costs. Specifically, we use the Conditional Value at Risk (CVaR) as a risk measure…

Machine Learning · Computer Science 2022-06-17 Zifan Wang , Yi Shen , Michael M. Zavlanos

We present a polynomial-time online algorithm for maximizing the conditional value at risk (CVaR) of a monotone stochastic submodular function. Given $T$ i.i.d. samples from an underlying distribution arriving online, our algorithm produces…

Data Structures and Algorithms · Computer Science 2021-05-21 Tasuku Soma , Yuichi Yoshida

The popular systemic risk measure CoVaR (conditional Value-at-Risk) and its variants are widely used in economics and finance. In this article, we propose joint dynamic forecasting models for the Value-at-Risk (VaR) and CoVaR. The CoVaR…

Econometrics · Economics 2025-01-22 Timo Dimitriadis , Yannick Hoga

The Stochastic Shortest Path (SSP) problem models probabilistic sequential-decision problems where an agent must pursue a goal while minimizing a cost function. Because of the probabilistic dynamics, it is desired to have a cost function…

Artificial Intelligence · Computer Science 2023-03-02 Willy Arthur Silva Reis , Denis Benevolo Pais , Valdinei Freire , Karina Valdivia Delgado
‹ Prev 1 2 3 10 Next ›