English
Related papers

Related papers: Risk-Sensitive Markov Decision Processes with Long…

200 papers

We consider an optimal investment and risk control problem for an insurer under the mean-variance (MV) criterion. By introducing a deterministic auxiliary process defined forward in time, we formulate an alternative time-consistent problem…

Portfolio Management · Quantitative Finance 2021-01-12 Yang Shen , Bin Zou

Conditional value-at-risk (CVaR) precisely characterizes the influence that rare, catastrophic events can exert over decisions. Such characterizations are important for both normal decision-making and for psychiatric conditions such as…

Artificial Intelligence · Computer Science 2021-11-15 Chris Gagne , Peter Dayan

Markov decision processes (MDPs) are standard models for probabilistic systems with non-deterministic behaviours. Long-run average rewards provide a mathematically elegant formalism for expressing long term performance. Value iteration (VI)…

Systems and Control · Computer Science 2017-09-01 Pranav Ashok , Krishnendu Chatterjee , Przemyslaw Daca , Jan Křetínský , Tobias Meggendorfer

Cumulative prospect theory (CPT) is the first theory for decision-making under uncertainty that combines full theoretical soundness and empirically realistic features [P.P. Wakker - Prospect theory: For risk and ambiguity, Page 2]. While…

Logic in Computer Science · Computer Science 2025-05-15 Thomas Brihaye , Krishnendu Chatterjee , Stefanie Mohr , Maximilian Weininger

This paper studies the remote estimation of multiple Markov sources over a lossy and rate-constrained channel. Unlike most existing studies that treat all source states equally, we exploit the \emph{semantics of information} and consider…

Systems and Control · Electrical Eng. & Systems 2025-05-22 Jiping Luo , Nikolaos Pappas

Real-time coordination of distributed energy resources (DERs) is crucial for regulating the voltage profile in distribution grids. By capitalizing on a scalable neural network (NN) architecture, one can attain decentralized DER decisions to…

Machine Learning · Computer Science 2022-04-20 Shanny Lin , Shaohui Liu , Hao Zhu

In this work we want to provide a general principle to evaluate the CVA (Credit Value Adjustment) for a vulnerable option, that is an option subject to some default event, concerning the solvability of the issuer. CVA is needed to evaluate…

Computational Finance · Quantitative Finance 2019-07-31 Elisa Alos , Fabio Antonelli , Alessandro Ramponi , Sergio Scarlatti

In this paper, a new way to integrate volatility information for estimating value at risk (VaR) and conditional value at risk (CVaR) of a portfolio is suggested. The new method is developed from the perspective of Bayesian statistics and it…

Risk Management · Quantitative Finance 2022-05-04 Taras Bodnar , Vilhelm Niklasson , Erik Thorsén

The aim of this paper is to investigate risk-averse and distributionally robust modeling of Stochastic Optimal Control (SOC) and Markov Decision Process (MDP). We discuss construction of conditional nested risk functionals, a particular…

Optimization and Control · Mathematics 2025-05-23 Alexander Shapiro , Yan Li

Though deep reinforcement learning (DRL) has obtained substantial success, it may encounter catastrophic failures due to the intrinsic uncertainty of both transition and observation. Most of the existing methods for safe reinforcement…

Machine Learning · Computer Science 2025-05-20 Chengyang Ying , Xinning Zhou , Hang Su , Dong Yan , Ning Chen , Jun Zhu

In robotic planetary surface exploration, strategic mobility planning is an important task that involves finding candidate long-distance routes on orbital maps and identifying segments with uncertain traversability. Then, expert human…

Robotics · Computer Science 2026-05-08 Olivier Lamarre , Jonathan Kelly

This paper presents a new method to assess default risk based on applying the CEV process to the KMV model. We find that the volatility of the firm asset value may not be a constant, so we assume the firm's asset value dynamics are given by…

Risk Management · Quantitative Finance 2022-05-23 Wen Su

This paper addresses allocation methodologies for a risk measure inherited from ruin theory. Specifically, we consider a dynamic value-at-risk (VaR) measure defined as the smallest initial capital needed to ensure that the ultimate ruin…

Mathematical Finance · Quantitative Finance 2021-03-31 Guusje Delsing , Michel Mandjes , Peter Spreij , Erik Winands

Credit Valuation Adjustment (CVA) pricing models need to be both flexible and tractable. The survival probability has to be known in closed form (for calibration purposes), the model should be able to fit any valid Credit Default Swap (CDS)…

Mathematical Finance · Quantitative Finance 2018-01-18 Cheikh Mbaye , Frédéric Vrins

This paper proposes control approaches for discrete-time linear systems subject to stochastic disturbances. It employs Kalman filter to estimate the mean and covariance of the state propagation, and the worst-case conditional value-at-risk…

Optimization and Control · Mathematics 2024-12-20 Masako Kishida

Predicting future values at risk (fVaR) is an important problem in finance. They arise in the modelling of future initial margin requirements for counterparty credit risk and future market risk VaR. One is also interested in derived…

Computational Finance · Quantitative Finance 2021-04-27 Narayan Ganesan , Bernhard Hientzsch

Whereas classical Markov decision processes maximize the expected reward, we consider minimizing the risk. We propose to evaluate the risk associated to a given policy over a long-enough time horizon with the help of a central limit…

Optimization and Control · Mathematics 2015-12-03 Pengqian Yu , Jia Yuan Yu , Huan Xu

We introduce and study constrained Markov Decision Processes (cMDPs) with anytime constraints. An anytime constraint requires the agent to never violate its budget at any point in time, almost surely. Although Markovian policies are no…

Machine Learning · Computer Science 2024-06-14 Jeremy McMahan , Xiaojin Zhu

A classic reachability problem for safety of dynamic systems is to compute the set of initial states from which the state trajectory is guaranteed to stay inside a given constraint set over a given time horizon. In this paper, we leverage…

A novel optimisation framework through quadratic nonlinear projection is introduced for credit portfolio when the portfolio risk is measured by Conditional Value-at-Risk (CVaR). The whole optimisation procedure to search toward the optimal…

Portfolio Management · Quantitative Finance 2016-07-20 Boguk Kim , Chulwoo Han , Frank Chongwoo Park