English
Related papers

Related papers: Iterated risk measures for risk-sensitive Markov d…

200 papers

Euclidean Markov decision processes are a powerful tool for modeling control problems under uncertainty over continuous domains. Finite state imprecise, Markov decision processes can be used to approximate the behavior of these infinite…

Artificial Intelligence · Computer Science 2020-06-29 Manfred Jaeger , Giorgio Bacci , Giovanni Bacci , Kim Guldstrand Larsen , Peter Gjøl Jensen

Protecting against cyber-threats is vital for every organization and can be done by investing in cybersecurity controls and purchasing cyber insurance. However, these are interlinked since insurance premiums could be reduced by investing…

Econometrics · Economics 2024-12-02 Chaitanya Joshi , Jinming Yang , Sergeja Slapnicar , Ryan K L Ko

Markov decision processes (MDPs) are standard models for probabilistic systems with non-deterministic behaviours. Long-run average rewards provide a mathematically elegant formalism for expressing long term performance. Value iteration (VI)…

Systems and Control · Computer Science 2017-09-01 Pranav Ashok , Krishnendu Chatterjee , Przemyslaw Daca , Jan Křetínský , Tobias Meggendorfer

Ergodicity describes an equivalence between the expectation value and the time average of observables. Applied to human behaviour, ergodic theories of decision-making reveal how individuals should tolerate risk in different environments. To…

Consider an investor trading dynamically to maximize expected utility from terminal wealth. Our aim is to study the dependence between her risk aversion and the distribution of the optimal terminal payoff. Economic intuition suggests that…

General Finance · Quantitative Finance 2011-09-15 Mathias Beiglboeck , Johannes Muhle-Karbe , Johannes Temme

Spectral risk measures are attractive risk measures as they allow the user to obtain risk measures that reflect their subjective risk-aversion. This paper examines spectral risk measures based on an exponential utility function, and finds…

Risk Management · Quantitative Finance 2011-03-29 Kevin Dowd , John Cotter

Perfectly rational decision-makers maximize expected utility, but crucially ignore the resource costs incurred when determining optimal actions. Here we employ an axiomatic framework for bounded rational decision-making based on a…

Artificial Intelligence · Computer Science 2011-07-29 Pedro A. Ortega , Daniel A. Braun

Distributional reinforcement learning (RL) is a powerful framework increasingly adopted in safety-critical domains for its ability to optimize risk-sensitive objectives. However, the role of the discount factor is often overlooked, as it is…

Machine Learning · Computer Science 2026-02-05 Mehrdad Moghimi , Anthony Coache , Hyejin Ku

We consider a setting where an agent's uncertainty is represented by a set of probability measures, rather than a single measure. Measure-by-measure updating of such a set of measures upon acquiring new information is well-known to suffer…

Computer Science and Game Theory · Computer Science 2016-11-04 Joseph Y. Halpern , Samantha Leung

We introduce an equilibrium asset pricing model, which we build on the relationship between a novel risk measure, the Expected Downside Risk (EDR) and the expected return. On the one hand, our proposed risk measure uses a nonparametric…

Pricing of Securities · Quantitative Finance 2015-12-08 Mihaly Ormos , Dusan Timotity

In many practical sequential decision-making problems, tracking the state of the environment incurs a sensing/communication/computation cost. In these settings, the agent's interaction with its environment includes the additional component…

Machine Learning · Computer Science 2026-04-16 Vansh Kapoor , Jayakrishnan Nair

Decision-making pipelines are generally characterized by tradeoffs among various risk functions. It is often desirable to manage such tradeoffs in a data-adaptive manner. As we demonstrate, if this is done naively, state-of-the art…

We study intertemporal decision making under uncertainty. We fully characterize discounted expected utility in a framework \`a la Savage. Despite the popularity of this model, no characterization is available in this setting. The concept of…

Theoretical Economics · Economics 2020-03-13 Lorenzo Bastianello , José Heleno Faro

Risk aversion is a key element of utility maximizing hedge strategies; however, it has typically been assigned an arbitrary value in the literature. This paper instead applies a GARCH-in-Mean (GARCH-M) model to estimate a time-varying…

Risk Management · Quantitative Finance 2011-03-31 John Cotter , Jim Hanly

In several applications such as clinical trials and financial portfolio optimization, the expected value (or the average reward) does not satisfactorily capture the merits of a drug or a portfolio. In such applications, risk plays a crucial…

Machine Learning · Statistics 2022-05-13 Vincent Y. F. Tan , Prashanth L. A. , Krishna Jagannathan

I model a rational agent who experiences endogenous deadline pressure in the face of a fixed future deadline. The agent holds a resource stock, and opportunities to spend resources arise randomly according to a Poisson process. When the…

Theoretical Economics · Economics 2025-09-10 Conrad Kosowsky

We consider the discretized Bachelier model where hedging is done on an equidistant set of times. Exponential utility indifference prices are studied for path-dependent European options and we compute their non-trivial scaling limit for a…

Probability · Mathematics 2022-03-03 Asaf Cohen , Yan Dolinsky

We propose a novel approach to infer investors' risk preferences from their portfolio choices, and then use the implied risk preferences to measure the efficiency of investment portfolios. We analyze a dataset spanning a period of six…

Portfolio Management · Quantitative Finance 2020-10-28 Agostino Capponi , Zhaoyu Zhang

Systemic risk refers to the risk that the financial system is susceptible to failures due to the characteristics of the system itself. The tremendous cost of systemic risk requires the design and implementation of tools for the efficient…

Risk Management · Quantitative Finance 2021-04-06 Zachary Feinstein , Birgit Rudloff , Stefan Weber

Subjective expected utility theory assumes that decision-makers possess unlimited computational resources to reason about their choices; however, virtually all decisions in everyday life are made under resource constraints - i.e.…

Machine Learning · Statistics 2016-10-07 Pedro A. Ortega , Alan A. Stocker