English
Related papers

Related papers: Optimization under rare events: scaling laws for l…

200 papers

Optimizing static risk-averse objectives in Markov decision processes is difficult because they do not admit standard dynamic programming equations common in Reinforcement Learning (RL) algorithms. Dynamic programming decompositions that…

Optimization and Control · Mathematics 2024-07-04 Jia Lin Hau , Erick Delage , Mohammad Ghavamzadeh , Marek Petrik

Rare weather and climate events, such as heat waves and floods, can bring tremendous social costs. Climate data is often limited in duration and spatial coverage, and climate forecasting has often turned to simulations of climate models to…

Methodology · Statistics 2020-05-18 Meagan Carney , Holger Kantz , Matthew Nicol

Optimizing Conditional Value-at-risk (CVaR) using policy gradient (a.k.a CVaR-PG) faces significant challenges of sample inefficiency. This inefficiency stems from the fact that it focuses on tail-end performance and overlooks many sampled…

Machine Learning · Computer Science 2026-02-06 Yudong Luo , Erick Delage

Rare events are events that are expected to occur infrequently, or more technically, those that have low probabilities (say, order of $10^{-3}$ or less) of occurring according to a probability model. In the context of uncertainty…

Computation · Statistics 2015-08-21 James L. Beck , Konstantin M. Zuev

The object of this paper is twofold. From one side we study the dichotomy, in terms of the Extremal Index of the possible Extreme Value Laws, when the rare events are centred around periodic or non periodic points. Then we build a general…

Dynamical Systems · Mathematics 2016-03-24 Hale Aytaç , Jorge Milhazes Freitas , Sandro Vaienti

In this paper we consider the extreme behavior of the extremal eigenvalues of white Wishart matrices, which plays an important role in multivariate analysis. In particular, we focus on the case when the dimension of the feature p is much…

Probability · Mathematics 2016-07-27 Tiefeng Jiang , Kevin Leder , Gongjun Xu

We develop and generalize the theory of extreme value for non-stationary stochastic processes, mostly by weakening the uniform mixing condition that was previously used in this setting. We apply our results to non-autonomous dynamical…

Dynamical Systems · Mathematics 2017-06-27 Ana Cristina Moreira Freitas , Jorge Milhazes Freitas , Sandro Vaienti

Minimizing volatility and adjustment costs is of central importance in many economic environments, yet it is often complicated by evolving feasibility constraints. We study a decision maker who repeatedly selects an action from a…

Theoretical Economics · Economics 2026-02-18 Simon Jantschgi , Heinrich H. Nax , Bary S. R. Pradelski , Marek Pycia

This paper studies distributionally robust chance constrained programs (DRCCPs), where the uncertain constraints must be satisfied with at least a probability of a prespecified threshold for all probability distributions from the…

Optimization and Control · Mathematics 2023-02-06 Nan Jiang , Weijun Xie

We develop an approach to risk minimization and stochastic optimization that provides a convex surrogate for variance, allowing near-optimal and computationally efficient trading between approximation and estimation error. Our approach…

Machine Learning · Statistics 2017-12-15 John Duchi , Hongseok Namkoong

Although the fundamental probabilistic theory of extremes has been well developed, there are many practical considerations that must be addressed in application. The contribution of this thesis is four-fold. The first concerns the choice of…

Methodology · Statistics 2016-11-28 Brian Bader

This paper deals with the scenario approach to robust optimization. This relies on a random sampling of the possibly infinite number of constraints induced by uncertainties in the parameters of an optimization problem. Solving the resulting…

Optimization and Control · Mathematics 2023-03-08 Fabien Lauer

We study the problem of resource provisioning under stringent reliability or service level requirements, which arise in applications such as power distribution, emergency response, cloud server provisioning, and regulatory risk management.…

Optimization and Control · Mathematics 2025-04-11 Anand Deo , Karthyek Murthy

We explore past and recent developments in rare-event probability estimation with a particular focus on a novel Monte Carlo technique Empirical Likelihood Maximization (ELM). This is a versatile method that involves sampling from a sequence…

Computation · Statistics 2013-12-12 A. Huang , Z. I. Botev

In this paper we address the problem of rare-event simulation for heavy-tailed L\'evy processes with infinite activities. We propose a strongly efficient importance sampling algorithm that builds upon the sample path large deviations for…

Probability · Mathematics 2020-07-17 Xingyu Wang , Chang-Han Rhee

An overview of rare events algorithms based on large deviation theory (LDT) is presented. It covers a range of numerical schemes to compute the large deviation minimizer in various setups, and discusses best practices, common pitfalls, and…

Statistical Mechanics · Physics 2019-07-24 Tobias Grafke , Eric Vanden-Eijnden

In many complex systems, large events are believed to follow power-law, scale-free probability distributions, so that the extreme, catastrophic events are unpredictable. Here, we study coupled chaotic oscillators that display extreme…

Conventional methods for extreme event estimation rely on well-chosen parametric models asymptotically justified from extreme value theory (EVT). These methods, while powerful and theoretically grounded, could however encounter a difficult…

Methodology · Statistics 2023-01-05 Yuanlu Bai , Henry Lam , Xinyu Zhang

Threshold selection plays a key role for various aspects of statistical inference of rare events. Most classical approaches tackling this problem for heavy-tailed distributions crucially depend on tuning parameters or critical values to be…

Methodology · Statistics 2019-03-07 Laura Fee Schneider , Andrea Krajina , Tatyana Krivobokova

In many sequential decision-making problems we may want to manage risk by minimizing some measure of variability in costs in addition to minimizing a standard criterion. Conditional value-at-risk (CVaR) is a relatively new risk measure that…

Artificial Intelligence · Computer Science 2014-07-14 Yinlam Chow , Mohammad Ghavamzadeh