English
Related papers

Related papers: Optimization under rare events: scaling laws for l…

200 papers

We study the unconstrained minimization of a smooth and strongly convex population loss function under a stochastic oracle that introduces both additive and multiplicative noise; this is a canonical and widely-studied setting that arises…

Optimization and Control · Mathematics 2026-03-27 Liwei Jiang , Ashwin Pananjady

The ability to detect and classify rare occurrences in images has important applications - for example, counting rare and endangered species when studying biodiversity, or detecting infrequent traffic scenarios that pose a danger to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Sara Beery , Yang Liu , Dan Morris , Jim Piavis , Ashish Kapoor , Markus Meister , Neel Joshi , Pietro Perona

Choosing decision variables deterministically (deterministic decision-making) can be regarded as a particular case of choosing decision variables probabilistically (probabilistic decision-making). It is necessary to investigate whether…

Optimization and Control · Mathematics 2023-09-18 Xun Shen , Yuhu Wu , Satoshi Ito , Jun-ichi Imura

Chance constraints are frequently used to limit the probability of constraint violations in real-world optimization problems where the constraints involve stochastic components. We study chance-constrained submodular optimization problems,…

Optimization and Control · Mathematics 2023-09-27 Xiankun Yan , Anh Viet Do , Feng Shi , Xiaoyu Qin , Frank Neumann

The global financial crisis of 2007-2009 highlighted the crucial role systemic risk plays in ensuring stability of financial markets. Accurate assessment of systemic risk would enable regulators to introduce suitable policies to mitigate…

Statistics Theory · Mathematics 2022-03-03 Natalia Nolde , Chen Zhou , Menglin Zhou

Random effect models are popular statistical models for detecting and correcting spurious sample correlations due to hidden confounders in genome-wide gene expression data. In applications where some confounding factors are known,…

Methodology · Statistics 2021-11-08 Muhammad Ammar Malik , Tom Michoel

Online portfolio selection research has so far focused mainly on minimizing regret defined in terms of wealth growth. Practical financial decision making, however, is deeply concerned with both wealth and risk. We consider online learning…

Mathematical Finance · Quantitative Finance 2017-05-30 Guy Uziel , Ran El-Yaniv

Robust estimators for linear regression require non-convex objective functions to shield against adverse affects of outliers. This non-convexity brings challenges, particularly when combined with penalization in high-dimensional settings.…

Computation · Statistics 2025-08-08 David Kepplinger , Siqi Wei

The use of expectiles in risk management has recently gathered remarkable momentum due to their excellent axiomatic and probabilistic properties. In particular, the class of elicitable law-invariant coherent risk measures only consists of…

Statistics Theory · Mathematics 2023-03-21 Abdelaati Daouia , Simone A. Padoan , Gilles Stupfler

Mass violence, almost no matter how defined, is (thankfully) rare. Rare events are very difficult to study in a systematic manner. Standard statistical procedures can fail badly and usefully accurate forecasts of rare events often are…

Applications · Statistics 2019-03-05 Richard A. Berk , Susan B. Sorenson

The ability to make optimal decisions under uncertainty remains important across a variety of disciplines from portfolio management to power engineering. This generally implies applying some safety margins on uncertain parameters that may…

Systems and Control · Electrical Eng. & Systems 2020-03-05 Matt Roveto , Robert Mieth , Yury Dvorkin

We prove a large deviation principle for the sum of n independent heavy-tailed random variables, which are subject to a moving cut-off boundary at location n. Conditional on the sum being large at scale n, we show that a finite number of…

Probability · Mathematics 2024-12-17 Céline Kerriou , Peter Mörters

We account for time-varying parameters in the conditional expectile-based value at risk (EVaR) model. The EVaR downside risk is more sensitive to the magnitude of portfolio losses compared to the quantile-based value at risk (QVaR). Rather…

Statistical Finance · Quantitative Finance 2020-09-29 Xiu Xu , Andrija Mihoci , Wolfgang Karl Härdle

This work investigates the finite-horizon optimal covariance steering problem for discrete-time linear systems subject to both additive and multiplicative uncertainties as well as state and input chance constraints. In particular, a…

Optimization and Control · Mathematics 2023-01-19 Jacob Knaup , Panagiotis Tsiotras

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

Machine Learning · Computer Science 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

In this paper a method based on a Markov chain Monte Carlo (MCMC) algorithm is proposed to compute the probability of a rare event. The conditional distribution of the underlying process given that the rare event occurs has the probability…

Probability · Mathematics 2012-11-12 Thorbjörn Gudmundsson , Henrik Hult

We propose and compare methods for the analysis of extreme events in complex systems governed by PDEs that involve random parameters, in situations where we are interested in quantifying the probability that a scalar function of the…

Optimization and Control · Mathematics 2025-08-12 Shanyin Tong , Eric Vanden-Eijnden , Georg Stadler

The geology of oil reservoirs is largely unknown. Consequently, the reservoir models used for production optimization are subject to significant uncertainty. To minimize the associated risk, the oil literature has mainly used ensemble-based…

Optimization and Control · Mathematics 2018-01-03 Andrea Capolei , Lasse Hjuler Christiansen , John Bagterp Jørgensen

Distributional reinforcement learning (RL) -- in which agents learn about all the possible long-term consequences of their actions, and not just the expected value -- is of great recent interest. One of the most important affordances of a…

Artificial Intelligence · Computer Science 2021-11-15 Chris Gagne , Peter Dayan

We study the optimal sample complexity of variable selection in linear regression under general design covariance, and show that subset selection is optimal while under standard complexity assumptions, efficient algorithms for this problem…

Statistics Theory · Mathematics 2025-10-07 Ming Gao , Bryon Aragam