English
Related papers

Related papers: Optimization under rare events: scaling laws for l…

200 papers

Modern statistical analyses often encounter datasets with massive sizes and heavy-tailed distributions. For datasets with massive sizes, traditional estimation methods can hardly be used to estimate the extreme value index directly. To…

Methodology · Statistics 2022-07-26 Yongxin Li , Liujun Chen , Deyuan Li , Hansheng Wang

We study rare events in the extreme value statistics of stochastic symmetric jump processes with power tails in the distributions of the jumps, using the big-jump principle. The principle states that in the presence of stochastic processes…

Statistical Mechanics · Physics 2024-09-04 Alberto Bassanoni , Alessandro Vezzani , Raffaella Burioni

We develop a variant of the stochastic prox-linear method for minimizing the Conditional Value-at-Risk (CVaR) objective. CVaR is a risk measure focused on minimizing worst-case performance, defined as the average of the top quantile of the…

Optimization and Control · Mathematics 2023-05-30 Si Yi Meng , Robert M. Gower

Chance constrained optimization problems allow to model problems where constraints involving stochastic components should only be violated with a small probability. Evolutionary algorithms have been applied to this scenario and shown to…

Neural and Evolutionary Computing · Computer Science 2024-08-23 Frank Neumann , Carsten Witt

We present the conditional value-at-risk (CVaR) in the context of Markov chains and Markov decision processes with reachability and mean-payoff objectives. CVaR quantifies risk by means of the expectation of the worst p-quantile. As such it…

Logic in Computer Science · Computer Science 2018-05-09 Jan Křetínský , Tobias Meggendorfer

Optimal portfolio allocation is often formulated as a constrained risk problem, where one aims to minimize a risk measure subject to some performance constraints. This paper presents new Bayesian Optimization algorithms for such constrained…

Portfolio Management · Quantitative Finance 2025-03-25 Robert Millar , Jinglai Li

We propose an adaptive importance sampling scheme for the simulation of rare events when the underlying dynamics is given by a diffusion. The scheme is based on a Gibbs variational principle that is used to determine the optimal (i.e.…

Probability · Mathematics 2019-07-24 Carsten Hartmann , Omar Kebiri , Lara Neureither , Lorenz Richter

In this paper a class of single machine scheduling problems is considered. It is assumed that job processing times and due dates can be uncertain and they are specified in the form of discrete scenario set. A probability distribution in the…

Data Structures and Algorithms · Computer Science 2017-12-12 Adam Kasperski , Pawel Zielinski

We provide some asymptotic theory for the largest eigenvalues of a sample covariance matrix of a p-dimensional time series where the dimension p = p_n converges to infinity when the sample size n increases. We give a short overview of the…

Statistics Theory · Mathematics 2016-04-27 Richard Davis , Johannes Heiny , Thomas Mikosch , Xiaolei Xie

We propose a class of strongly efficient rare event simulation estimators for random walks and compound Poisson processes with a regularly varying increment/jump-size distribution in a general large deviations regime. Our estimator is based…

Probability · Mathematics 2017-06-14 Bohan Chen , Jose Blanchet , Chang-Han Rhee , Bert Zwart

Many modern machine learning tasks require models with high tail performance, i.e. high performance over the worst-off samples in the dataset. This problem has been widely studied in fields such as algorithmic fairness, class imbalance, and…

Machine Learning · Computer Science 2021-11-11 Runtian Zhai , Chen Dan , Arun Sai Suggala , Zico Kolter , Pradeep Ravikumar

In several real-world applications involving decision making under uncertainty, the traditional expected value objective may not be suitable, as it may be necessary to control losses in the case of a rare but extreme event. Conditional…

Machine Learning · Computer Science 2018-08-07 Ravi Kumar Kolla , Prashanth L. A. , Sanjay P. Bhat , Krishna Jagannathan

In this work, we tackle the problem of minimising the Conditional-Value-at-Risk (CVaR) of output quantities of complex differential models with random input data, using gradient-based approaches in combination with the Multi-Level Monte…

Numerical Analysis · Mathematics 2023-10-16 Sundar Ganesh , Fabio Nobile

Training compute is increasingly outpacing the availability of high-quality data. This shifts the central challenge from optimal compute allocation to extracting maximum value from limited data. The widely adopted Chinchilla scaling law…

Machine Learning · Computer Science 2026-05-05 Justin Lovelace , Christian Belardi , Srivatsa Kundurthy , Shriya Sudhakar , Kilian Q. Weinberger

Extremal quantile regression, i.e. quantile regression applied to the tails of the conditional distribution, counts with an increasing number of economic and financial applications such as value-at-risk, production frontiers, determinants…

Methodology · Statistics 2022-01-24 Victor Chernozhukov , Iván Fernández-Val , Tetsuya Kaji

High-dimensional time series data appear in many scientific areas in the current data-rich environment. Analysis of such data poses new challenges to data analysts because of not only the complicated dynamic dependence between the series,…

Methodology · Statistics 2022-06-22 Di Wang , Ruey S. Tsay

We study a linear-quadratic, optimal control problem on a discrete, finite time horizon with distributional ambiguity, in which the cost is assessed via Conditional Value-at-Risk (CVaR). We take steps toward deriving a scalable dynamic…

Systems and Control · Electrical Eng. & Systems 2022-06-28 Margaret P. Chapman , Laurent Lessard

This paper studies the use of a machine learning-based estimator as a control variate for mitigating the variance of Monte Carlo sampling. Specifically, we seek to uncover the key factors that influence the efficiency of control variates in…

Statistics Theory · Mathematics 2023-05-29 Jose Blanchet , Haoxuan Chen , Yiping Lu , Lexing Ying

Predictions of the uncertainty associated with extreme events are a vital component of any prediction system for such events. Consequently, the prediction system ought to be probabilistic in nature, with the predictions taking the form of…

Applications · Statistics 2012-10-26 Petra Friederichs , Thordis L. Thorarinsdottir

For statistics of rare events in systems obeying a large-deviation principle, the rate function is a key quantity. When numerically estimating the rate function one is always restricted to finite system sizes. Thus, if the interest is in…

Data Analysis, Statistics and Probability · Physics 2024-12-06 Peter Werner , Alexander K. Hartmann
‹ Prev 1 4 5 6 7 8 10 Next ›