English
Related papers

Related papers: On Goodhart's law, with an application to value al…

200 papers

We present a limited empirical study of scaling laws for transfer learning in transformer models. More specifically, we examine a scaling law that incorporates a "transfer gap" term, indicating the effectiveness of pre-training on one…

Machine Learning · Computer Science 2024-09-02 Matthew Barnett

There are many ways of measuring and modeling tail-dependence in random vectors: from the general framework of multivariate regular variation and the flexible class of max-stable vectors down to simple and concise summary measures like the…

Probability · Mathematics 2022-12-05 Anja Janßen , Sebastian Neblung , Stilian Stoev

Heavy-tailed distributions are found throughout many naturally occurring phenomena. We have reviewed the models of stochastic dynamics that lead to heavy-tailed distributions (and power law distributions, in particular) including the…

Mathematical Physics · Physics 2011-05-09 Ph. Blanchard , T. Krueger , D. Volchenkov

The existence of large and extreme claims of a non-life insurance portfolio influences the ability of (re)insurers to estimate the reserve. The excess over-threshold method provides a way to capture and model the typical behaviour of…

Applications · Statistics 2019-11-07 Yinzhi Wang , Ingrid Hobæk Haff , Arne Huseby

We consider heavy-tailed distributions and compare the well-known estimators of the tail index, based on extreme value theory with a comparatively recent estimator based on a different idea.

Probability · Mathematics 2016-08-14 Vygantas Paulauskas , Marijus Vaičiulis

Test-time scaling has emerged as a critical avenue for enhancing the reasoning capabilities of Large Language Models (LLMs). Though the straight-forward ''best-of-$N$'' (BoN) strategy has already demonstrated significant improvements in…

Machine Learning · Computer Science 2026-02-03 Muheng Li , Jian Qian , Wenlong Mou

What does it mean to say that, for example, the probability for rain tomorrow is between 20% and 30%? The theory for the evaluation of precise probabilistic forecasts is well-developed and is grounded in the key concepts of proper scoring…

Machine Learning · Computer Science 2024-10-31 Christian Fröhlich , Robert C. Williamson

Kuiper's statistic is a good measure for the difference of ideal distribution and empirical distribution in the goodness-of-fit test. However, it is a challenging problem to solve the critical value and upper tail quantile, or simply Kuiper…

Computation · Statistics 2024-03-26 Hong-Yan Zhang , Wei Sun , Xiao Chen , Rui-Jia Lin , Yu Zhou

The study of tail behaviour of SGD-induced processes has been attracting a lot of interest, due to offering strong guarantees with respect to individual runs of an algorithm. While many works provide high-probability guarantees, quantifying…

Machine Learning · Computer Science 2026-02-06 Aleksandar Armacki , Dragana Bajović , Dušan Jakovetić , Soummya Kar , Ali H. Sayed

This work studies the systematic organization of higher-order gravitational quadrupole tails using generalized unitarity methods imported from the study of scattering amplitudes. The first major result is a constructive algorithm for…

High Energy Physics - Theory · Physics 2024-09-27 Alex Edison

Heavy tailed phenomena are naturally analyzed by extreme value statistics. A crucial step in such an analysis is the estimation of the extreme value index, which describes the tail heaviness of the underlying probability distribution. We…

Statistics Theory · Mathematics 2018-07-18 Hanan Ahmed , John H. J. Einmahl

In this work, we study the convergence \emph{in high probability} of clipped gradient methods when the noise distribution has heavy tails, ie., with bounded $p$th moments, for some $1<p\le2$. Prior works in this setting follow the same…

Optimization and Control · Mathematics 2023-04-05 Ta Duy Nguyen , Alina Ene , Huy L. Nguyen

When performing imitation learning from expert demonstrations, distribution matching is a popular approach, in which one alternates between estimating distribution ratios and then using these ratios as rewards in a standard reinforcement…

Machine Learning · Computer Science 2019-12-12 Ilya Kostrikov , Ofir Nachum , Jonathan Tompson

Preferential attachment is widely used to model power-law behavior of degree distributions in both directed and undirected networks. In a directed preferential attachment model, despite the well-known marginal power-law degree…

Probability · Mathematics 2018-08-07 Tiandong Wang , Sidney I. Resnick

A particular direction of recent advance about stochastic deep-learning algorithms has been about uncovering a rather mysterious heavy-tailed nature of the stationary distribution of these algorithms, even when the data distribution is not…

Machine Learning · Computer Science 2022-04-28 Sayar Karmakar , Anirbit Mukherjee

This paper bridges some of the gap between optimal planning and reinforcement learning (RL), both of which share roots in dynamic programming applied to sequential decision making or optimal control. Whereas planning typically favors…

Robotics · Computer Science 2026-03-10 Filip V. Georgiev , Kalle G. Timperi , Başak Sakçak , Steven M. LaValle

The task for a general and useful classification of the tail behaviors of probability distributions still has no satisfactory solution. Due to lack of information outside the range of the data the tails of the distribution should be…

Probability · Mathematics 2019-07-23 Pavlina Jordanova

Map generalization is a process of producing maps at different levels of detail by retaining essential properties of the underlying geographic space. In this paper, we explore how the map generalization process can be guided by the…

Data Analysis, Statistics and Probability · Physics 2013-10-22 Bin Jiang , Xintao Liu , Tao Jia

The total number of fatalities of an epidemic outbreak is a dramatic but extremely informative quantity. Knowledge of the statistics of this quantity allows the calculation of the mean total number of fatalities conditioned to the fact that…

Physics and Society · Physics 2024-03-06 Alvaro Corral

The tail index, indicating the degree of fatness of the tail distribution, is an important component of extreme value theory since it dominates the asymptotic distribution of extreme values such as the sample maximum. In this paper, we…

Statistics Theory · Mathematics 2009-06-12 Moosup Kim , Sangyeol Lee