English
Related papers

Related papers: A Limit Theorem in Singular Regression Problem

200 papers

In this article we prove a general theorem which establishes the existence of limiting distributions for a wide class of error terms from prime number theory. As a corollary to our main theorem, we deduce previous results of Wintner (1935),…

Number Theory · Mathematics 2013-06-10 Amir Akbary , Nathan Ng , Majid Shahabi

Many machine learning models appear to deploy effortlessly under distribution shift, and perform well on a target distribution that is considerably different from the training distribution. Yet, learning theory of distribution shift bounds…

Machine Learning · Computer Science 2024-05-30 Robi Bhattacharjee , Nick Rittler , Kamalika Chaudhuri

Distinguishing between uniform and non-uniform sample distributions is a common problem in directional data analysis; however for many tests, non-uniform distributions exist that fail uniformity rejection. By merging directional statistics…

Applications · Statistics 2011-08-11 Martin Ehler , Jennifer Galanis

Distributional regression aims at estimating the conditional distribution of a targetvariable given explanatory co-variates. It is a crucial tool for forecasting whena precise uncertainty quantification is required. A popular methodology…

Statistics Theory · Mathematics 2024-11-22 Clément Dombry , Ahmed Zaoui

Given natural parameters s and r, where $2\leq s\leq r$, we consider the distribution of a random variable $\xi=\sum\limits_{k=1}^{\infty}s^{-k}\xi_k\equiv\Delta^{r_s}_{\xi_1\xi_2...\xi_k...},$ where $(\xi_k)$ is a sequence of independent…

Probability · Mathematics 2026-01-06 Mykola Pratsiovytyi , Sofiia Ratushniak

In this work, the probability of an event under some joint distribution is bounded by measuring it with the product of the marginals instead (which is typically easier to analyze) together with a measure of the dependence between the two…

Information Theory · Computer Science 2020-10-22 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

The main result of this paper is a general central limit theorem for distributions defined by certain renewal type equations. We apply this to weakly self-avoiding random walks. We give good error estimates and Gaussian tail estimates which…

Probability · Mathematics 2007-05-23 Erwin Bolthausen , Christine Ritzmann

We show the relationship between the strongly non-linear limit (also termed the dispersionless or the Whitham limit) of the macroscopic fluctuation theory of certain statistical models and the inverse scattering method. We show that in the…

Statistical Mechanics · Physics 2023-08-08 Eldad Bettelheim

The \textit{Central Limit Theorem (CLT)} is at the heart of a great deal of applied problem-solving in statistics and data science, but the theorem is silent on an important implementation issue: \textit{how much data do you need for the…

Other Statistics · Statistics 2021-11-25 David Draper , Erdong Guo

We determine the asymptotic distribution of the sum of correlated variables described by a matrix product ansatz with finite matrices, considering variables with finite variances. In cases when the correlation length is finite, the law of…

Statistical Mechanics · Physics 2014-01-08 Florian Angeletti , Eric Bertin , Patrice Abry

We generalise the Erdos-Renyi limit theorem on the maximum of the partial sums of random variables to the case when the number of terms in these sums is randomly distributed. Certain relations between the limiting theorems of this type and…

Probability · Mathematics 2007-05-23 A. Khorunzhy

Learning machines which have hierarchical structures or hidden variables are singular statistical models because they are nonidentifiable and their Fisher information matrices are singular. In singular statistical models, neither the Bayes…

Machine Learning · Computer Science 2009-05-11 Sumio Watanabe

The angular measure on the unit sphere characterizes the first-order dependence structure of the components of a random vector in extreme regions and is defined in terms of standardized margins. Its statistical recovery is an important step…

Statistics Theory · Mathematics 2022-10-18 Stéphan Clémençon , Hamid Jalalzai , Stéphane Lhaut , Anne Sabourin , Johan Segers

In this paper, we give the explicit bounds for the data of objects involved in some basic theorems of Singularity theory: the Inverse, Implicit and Rank Theorems for Lipschitz mappings, Splitting Lemma and Morse Lemma, the density and…

Numerical Analysis · Mathematics 2012-08-28 Ta Le Loi , Phan Phien

We determine the distributional behavior for products of free random variables in a general infinitesimal triangular array. In the case of positive variables, the main theorem extends a result proved earlier for arrays with identically…

Operator Algebras · Mathematics 2007-05-23 Hari Bercovici , Jiun-Chau Wang

A new information-theoretic approach to the central limit theorem for stable laws is presented. The main novelty is the concept of relative fractional Fisher information, which shares most of the properties of the classical one, included…

Information Theory · Computer Science 2015-04-28 Giuseppe Toscani

Learning under one-sided feedback (i.e., where we only observe the labels for examples we predicted positively on) is a fundamental problem in machine learning -- applications include lending and recommendation systems. Despite this, there…

Machine Learning · Computer Science 2020-10-14 Heinrich Jiang , Qijia Jiang , Aldo Pacchiano

In this article, for a two dimensional fractional diffusion equation, we study an inverse problem for simultaneous restoration of the fractional order and the source term from the sparse boundary measurements. By the adjoint system…

Analysis of PDEs · Mathematics 2020-12-02 Zhiyuan Li , Zhidong Zhang

We discuss a family of time-reversible, scale-invariant diffusions with singular coefficients. In analogy with the standard Gaussian theory, a corresponding family of generalized characteristic functions provides a useful tool for proving…

Probability · Mathematics 2017-09-22 Jeremy T. Clark , Jeffrey H. Schenker

For Bayesian D-optimal design, we define a singular prior distribution for the model parameters as a prior distribution such that the determinant of the Fisher information matrix has a prior geometric mean of zero for all designs. For such…

Methodology · Statistics 2019-08-13 Timothy W. Waite