English
Related papers

Related papers: Asymptotic Learning Curve and Renormalizable Condi…

200 papers

Linear regression is a classical paradigm in statistics. A new look at it is provided via the lens of universal learning. In applying universal learning to linear regression the hypotheses class represents the label $y\in {\cal R}$ as a…

Machine Learning · Computer Science 2019-11-11 Koby Bibas , Yaniv Fogel , Meir Feder

Contemporary focus on selective inference has renewed interest in the theory of selection models. In this paper, we analyze the asymptotic properties of selection models built on independent and identically distributed observations. We show…

Statistics Theory · Mathematics 2026-03-16 Daniel G. Rasines , G. Alastair Young

Symmetry is a cornerstone of much of mathematics, and many probability distributions possess symmetries characterized by their invariance to a collection of group actions. Thus, many mathematical and statistical methods rely on such…

Statistics Theory · Mathematics 2023-10-23 Adam B Kashlak

Bayesian networks are basic graphical models, used widely both in statistics and artificial intelligence. These statistical models of conditional independence structure are described by acyclic directed graphs whose nodes correspond to…

Optimization and Control · Mathematics 2010-12-01 Raymond Hemmecke , Silvia Lindner , Milan Studený

We consider nonsynchronous sampling of parameterized stochastic regression models, which contain stochastic differential equations. Constructing a quasi-likelihood function, we prove that the quasi-maximum likelihood estimator and the Bayes…

Statistics Theory · Mathematics 2012-12-21 Teppei Ogihara , Nakahiro Yoshida

Hierarchical statistical models are widely employed in information science and data engineering. The models consist of two types of variables: observable variables that represent the given data and latent variables for the unobservable…

Machine Learning · Statistics 2014-02-21 Keisuke Yamazaki

Ordinary Differential Equations (ODEs) have recently gained a lot of attention in machine learning. However, the theoretical aspects, e.g., identifiability and asymptotic properties of statistical estimation are still obscure. This paper…

Machine Learning · Statistics 2024-06-04 Yuanyuan Wang , Wei Huang , Mingming Gong , Xi Geng , Tongliang Liu , Kun Zhang , Dacheng Tao

We study strong universal Bayes-consistency in the realizable setting for learning with general metric losses, extending classical characterizations beyond $0$-$1$ classification (Bousquet et al., 2020; Hanneke et al., 2021) and real-valued…

Machine Learning · Computer Science 2026-05-15 Dan Tsir Cohen , Steve Hanneke , Aryeh Kontorovich

For affine stochastic differential equation with uniformly distributed time delay the local asymptotic properties of the likelihood function are studied. Local asymptotic normality, local asymptotic mixed normality, periodic local…

Statistics Theory · Mathematics 2015-09-10 János Marcell Benke , Gyula Pap

Rerandomization is an effective treatment allocation procedure to control for baseline covariate imbalance. For estimating the average treatment effect, rerandomization has been previously shown to improve the precision of the unadjusted…

Methodology · Statistics 2026-05-18 Bingkai Wang , Fan Li

We study asymptotic behaviors of Bayes type estimators and give sufficient conditions to obtain asymptotic limit distribution of estimation error. We assume polynomial type large deviation inequalities and prove asymptotic equivalence of…

Statistics Theory · Mathematics 2013-12-31 Teppei Ogihara

If the log likelihood is approximately quadratic with constant Hessian, then the maximum likelihood estimator (MLE) is approximately normally distributed. No other assumptions are required. We do not need independent and identically…

Statistics Theory · Mathematics 2012-07-06 Charles J. Geyer

We study the variance and the Laplace transform of the probability law of linear eigenvalue statistics of unitary invariant Matrix Models of n-dimentional Hermitian matrices as n tends to infinity. Assuming that the test function of…

Probability · Mathematics 2015-06-26 L. Pastur

The aim of the paper is to study the limit distributions and the asymptotic behavior of summation arithmetic functions. A probabilistic approach based on the use of the axioms of probability theory is used for these purposes. Sufficient…

Number Theory · Mathematics 2018-04-23 Victor Volfson

This paper deals with some computational aspects in the Bayesian analysis of statistical models with intractable normalizing constants. In the presence of intractable normalizing constants in the likelihood function, traditional MCMC…

Computation · Statistics 2008-04-22 Yves Atchade , Nicolas Lartillot , Christian P. Robert

We consider the estimation of parametric fractional time series models in which not only is the memory parameter unknown, but one may not know whether it lies in the stationary/invertible region or the nonstationary or noninvertible…

Statistics Theory · Mathematics 2012-03-14 Javier Hualde , Peter M. Robinson

We investigate the asymptotic behavior of parametric Bayes estimators under a broad class of loss functions that extend beyond the classical translation-invariant setting. To this end, we develop a unified theoretical framework for loss…

Statistics Theory · Mathematics 2026-03-16 Robin Requadt , Housen Li , Axel Munk

Summation arithmetic functions with asymptotically independent terms are studied in the paper, the limit of which is the law of normal distribution. Assertions about the asymptotic behavior of the indicated functions are proved.

Number Theory · Mathematics 2019-04-17 Victor Volfson

In statistical practice, a realistic Bayesian model for a given data set can be defined by a likelihood function that is analytically or computationally intractable, due to large data sample size, high parameter dimensionality, or complex…

Methodology · Statistics 2019-03-19 George Karabatsos , Fabrizio Leisen

There has been a resurgence of interest in incomplete U-statistics that only sum over a subset of kernel evaluations, due to their computational efficiency and asymptotic normality which can be leveraged to quantify the uncertainty of…

Statistics Theory · Mathematics 2026-01-14 Dennis Leung