English
Related papers

Related papers: Higher-order asymptotics for the parametric comple…

200 papers

The Minimum Description Length (MDL) principle states that the optimal model for a given data set is that which compresses it best. Due to practial limitations the model can be restricted to a class such as linear regression models, which…

Machine Learning · Statistics 2015-03-13 Florin Popescu , Daniel Renz

Suppose one has a collection of parameters indexed by a (possibly infinite dimensional) set. Given data generated from some distribution, the objective is to estimate the maximal parameter in this collection evaluated at this distribution.…

Methodology · Statistics 2016-05-26 Alexander R. Luedtke , Mark J. van der Laan

The problem of defining and studying complexity of a time series has interested people for years. In the context of dynamical systems, Grassberger has suggested that a slow approach of the entropy to its extensive asymptotic limit is a sign…

Data Analysis, Statistics and Probability · Physics 2009-11-07 William Bialek , Ilya Nemenman , Naftali Tishby

We characterize the algorithmic dimensions (i.e., the lower and upper asymptotic densities of information) of infinite binary sequences in terms of the inability of learning functions having an algorithmic constraint to detect patterns in…

Information Theory · Computer Science 2024-07-03 Jack H. Lutz , Andrei N. Migunov

Datasets from the fields of bioinformatics, chemometrics, and face recognition are typically characterized by small samples of high-dimensional data. Among the many variants of linear discriminant analysis that have been proposed in order…

Machine Learning · Statistics 2020-04-20 Lama B. Niyazi , Abla Kammoun , Hayssam Dahrouj , Mohamed-Slim Alouini , Tareq Y. Al-Naffouri

This paper establishes expectation and variance asymptotics for statistics of the Poisson--Voronoi approximation of general sets, as the underlying intensity of the Poisson point process tends to infinity. Statistics of interest include…

Probability · Mathematics 2016-06-24 Christoph Thäle , J. E. Yukich

The density weighted average derivative (DWAD) of a regression function is a canonical parameter of interest in economics. Classical first-order large sample distribution theory for kernel-based DWAD estimators relies on tuning parameter…

Econometrics · Economics 2024-02-16 Matias D. Cattaneo , Max H. Farrell , Michael Jansson , Ricardo Masini

Motivated by numerical methods for solving parametric partial differential equations, this paper studies the approximation of multivariate analytic functions by algebraic polynomials. We introduce various anisotropic model classes based on…

Numerical Analysis · Mathematics 2020-01-17 Andrea Bonito , Ronald DeVore , Diane Guignard , Peter Jantsch , Guergana Petrova

This paper deals with the asymptotic statistical properties of a class of redescending M-estimators in linear models with increasing dimension. This class is wide enough to include popular high breakdown point estimators such as…

Statistics Theory · Mathematics 2016-12-20 Ezequiel Smucler

In this paper, we present a high-order expansion for elliptic equations in high-contrast media. The background conductivity is taken to be one and we assume the medium contains high (or low) conductivity inclusions. We derive an asymptotic…

Analysis of PDEs · Mathematics 2014-01-28 Victor M. Calo , Yalchin Efendiev , Juan Galvis

Classical Fisher-information asymptotics describe the covariance of regular efficient estimators through the local quadratic approximation of the log-likelihood, and thus capture first-order geometry only. In curved models, including…

Statistics Theory · Mathematics 2026-04-15 Malik Amir , Sourangshu Ghosh

Parametric high-dimensional regression analysis requires the usage of regularization terms to get interpretable models. The respective estimators can be regarded as regularized M-functionals which are naturally highly nonlinear. We study…

Statistics Theory · Mathematics 2019-09-04 Tino Werner

We derive high-order terms in the asymptotic expansions of the steady-state voltage potentials in the presence of a finite number of diametrically small inhomogeneities with conductivities different from the background conductivity. Our…

Mathematical Physics · Physics 2007-05-23 Habib Ammari , Hyeonbae Kang

Asymptotic expansions are derived for Gegenbauer (ultraspherical) polynomials for large order $n$ that are uniformly valid for unbounded complex values of the argument $z$, including the real interval $0 \leq z \leq 1$ in which the zeros in…

Classical Analysis and ODEs · Mathematics 2025-07-04 T. M. Dunster

In contrast to the advances in characterizing the sample complexity for solving Markov decision processes (MDPs), the optimal statistical complexity for solving constrained MDPs (CMDPs) remains unknown. We resolve this question by providing…

Machine Learning · Computer Science 2022-11-22 Sharan Vaswani , Lin F. Yang , Csaba Szepesvári

We derive a nonparametric higher-order asymptotic expansion for small-time changes of conditional characteristic functions of It\^o semimartingale increments. The asymptotics setup is of joint type: both the length of the time interval of…

Statistical Finance · Quantitative Finance 2025-02-12 Carsten H. Chong , Viktor Todorov

High-resolution simulations of particle-based kinetic plasma models typically require a high number of particles and thus often become computationally intractable. This is exacerbated in multi-query simulations, where the problem depends on…

Numerical Analysis · Mathematics 2023-07-10 Jan S. Hesthaven , Cecilia Pagliantini , Nicolò Ripamonti

We give an asymptotic development of the maximum likelihood estimator (MLE), or any other estimator defined implicitly, in a way which involves the limiting behavior of the score and its higher-order derivatives. This development, which is…

Statistics Theory · Mathematics 2024-04-10 Antoine Lejay , Sara Mazzonetto

Critical exponent $\eta$ for three-dimensional systems with $n$-vector order parameter is evaluated in the frame of pseudo-$\epsilon$ expansion approach. Pseudo-$\epsilon$ expansion ($\tau$-series) for $\eta$ found up to $\tau^7$ term for…

Statistical Mechanics · Physics 2015-06-18 A. I. Sokolov , M. A. Nikitina

The determinantal complexity of a polynomial $P \in \mathbb{F}[x_1, \ldots, x_n]$ over a field $\mathbb{F}$ is the dimension of the smallest matrix $M$ whose entries are affine functions in $\mathbb{F}[x_1, \ldots, x_n]$ such that $P =…

Computational Complexity · Computer Science 2021-12-03 Mrinal Kumar , Ben Lee Volk