English
Related papers

Related papers: Large scale reduction principle and application to…

200 papers

It is of interest to study a wavelet system with a minimum number of generators. It has been showed by X. Dai, D. R. Larson, and D. M. Speegle in [11] that for any $d\times d$ real-valued expansive matrix M, a homogeneous orthonormal…

Functional Analysis · Mathematics 2010-02-12 Bin Han

We develop a general mathematical framework to analyze scaling regimes and derive explicit analytic solutions for gradient flow (GF) in large learning problems. Our key innovation is a formal power series expansion of the loss evolution,…

Machine Learning · Computer Science 2026-02-05 Dmitry Yarotsky , Eugene Golikov , Yaroslav Gusev

Central limit theorems are established for the sum, over a spatial region, of observations from a linear process on a $d$-dimensional lattice. This region need not be rectangular, but can be irregularly-shaped. Separate results are…

Statistics Theory · Mathematics 2016-01-07 S. N. Lahiri , Peter M. Robinson

The extension of the classical Bayesian penalized spline method to inference on vector-valued functions is considered, with an emphasis on characterizing the suitability of the method for general application.We show that the standard…

Machine Learning · Statistics 2010-03-26 David M. Rogers , Thomas L. Beck

The empirical likelihood inference is extended to a class of semiparametric models for stationary, weakly dependent series. A partially linear single-index regression is used for the conditional mean of the series given its past, and the…

Methodology · Statistics 2021-05-18 Marie Du Roy de Chaumaray , Matthieu Marbac , Valentin Patilea

We consider component-wise equivariant estimation of order restricted location/scale parameters of a general bivariate distribution under quite general conditions on underlying distributions and the loss function. This paper unifies various…

Statistics Theory · Mathematics 2022-07-05 Naresh Garg , Neeraj Misra

We compare classification and regression tasks in an overparameterized linear model with Gaussian features. On the one hand, we show that with sufficient overparameterization all training points are support vectors: solutions obtained by…

Machine Learning · Computer Science 2021-10-15 Vidya Muthukumar , Adhyyan Narang , Vignesh Subramanian , Mikhail Belkin , Daniel Hsu , Anant Sahai

The $W$-random graphs provide a flexible framework for modeling large random networks. Using the Large Deviation Principle (LDP) for $W$-random graphs from [9], we prove the LDP for the corresponding class of random symmetric…

Probability · Mathematics 2024-05-08 Mahya Ghandehari , Georgi S. Medvedev

Generalized sampling consists in the recovery of a function $f$, from the samples of the responses of a collection of linear shift-invariant systems to the input $f$. The reconstructed function is typically a member of a finitely generated…

Numerical Analysis · Mathematics 2021-06-18 Alexis Goujon , Shayan Aziznejad , Alireza Naderi , Michael Unser

We study non-parametric regression estimates for random fields. The data satisfies certain strong mixing conditions and is defined on the regular $N$-dimensional lattice structure. We show consistency and obtain rates of convergence. The…

Statistics Theory · Mathematics 2018-07-06 Johannes T. N. Krebs

To a good approximation, on large cosmological scales the evolved two-point correlation function of biased tracers is related to the initial one by a convolution. For Gaussian initial conditions, the smearing kernel is Gaussian, so if the…

Cosmology and Nongalactic Astrophysics · Physics 2022-03-09 Farnik Nikakhtar , Ravi K. Sheth , Idit Zehavi

Consider a scalar reflected diffusion $(X_t:t\geq 0)$, where the unknown drift function $b$ is modelled nonparametrically. We show that in the low frequency sampling case, when the sample consists of $(X_0,X_\Delta,...,X_{n\Delta})$ for…

Statistics Theory · Mathematics 2019-04-16 Sven Wang

We study a high-dimensional generalized linear model and penalized empirical risk minimization with $\ell_1$ penalty. Our aim is to provide a non-trivial illustration that non-asymptotic bounds for the estimator can be obtained without…

Statistics Theory · Mathematics 2007-09-12 Sara A. van de Geer

This article investigates general scaling settings and limit distributions of functionals of filtered random fields. The filters are defined by the convolution of non-random kernels with functions of Gaussian random fields. The case of…

Probability · Mathematics 2018-12-19 Tareq Alodat , Nikolai Leonenko , Andriy Olenko

In this paper, we consider testing the martingale difference hypothesis for high-dimensional time series. Our test is built on the sum of squares of the element-wise max-norm of the proposed matrix-valued nonlinear dependence measure at…

Econometrics · Economics 2023-11-15 Jinyuan Chang , Qing Jiang , Xiaofeng Shao

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

Data Structures and Algorithms · Computer Science 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

In practice, there often exist unobserved variables, also termed hidden variables, associated with both the response and covariates. Existing works in the literature mostly focus on linear regression with hidden variables. However, when the…

Methodology · Statistics 2025-09-03 Inbeom Lee , Yang Ning

We present an investigation of the scale-dependence of bias described by the linear model: $(\delta \rho({\bf x})/\bar{\rho})_{g} = b (\delta \rho(x)/\bar{\rho})_{m}$, $b$ being the bias parameter, and $\rho({\bf x})_{g}$ and $\rho({\bf…

Astrophysics · Physics 2009-10-30 Li-Zhi Fang , Zu-Gang Deng , Xiao-Yang Xia

Estimation in generalized linear models (GLM) is complicated by the presence of constraints. One can handle constraints by maximizing a penalized log-likelihood. Penalties such as the lasso are effective in high dimensions, but often lead…

Machine Learning · Statistics 2017-11-07 Jason Xu , Eric C. Chi , Kenneth Lange

We study partial sums limits of linear random fields $X$ on $\mathbb{Z}^2 $ with spectral density $f({\mathbf x}) $ tending to $\infty,\, 0$ or to both (along different subsequences) as ${\mathbf x} \to (0,0)$. The above behaviors are…

Probability · Mathematics 2023-01-06 Donatas Surgailis