English
Related papers

Related papers: An analysis of penalized interaction models

200 papers

In this paper, we consider the problem of Gaussian approximation for the online linear regression task. We derive the corresponding rates for the setting of a constant learning rate and study the explicit dependence of the convergence rate…

Machine Learning · Statistics 2025-09-18 Marat Khusainov , Marina Sheshukova , Alain Durmus , Sergey Samsonov

We consider nonlinear mixed effects models including high-dimensional covariates to model individual parameters variability. The objective is to identify relevant covariates among a large set under sparsity assumption and to estimate model…

Statistics Theory · Mathematics 2025-08-06 Antoine Caillebotte , Estelle Kuhn , Sarah Lemler

Estimating the dependences between random variables, and ranking them accordingly, is a prevalent problem in machine learning. Pursuing frequentist and information-theoretic approaches, we first show that the p-value and the mutual…

Machine Learning · Computer Science 2012-07-02 Harald Steck

Penalized likelihood approaches are widely used for high-dimensional regression. Although many methods have been proposed and the associated theory is now well-developed, the relative efficacy of different approaches in finite-sample…

Methodology · Statistics 2020-01-29 Fan Wang , Sach Mukherjee , Sylvia Richardson , Steven M. Hill

We study a regression model with a huge number of interacting variables. We consider a specific approximation of the regression function under two ssumptions: (i) there exists a sparse representation of the regression function in a…

Statistics Theory · Mathematics 2009-09-29 Peter J. Bickel , Ya'acov Ritov , Alexander B. Tsybakov

This paper gives a comprehensive treatment of the convergence rates of penalized spline estimators for simultaneously estimating several leading principal component functions, when the functional data is sparsely observed. The penalized…

Statistics Theory · Mathematics 2024-02-09 Shiyuan He , Jianhua Z. Huang , Kejun He

Beliefs inform the behavior of forward-thinking agents in complex environments. Recently, sequential Bayesian inference has emerged as a mechanism to study belief formation among agents adapting to dynamical conditions. However, we lack…

Adaptation and Self-Organizing Systems · Physics 2023-11-08 Jordan T Kemp , Max-Olivier Hongler , Olivier Gallay

A powerful tool for the analysis of nonrandomized observational studies has been the potential outcomes model. Utilization of this framework allows analysts to estimate average treatment effects. This article considers the situation in…

Statistics Theory · Mathematics 2019-05-31 Debashis Ghosh , Efrén Cruz-Cortés

This paper considers a distributionally robust chance constraint model with a general ambiguity set. We show that a sample based approximation of this model converges under suitable sufficient conditions. We also show that upper and lower…

Optimization and Control · Mathematics 2025-01-17 Jiaqi Lei , Sanjay Mehrotra

In this work, we investigate the convergence of numerical approximations to coercivity constants of variational problems. These constants are essential components of rigorous error bounds for reduced-order modeling; extension of these…

Numerical Analysis · Mathematics 2022-05-25 Peter Sentz , Jehanzeb Hameed Chaudhry , Luke N. Olson

Bayesian nonparametric regression under a rescaled Gaussian process prior offers smoothness-adaptive function estimation with near minimax-optimal error rates. Hierarchical extensions of this approach, equipped with stochastic variable…

Statistics Theory · Mathematics 2020-12-15 Sheng Jiang , Surya T. Tokdar

Interval-censored competing risks data arise when each study subject may experience an event or failure from one of several causes and the failure time is not observed exactly but rather known to lie in an interval between two successive…

Methodology · Statistics 2016-03-02 Lu Mao , D. Y. Lin , Donglin Zeng

This paper presents a new estimator of the intercept of a linear regression model in cases where the outcome varaible is observed subject to a selection rule. The intercept is often in this context of inherent interest; for example, in a…

Econometrics · Economics 2018-09-26 Chuan Goh

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

Machine Learning · Statistics 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

A major effort in modern high-dimensional statistics has been devoted to the analysis of linear predictors trained on nonlinear feature embeddings via empirical risk minimization (ERM). Gaussian equivalence theory (GET) has emerged as a…

Statistics Theory · Mathematics 2025-12-04 Garrett G. Wen , Hong Hu , Yue M. Lu , Zhou Fan , Theodor Misiakiewicz

In this article, we obtain a super-exponential rate of convergence in total variation between the traces of the first $m$ powers of an $n\times n$ random unitary matrices and a $2m$-dimensional Gaussian random variable. This generalizes…

Probability · Mathematics 2020-02-06 Kurt Johansson , Gaultier Lambert

The purpose of this paper is to pursue our study of rho-estimators built from i.i.d. observations that we defined in Baraud et al. (2014). For a \rho-estimator based on some model S (which means that the estimator belongs to S) and a true…

Statistics Theory · Mathematics 2017-03-07 Yannick Baraud , Lucien Birgé

We study linear chance-constrained problems where the coefficients follow a Gaussian mixture distribution. We provide mixed-binary quadratic programs that give inner and outer approximations of the chance constraint based on piecewise…

Optimization and Control · Mathematics 2025-11-24 Shibshankar Dey , Sanjay Mehrotra , Anirudh Subramanyam

This paper investigates the approximation of Gaussian random variables in Banach spaces, focusing on the high-probability bounds for the approximation of Gaussian random variables using finitely many observations. We derive non-asymptotic…

Statistics Theory · Mathematics 2025-08-28 Daniel Winkle , Ingo Steinwart , Bernard Haasdonk

Usually, opinion formation models assume that individuals have an opinion about a given topic which can change due to interactions with others. However, individuals can have different opinions in different topics and therefore n-dimensional…

Physics and Society · Physics 2021-09-22 Lucia Pedraza , Juan Pablo Pinasco , Nicolas Saintier , Pablo Balenzuela