English
Related papers

Related papers: Rate-Optimal Non-Asymptotics for the Quadratic Pre…

200 papers

We propose an algorithm to actively estimate the parameters of a linear dynamical system. Given complete control over the system's input, our algorithm adaptively chooses the inputs to accelerate estimation. We show a finite time bound…

Machine Learning · Computer Science 2020-06-23 Andrew Wagenmaker , Kevin Jamieson

We compute precise asymptotic expressions for the learning curves of least squares random feature (RF) models with either a separable strongly convex regularization or the $\ell_1$ regularization. We propose a novel multi-level application…

Machine Learning · Statistics 2023-03-02 David Bosch , Ashkan Panahi , Ayca Özcelikkale , Devdatt Dubhash

Model averaging has demonstrated superior performance for ensemble forecasting in high-dimensional framework, its extension to incomplete datasets remains a critical but underexplored challenge. Moreover, identifying the parsimonious model…

Methodology · Statistics 2025-09-03 Wei Xiong , Dianliang Deng , Dehui Wang

In this paper, we establish minimax optimal rates of convergence for prediction in a semi-functional linear model that consists of a functional component and a less smooth nonparametric component. Our results reveal that the smoother…

Statistics Theory · Mathematics 2021-11-01 Keli Guo , Jun Fan , Lixing Zhu

This paper is about vector autoregressive-moving average (VARMA) models with time-dependent coefficients to represent non-stationary time series. Contrarily to other papers in the univariate case, the coefficients depend on time but not on…

Statistics Theory · Mathematics 2015-06-05 Abdelkamel Alj , Christophe Ley , Guy Mélard

We analyze a simple prefiltered variation of the least squares estimator for the problem of estimation with biased, semi-parametric noise, an error model studied more broadly in causal statistics and active learning. We prove an oracle…

Machine Learning · Computer Science 2019-02-05 Max Simchowitz , Ross Boczar , Benjamin Recht

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

This paper discusses the simultaneous inference of mean parameters in a family of distributions with quadratic variance function. We first introduce a class of semiparametric/parametric shrinkage estimators and establish their asymptotic…

Statistics Theory · Mathematics 2016-03-31 Xianchao Xie , S. C. Kou , Lawrence Brown

Classical estimation techniques for linear models either are inconsistent, or perform rather poorly, under $\alpha$-stable error densities; most of them are not even rate-optimal. In this paper, we propose an original one-step R-estimation…

Methodology · Statistics 2012-10-19 Marc Hallin , Yvik Swan , Thomas Verdebout , David Veredas

We investigate the problem of jointly testing multiple hypotheses and estimating a random parameter of the underlying distribution in a sequential setup. The aim is to jointly infer the true hypothesis and the true parameter while using on…

Signal Processing · Electrical Eng. & Systems 2024-02-02 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

Inference methods for computing confidence intervals in parametric settings usually rely on consistent estimators of the parameter of interest. However, it may be computationally and/or analytically burdensome to obtain such estimators in…

Methodology · Statistics 2024-09-20 Samuel Orso , Mucyo Karemera , Maria-Pia Victoria-Feser , Stéphane Guerrier

We consider the estimation of parametric fractional time series models in which not only is the memory parameter unknown, but one may not know whether it lies in the stationary/invertible region or the nonstationary or noninvertible…

Statistics Theory · Mathematics 2012-03-14 Javier Hualde , Peter M. Robinson

We study the problem of parameter estimation for reflected stochastic processes driven by a standard Brownian motion. The estimator is obtained using nonlinear least squares method based on discretely observed processes. Under some certain…

Statistics Theory · Mathematics 2022-05-03 Han Yuecai , Zhang Dingwen

We study semiparametric inference in some linear regression models with time-varying coefficients, dependent regressors and dependent errors. This problem, which has been considered recently by Zhang and Wu (2012) under the functional…

Statistics Theory · Mathematics 2017-07-19 Lionel Truquet

In the context of nonparametric regression, we study conditions under which the consistency (and rates of convergence) of estimators built from discretely sampled curves can be derived from the consistency of estimators based on the…

Statistics Theory · Mathematics 2017-05-29 Forzani Liliana , Fraiman Ricardo , Llop Pamela

The extremal dependence structure of a regularly varying $d$-dimensional random vector can be described by its angular measure. The standard nonparametric estimator of this measure is the empirical measure of the observed angles of the $k$…

Statistics Theory · Mathematics 2025-03-31 Holger Drees

Non linear regression models are a standard tool for modeling real phenomena, with several applications in machine learning, ecology, econometry... Estimating the parameters of the model has garnered a lot of attention during many years. We…

Statistics Theory · Mathematics 2020-09-17 Peggy Cénac , Antoine Godichon-Baggioni , Bruno Portier

A sequential quadratic optimization algorithm for minimizing an objective function defined by an expectation subject to nonlinear inequality and equality constraints is proposed, analyzed, and tested. The context of interest is when it is…

Optimization and Control · Mathematics 2023-03-01 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

This paper is concerned with the optimal identification problem of dynamical systems in which only quantized output observations are available under the assumption of fixed thresholds and bounded persistent excitations. Based on a…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Ying Wang , Yanlong Zhao , Ji-Feng Zhang

In this paper, we develop a unified framework able to certify both exponential and subexponential convergence rates for a wide range of iterative first-order optimization algorithms. To this end, we construct a family of parameter-dependent…

Optimization and Control · Mathematics 2018-02-26 Mahyar Fazlyab , Alejandro Ribeiro , Manfred Morari , Victor M. Preciado