English
Related papers

Related papers: Rate-Optimal Non-Asymptotics for the Quadratic Pre…

200 papers

Most identification laws of unknown parameters of linear regression equations (LRE) ensure only boundedness of a parametric error in the presence of additive perturbations, which is almost always unacceptable for practical scenarios. In…

Systems and Control · Electrical Eng. & Systems 2024-02-05 Anton Glushchenko , Konstantin Lastochkin

The Vector AutoRegressive Moving Average (VARMA) model is fundamental to the theory of multivariate time series; however, identifiability issues have led practitioners to abandon it in favor of the simpler but more restrictive Vector…

Methodology · Statistics 2021-06-09 Ines Wilms , Sumanta Basu , Jacob Bien , David S. Matteson

This paper studies the probability of error associated with the social machine learning framework, which involves an independent training phase followed by a cooperative decision-making phase over a graph. This framework addresses the…

Machine Learning · Computer Science 2024-07-10 Ping Hu , Virginia Bordignon , Mert Kayaalp , Ali H. Sayed

We consider nonparametric testing in a non-asymptotic framework. Our statistical guarantees are exact in the sense that Type I and II errors are controlled for any finite sample size. Meanwhile, one proposed test is shown to achieve minimax…

Statistics Theory · Mathematics 2017-02-07 Yun Yang , Zuofeng Shang , Guang Cheng

We propose a rate optimal estimator for the linear regression model on network data with interacted (unobservable) individual effects. The estimator achieves a faster rate of convergence $N$ compared to the standard estimators' $\sqrt{N}$…

Econometrics · Economics 2023-04-26 Yassine Sbai Sassi

A parameter estimation problem is considered, in which dispersed sensors transmit to the statistician partial information regarding their observations. The sensors observe the paths of continuous semimartingales, whose drifts are linear…

Methodology · Statistics 2013-02-01 Georgios Fellouris

The Gaussian graphical model, a popular paradigm for studying relationship among variables in a wide range of applications, has attracted great attention in recent years. This paper considers a fundamental question: When is it possible to…

Statistics Theory · Mathematics 2015-06-04 Zhao Ren , Tingni Sun , Cun-Hui Zhang , Harrison H. Zhou

We study prediction in the functional linear model with functional outputs : $Y=SX+\epsilon $ where the covariates $X$ and $Y$ belong to some functional space and $S$ is a linear operator. We provide the asymptotic mean square prediction…

Statistics Theory · Mathematics 2011-02-14 Christophe Crambes , André Mas

In this paper, we propose a new test for the detection of a change in a non-linear (auto-)regressive time series as well as a corresponding estimator for the unknown time point of the change. To this end, we consider an at-most-one-change…

Statistics Theory · Mathematics 2025-04-15 Claudia Kirch , Stefanie Schwaar

Among first order optimization methods, Polyak's heavy ball method has long been known to guarantee the asymptotic rate of convergence matching Nesterov's lower bound for functions defined in an infinite-dimensional space. In this paper, we…

Optimization and Control · Mathematics 2023-05-12 V. Ugrinovskii , I. R. Petersen , I. Shames

We consider the estimation of quadratic functionals in a Gaussian sequence model where the eigenvalues are supposed to be unknown and accessible through noisy observations only. Imposing smoothness assumptions both on the signal and the…

Statistics Theory · Mathematics 2019-07-16 Martin Kroll

Biased stochastic estimators, such as finite-differences for noisy gradient estimation, often contain parameters that need to be properly chosen to balance impacts from the bias and the variance. While the optimal order of these parameters…

Methodology · Statistics 2019-02-14 Henry Lam , Xinyu Zhang , Xuhui Zhang

Parameter-free algorithms are online learning algorithms that do not require setting learning rates. They achieve optimal regret with respect to the distance between the initial point and any competitor. Yet, parameter-free algorithms do…

Machine Learning · Computer Science 2022-03-22 Keyi Chen , Ashok Cutkosky , Francesco Orabona

This paper is a study on solutions of the Sample Average Approximation Method to solve compound stochastic programs. We derive nonasymptotic upper estimates for probabilities of the approximation errors. The results depend on the sample…

Optimization and Control · Mathematics 2025-08-29 Volker Kratschmer

During the last decade, sampling-based path planning algorithms, such as Probabilistic RoadMaps (PRM) and Rapidly-exploring Random Trees (RRT), have been shown to work well in practice and possess theoretical guarantees such as…

Robotics · Computer Science 2011-05-09 Sertac Karaman , Emilio Frazzoli

The paper covers a formulation of the inverse quadratic programming problem in terms of unconstrained optimization where it is required to find the unknown parameters (the matrix of the quadratic form and the vector of the quasi-linear part…

Numerical Analysis · Computer Science 2017-01-09 E. G. Abramov

Sequential data collection has emerged as a widely adopted technique for enhancing the efficiency of data gathering processes. Despite its advantages, such data collection mechanism often introduces complexities to the statistical inference…

Statistics Theory · Mathematics 2023-11-09 Mufang Ying , Koulik Khamaru , Cun-Hui Zhang

The focus of this paper is on trend estimation for a general state-space model $Y_t=\mu_t+\varepsilon_t$, where the $d$th difference of the trend $\{\mu_t\}$ is assumed to be i.i.d., and the error sequence $\{\varepsilon_t\}$ is assumed to…

Statistics Theory · Mathematics 2009-11-19 Prabir Burman , Robert H. Shumway

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

In this paper, we address the problem of parameter estimation of a 2-D chirp model under the assumption that the errors are stationary. We extend the 2-D periodogram method for the sinusoidal model, to find initial values to use in any…

Methodology · Statistics 2018-07-26 Rhythm Grover , Debasis Kundu , Amit Mitra