English
Related papers

Related papers: Non-Asymptotic Pointwise and Worst-Case Bounds for…

200 papers

We develop asymptotic approximations that can be applied to sequential estimation and inference problems, adaptive randomized controlled trials, and related settings. In batched adaptive settings where the decision at one stage can affect…

Econometrics · Economics 2025-02-25 Keisuke Hirano , Jack R. Porter

Ever since the proof of asymptotic normality of maximum likelihood estimator by Cramer (1946), it has been understood that a basic technique of the Taylor series expansion suffices for asymptotics of $M$-estimators with…

Statistics Theory · Mathematics 2018-09-17 Arun Kumar Kuchibhotla

Frequency domain methods form a ubiquitous part of the statistical toolbox for time series analysis. In recent years, considerable interest has been given to the development of new spectral methodology and tools capturing dynamics in the…

Statistics Theory · Mathematics 2022-12-23 Yuichi Goto , Tobias Kley , Ria Van Hecke , Stanislav Volgushev , Holger Dette , Marc Hallin

We propose a method for estimating the asymptotic phase and amplitude functions of limit-cycle oscillators using observed time series data without prior knowledge of their dynamical equations. The estimation is performed by polynomial…

Adaptation and Self-Organizing Systems · Physics 2023-01-19 Norihisa Namura , Shohei Takata , Katsunori Yamaguchi , Ryota Kobayashi , Hiroya Nakao

This paper obtains asymptotic results for parametric inference using prediction-based estimating functions when the data are high frequency observations of a diffusion process with an infinite time horizon. Specifically, the data are…

Statistics Theory · Mathematics 2020-07-27 Emil S. Jørgensen , Michael Sørensen

Data-driven methods for modeling dynamic systems have received considerable attention as they provide a mechanism for control synthesis directly from the observed time-series data. In the absence of prior assumptions on how the time-series…

Optimization and Control · Mathematics 2018-09-24 Atiye Alaeddini , Siavash Alemzadeh , Afshin Mesbahi , Mehran Mesbahi

Spectral estimators are fundamental in lowrank matrix models and arise throughout machine learning and statistics, with applications including network analysis, matrix completion and PCA. These estimators aim to recover the leading…

Statistics Theory · Mathematics 2025-02-17 Hao Yan , Keith Levin

Method of moment estimators exhibit appealing statistical properties, such as asymptotic unbiasedness, for nonconvex problems. However, they typically require a large number of samples and are extremely sensitive to model misspecification.…

Computation · Statistics 2016-03-30 Dustin Tran , Minjae Kim , Finale Doshi-Velez

For time series data observed at non-random and possibly non-equidistant time points, we estimate the trend function nonparametrically. Under the assumption of a bounded total variation of the function and low-order moment conditions on the…

Statistics Theory · Mathematics 2025-02-13 Michael H. Neumann , Anne Leucht

This paper studies a spectrum estimation method for the case that the samples are obtained at a rate lower than the Nyquist rate. The method is referred to as the correlogram for undersampled data. The algorithm partitions the spectrum into…

Information Theory · Computer Science 2018-02-07 Mahdi Shaghaghi , Sergiy A. Vorobyov

In continuous-time system identification, the intersample behavior of the input signal is known to play a crucial role in the performance of estimation methods. One common input behavior assumption is that the spectrum of the input is…

Systems and Control · Electrical Eng. & Systems 2021-03-22 Rodrigo A. González , Cristian R. Rojas , Håkan Hjalmarsson

We study the quadratic prediction error method -- i.e., nonlinear least squares -- for a class of time-varying parametric predictor models satisfying a certain identifiability condition. While this method is known to asymptotically achieve…

Statistics Theory · Mathematics 2024-04-17 Charis Stamouli , Ingvar Ziemann , George J. Pappas

Fitting parametric models by optimizing frequency domain objective functions is an attractive approach of parameter estimation in time series analysis. Whittle estimators are a prominent example in this context. Under weak conditions and…

Statistics Theory · Mathematics 2021-07-26 Jens-Peter Kreiss , Efstathios Paparoditis

We present improved methods for calculating confidence intervals and $p$-values in situations where standard asymptotic approaches fail due to small sample sizes. We apply these techniques to a specific class of statistical model that can…

Data Analysis, Statistics and Probability · Physics 2024-01-11 Enzo Canonero , Alessandra Rosalba Brazzale , Glen Cowan

We present a general framework for studying regularized estimators; such estimators are pervasive in estimation problems wherein "plug-in" type estimators are either ill-defined or ill-behaved. Within this framework, we derive, under…

Statistics Theory · Mathematics 2020-07-14 Michael Jansson , Demian Pouzo

This paper studies two spectrum estimation methods for the case that the samples are obtained at a rate lower than the Nyquist rate. The first method is the correlogram method for undersampled data. The algorithm partitions the spectrum…

Statistics Theory · Mathematics 2013-11-25 Mahdi Shaghaghi , Sergiy A. Vorobyov

We consider the problem of parameter estimation in a high-dimensional generalized linear model. Spectral methods obtained via the principal eigenvector of a suitable data-dependent matrix provide a simple yet surprisingly effective…

Statistics Theory · Mathematics 2025-07-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

Doubly robust estimators have gained widespread popularity in various fields due to their ability to provide unbiased estimates under model misspecification. However, the asymptotic theory for doubly robust estimators with continuous-time…

Statistics Theory · Mathematics 2024-04-23 Andrew Ying

Multi-index models provide a popular framework to investigate the learnability of functions with low-dimensional structure and, also due to their connections with neural networks, they have been object of recent intensive study. In this…

Machine Learning · Statistics 2025-06-11 Filip Kovačević , Yihan Zhang , Marco Mondelli

The Wallace--Freeman estimator is a classical invariant point estimator whose large-sample properties have not been fully developed in a modern asymptotic framework. We show that the estimator can be formulated as a penalised M-estimator…

Statistics Theory · Mathematics 2026-04-03 Enes Makalic , Daniel F. Schmidt