English
Related papers

Related papers: Rates of estimation for high-dimensional multi-ref…

200 papers

This paper describes recursive algorithms for state estimation of linear dynamical systems when measurements are noisy with unknown bias and/or outliers. For situations with noisy and biased measurements, algorithms are proposed that…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Krishan Mohan Nagpal

In this work, we study the accuracy that can be achieved when inferring the atmospheric information from realistic numerical magneto-hydrodynamic simulations that reproduce the spatial resolution we will obtain with future observations made…

In this paper, we establish sample complexity bounds for learning high-dimensional simplices in $\mathbb{R}^K$ from noisy data. Specifically, we consider $n$ i.i.d. samples uniformly drawn from an unknown simplex in $\mathbb{R}^K$, each…

Machine Learning · Statistics 2025-06-13 Seyed Amir Hossein Saberi , Amir Najafi , Abolfazl Motahari , Babak H. khalaj

Many statistical estimators for high-dimensional linear regression are M-estimators, formed through minimizing a data-dependent square loss function plus a regularizer. This work considers a new class of estimators implicitly defined…

Statistics Theory · Mathematics 2022-02-15 Peng Zhao , Yun Yang , Qiao-Chu He

We study theoretical properties of regularized robust M-estimators, applicable when data are drawn from a sparse high-dimensional linear model and contaminated by heavy-tailed distributions and/or outliers in the additive errors and…

Statistics Theory · Mathematics 2015-01-05 Po-Ling Loh

Existing algorithms for fitting the parameters of a sinusoid to noisy discrete time observations are not always successful due to initial value sensitivity and other issues. This paper demonstrates the techniques of FIR filtering, Fast…

General Mathematics · Mathematics 2012-08-27 Francis J. O'Brien, , Nathan Johnnie

The problem of optimal estimation of linear functionals constructed from unobserved values of stochastic sequence with periodically stationary increments based on observations of the sequence with a periodically stationary noise is…

Statistics Theory · Mathematics 2025-11-10 Maksym Luz , Mykhailo Moklyachuk

We study a minimax risk of estimating inverse functions on a plane, while keeping an estimator is also invertible. Learning invertibility from data and exploiting an invertible estimator are used in many domains, such as statistics,…

Statistics Theory · Mathematics 2023-12-27 Akifumi Okuno , Masaaki Imaizumi

In this paper, we study the problem of learning multi-dimensional Gaussian Mixture Models (GMMs), with a specific focus on model order selection and efficient mixing distribution estimation. We first establish an information-theoretic lower…

Machine Learning · Statistics 2026-03-23 Xinyu Liu , Hai Zhang

Recent years have witnessed an upsurge of interest in employing flexible machine learning models for instrumental variable (IV) regression, but the development of uncertainty quantification methodology is still lacking. In this work we…

Machine Learning · Statistics 2021-11-04 Ziyu Wang , Yuhao Zhou , Tongzheng Ren , Jun Zhu

In many industrial applications, signals with short periodic pulses, caused by repeated steps in the manufacturing process, are present, and their fundamental frequency or period may be of interest. Fundamental frequency estimation is in…

High frequency based estimation methods for a semiparametric pure-jump subordinated Brownian motion exposed to a small additive microstructure noise are developed building on the two-scales realized variations approach originally developed…

Statistics Theory · Mathematics 2017-02-07 Jose E. Figueroa-Lopez , K. Lee

Matrix-variate time series data are increasingly popular in economics, statistics, and environmental studies, among other fields. This paper develops regularized estimation methods for analyzing high-dimensional matrix-variate time series…

Methodology · Statistics 2024-10-16 Hangjin Jiang , Baining Shen , Yuzhou Li , Zhaoxing Gao

Hierarchical optimization refers to problems with interdependent decision variables and objectives, such as minimax and bilevel formulations. While various algorithms have been proposed, existing methods and analyses lack adaptivity in…

Machine Learning · Computer Science 2025-10-27 Xiaochuan Gong , Jie Hao , Mingrui Liu

Recently, sparsity-based algorithms are proposed for super-resolution spectrum estimation. However, to achieve adequately high resolution in real-world signal analysis, the dictionary atoms have to be close to each other in frequency,…

Machine Learning · Statistics 2015-06-05 Yiyuan She , Huanghuang Li , Jiangping Wang , Dapeng Wu

The advent of large-scale inference has spurred reexamination of conventional statistical thinking. In a Gaussian model for $n$ many $z$-scores with at most $k < \frac{n}{2}$ nonnulls, Efron suggests estimating the location and scale…

Statistics Theory · Mathematics 2025-01-15 Subhodh Kotekal , Chao Gao

This paper proposes a novel multiscale estimator for the integrated volatility of an Ito process, in the presence of market microstructure noise (observation error). The multiscale structure of the observed process is represented…

Methodology · Statistics 2009-04-19 Sofia Olhede , Adam Sykulski , Grigorios Pavliotis

In this paper we study the asymptotic behavior of a stochastic approximation scheme on two timescales with set-valued drift functions and in the presence of non-additive iterate-dependent Markov noise. It is shown that the recursion on each…

Systems and Control · Computer Science 2016-11-21 Vinayaka Yaji , Shalabh Bhatnagar

This work investigates the parameter estimation performance of super-resolution line spectral estimation using atomic norm minimization. The focus is on analyzing the algorithm's accuracy of inferring the frequencies and complex magnitudes…

Information Theory · Computer Science 2018-10-24 Qiuwei Li , Gongguo Tang

We study a spectral initialization method that serves a key role in recent work on estimating signals in nonconvex settings. Previous analysis of this method focuses on the phase retrieval problem and provides only performance bounds. In…

Information Theory · Computer Science 2019-07-23 Yue M. Lu , Gen Li