English
Related papers

Related papers: Strongly Consistent Model Order Selection for Esti…

200 papers

The article considers the problem of identifying the variable frequency of a sinusoidal signal. To obtain a regression model of the signal, an iterative differentiation of the original analytical expression is performed, and the swapping…

Systems and Control · Electrical Eng. & Systems 2021-09-21 S. I. Nizovtsev , S. V. Shavetov , A. A. Pyrkin

While model selection is a well-studied topic in parametric and nonparametric regression or density estimation, selection of possibly high-dimensional nuisance parameters in semiparametric problems is far less developed. In this paper, we…

Methodology · Statistics 2023-09-06 Yifan Cui , Eric Tchetgen Tchetgen

We present a least squares method for estimating parameters from measurements of event yields in the presence of background and crossfeed. We adopt a unified approach to incorporating the statistical and systematic uncertainties on the…

Data Analysis, Statistics and Probability · Physics 2009-11-11 Werner M. Sun

We consider the demixing problem of two (or more) high-dimensional vectors from nonlinear observations when the number of such observations is far less than the ambient dimension of the underlying vectors. Specifically, we demonstrate an…

Machine Learning · Statistics 2017-01-25 Mohammadreza Soltani , Chinmay Hegde

Image classification has become a ubiquitous task. Models trained on good quality data achieve accuracy which in some application domains is already above human-level performance. Unfortunately, real-world data are quite often degenerated…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Stanisław Kaźmierczak , Jacek Mańdziuk

This paper provides a unified framework for analyzing tensor estimation problems that allow for nonlinear observations, heteroskedastic noise, and covariate information. We study a general class of high-dimensional models where each…

Information Theory · Computer Science 2025-06-10 Riccardo Rossetti , Galen Reeves

This paper addresses the estimation of signals with sublinear sparsity sent over the additive white Gaussian noise channel. This fundamental problem arises in designing denoisers used in message-passing algorithms for sublinear sparsity.…

Information Theory · Computer Science 2026-04-28 Keigo Takeuchi

We prove a new and general concentration inequality for the excess risk in least-squares regression with random design and heteroscedastic noise. No specific structure is required on the model, except the existence of a suitable function…

Statistics Theory · Mathematics 2018-03-12 Adrien Saumard

This paper discusses the problem of estimating a stochastic signal from nonlinear uncertain observations with time-correlated additive noise described by a first-order Markov process. Random deception attacks are assumed to be launched by…

Signal Processing · Electrical Eng. & Systems 2024-05-09 R. Caballero-Águila , J. Hu , J. Linares-Pérez

The coresets approach, also called subsampling or subset selection, aims to select a subsample as a surrogate for the observed sample and has found extensive applications in large-scale data analysis. Existing coresets methods construct the…

Computation · Statistics 2024-09-17 Mengyu Li , Jun Yu , Tao Li , Cheng Meng

Shrinkage estimation usually reduces variance at the cost of bias. But when we care only about some parameters of a model, I show that we can reduce variance without incurring bias if we have additional information about the distribution of…

Statistics Theory · Mathematics 2017-11-01 Jann Spiess

We consider the deconvolution problem for densities supported on a $(d-1)$-dimensional sphere with unknown center and unknown radius, in the situation where the distribution of the noise is unknown and without any other observations. We…

Statistics Theory · Mathematics 2022-03-08 Jérémie Capitao-Miniconi , Elisabeth Gassiat

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

Statistics Theory · Mathematics 2018-10-16 Michael Krikheli , Amir Leshem

We consider the problem of parameter estimation, based on noisy chaotic signals, from the viewpoint of twisted modulation for waveform communication. In particular, we study communication systems where the parameter to be estimated is…

Information Theory · Computer Science 2023-08-02 Neri Merhav

Compressed Sensing suggests that the required number of samples for reconstructing a signal can be greatly reduced if it is sparse in a known discrete basis, yet many real-world signals are sparse in a continuous dictionary. One example is…

Information Theory · Computer Science 2015-07-24 Yuanxin Li , Yuejie Chi

Since its development, the minimax framework has been one of the corner stones of theoretical statistics, and has contributed to the popularity of many well-known estimators, such as the regularized M-estimators for high-dimensional…

Statistics Theory · Mathematics 2024-01-01 Yilin Guo , Haolei Weng , Arian Maleki

This paper investigates system identification problems with Gaussian inputs and quantized observations under fixed thresholds. By reinterpreting the nonlinear effects induced by quantization as the product of the unknown parameter and an…

Optimization and Control · Mathematics 2025-10-20 Xingrui Liu , Ying Wang , Yanlong Zhao

We consider a 2D XY model subjected to time-correlated noise, a model of direct relevance to active crystals, which were shown recently to be able to support very large deformations without melting in the presence of persistent…

Statistical Mechanics · Physics 2026-02-26 Xia-qing Shi , Hugues Chaté , Benoît Mahault

We consider higher order frequentist inference for the parametric component of a semiparametric model based on sampling from the posterior profile distribution. The first order validity of this procedure established by Lee, Kosorok and Fine…

Statistics Theory · Mathematics 2009-09-29 Guang Cheng , Michael R. Kosorok

The success of the compressed sensing paradigm has shown that a substantial reduction in sampling and storage complexity can be achieved in certain linear and non-adaptive estimation problems. It is therefore an advisable strategy for…

Information Theory · Computer Science 2014-08-27 Peter Jung , Philipp Walk