English
Related papers

Related papers: The radius of statistical efficiency

200 papers

Robust optimization (RO) is a common approach to tractably obtain safeguarding solutions for optimization problems with uncertain constraints. In this paper, we study a statistical framework to integrate data into RO, based on learning a…

Optimization and Control · Mathematics 2020-03-03 L. Jeff Hong , Zhiyuan Huang , Henry Lam

Information-theoretic inequalities play a fundamental role in numerous scientific and technological areas as they generally express the impossibility to have a complete description of a system via a finite number of information measures. In…

Mathematical Physics · Physics 2017-10-03 Steeve Zozor , David Puertas-Centeno , Jesús S. Dehesa

We study the problem of fitting parametrized curves to noisy data. Under certain assumptions (known as Cartesian and radial functional models), we derive asymptotic expressions for the bias and the covariance matrix of the parameter…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 N. Chernov , C. Lesort

We propose a robust and scalable procedure for general optimization and inference problems on manifolds leveraging the classical idea of `median-of-means' estimation. This is motivated by ubiquitous examples and applications in modern data…

Methodology · Statistics 2020-06-16 Lizhen Lin , Drew Lazar , Bayan Sarpabayeva , David B. Dunson

Reconfigurable Intelligent Surfaces (RIS) are planar structures connected to electronic circuitry, which can be employed to steer the electromagnetic signals in a controlled manner. Through this, the signal quality and the effective data…

Information Theory · Computer Science 2021-12-21 Long Kong , Steven Kisseleff , Symeon Chatzinotas , Björn Ottersten , Melike Erol-Kantarci

We show that several classical quantities controlling compressed sensing performance directly match classical parameters controlling algorithmic complexity. We first describe linearly convergent restart schemes on first-order methods…

Optimization and Control · Mathematics 2018-11-05 Vincent Roulet , Nicolas Boumal , Alexandre d'Aspremont

In this paper, we study robust stability of sparse LTI systems using the stability radius (SR) as a robustness measure. We consider real perturbations with an arbitrary and pre-specified sparsity pattern of the system matrix and measure…

Systems and Control · Computer Science 2018-10-26 Vaibhav Katewa , Fabio Pasqualetti

A class of robust estimators of scatter applied to information-plus-impulsive noise samples is studied, where the sample information matrix is assumed of low rank; this generalizes the study of (Couillet et al., 2013b) to spiked random…

Probability · Mathematics 2014-05-01 Romain Couillet

Evaluating rare-event forecasts is challenging because standard metrics collapse as event prevalence declines. Measures such as F1-score, AUPRC, MCC, and accuracy induce degenerate thresholds -- converging to zero or one -- and their values…

Methodology · Statistics 2025-12-02 Sotirios D. Nikolopoulos

In this paper, we develop a new sequential regression modeling approach for data streams. Data streams are commonly found around us, e.g in a retail enterprise sales data is continuously collected every day. A demand forecasting model is an…

Machine Learning · Statistics 2017-01-11 Chitta Ranjan , Samaneh Ebrahimi , Kamran Paynabar

We investigate the structural foundations of statistical efficiency under $\alpha$-local differential privacy, with a focus on maximizing Fisher information. Building on the role of continuous staircase mechanisms, we identify a fundamental…

Statistics Theory · Mathematics 2026-03-31 Chiara Amorino , Arnaud Gloter

We consider stochastic optimization problems which use observed data to estimate essential characteristics of the random quantities involved. Sample average approximation (SAA) or empirical (plug-in) estimation are very popular ways to use…

Statistics Theory · Mathematics 2021-03-16 Darinka Dentcheva , Yang Lin

We introduce a notion of "effective dimension" of a statistical model based on the number of cubes of size $1/\sqrt{n}$ needed to cover the model space when endowed with the Fisher Information Matrix as metric, $n$ being the number of…

Machine Learning · Statistics 2020-01-30 Oksana Berezniuk , Alessio Figalli , Raffaele Ghigliazza , Kharen Musaelian

A fundamental problem of statistical data analysis, distribution density estimation by experimental data, is considered. A new method with optimal asymptotic behavior, the root density estimator, is developed. The method proposed may be…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Yu. I. Bogdanov

Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanics approach to analyze sparse equation discovery algorithms, which typically balance data fit and…

Statistical Mechanics · Physics 2025-09-16 Andrei A. Klishin , Joseph Bakarji , J. Nathan Kutz , Krithika Manohar

In the target tracking and its engineering applications, recursive state estimation of the target is of fundamental importance. This paper presents a recursive performance bound for dynamic estimation and filtering problem, in the framework…

Applications · Statistics 2015-06-04 Huisi Tong , Hao Zhang , Huadong Meng , Xiqin Wang

Reconstructive spectrometers are a promising emerging class of devices that combine complex light scattering with inference to enable compact, high-resolution spectrometry. Thus far, the physical determinants of these devices' performance…

Optics · Physics 2026-03-24 Changyan Zhu , Hsuan Lo , Jianbo Yu , Qijie Wang , Y. D. Chong

Classical Fisher-information asymptotics describe the covariance of regular efficient estimators through the local quadratic approximation of the log-likelihood, and thus capture first-order geometry only. In curved models, including…

Statistics Theory · Mathematics 2026-04-15 Malik Amir , Sourangshu Ghosh

We present a framework for performing efficient regression in general metric spaces. Roughly speaking, our regressor predicts the value at a new point by computing a Lipschitz extension --- the smoothest function consistent with the…

Machine Learning · Computer Science 2017-04-25 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

Any performance analysis based on stochastic simulation is subject to the errors inherent in misspecifying the modeling assumptions, particularly the input distributions. In situations with little support from data, we investigate the use…

Probability · Mathematics 2018-04-12 Soumyadip Ghosh , Henry Lam