English
Related papers

Related papers: On the Information in Extreme Measurements for Par…

200 papers

The design and analysis of diffusive molecular communication systems generally requires knowledge of the environment's physical and chemical properties. Furthermore, prospective applications might rely on the timely detection of changes in…

Information Theory · Computer Science 2015-11-20 Adam Noel , Karen C. Cheung , Robert Schober

Motivated by the poor performance of cross-validation in settings where data are scarce, we propose a novel estimator of the out-of-sample performance of a policy in data-driven optimization.Our approach exploits the optimization problem's…

Optimization and Control · Mathematics 2022-08-04 Vishal Gupta , Michael Huang , Paat Rusmevichientong

Multivariate extreme-value analysis is concerned with the extremes in a multivariate random sample, that is, points of which at least some components have exceptionally large values. Mathematical theory suggests the use of max-stable models…

Probability · Mathematics 2012-04-03 Johan Segers

Asymptotic lower bounds for estimation play a fundamental role in assessing the quality of statistical procedures. In this paper we propose a framework for obtaining semi-parametric efficiency bounds for sparse high-dimensional models,…

Statistics Theory · Mathematics 2017-10-16 Jana Jankova , Sara van de Geer

We consider non-parametric estimation problems in the presence of dependent data, notably non-parametric regression with random design and non-parametric density estimation. The proposed estimation procedure is based on a dimension…

Statistics Theory · Mathematics 2016-02-02 Nicolas Asin , Jan Johannes

We consider estimation of the extreme value index and extreme quantiles for heavy-tailed data that are right-censored. We study a general procedure of removing low importance observations in tail estimators. This trimming procedure is…

Statistics Theory · Mathematics 2021-05-13 Martin Bladt , Hansjoerg Albrecher , Jan Beirlant

One-bit quantization has garnered significant attention in recent years for various signal processing and communication applications. Estimating model parameters from one bit quantized data can be challenging, particularly when the…

Signal Processing · Electrical Eng. & Systems 2025-04-01 Nadav E. Rosenthal , Joseph Tabrikian

Achieving ultimate bounds in estimation processes is the main objective of quantum metrology. In this context, several problems require measurement of multiple parameters by employing only a limited amount of resources. To this end,…

The goal of this paper is to characterize the best achievable performance for the problem of estimating an unknown parameter having a sparse representation. Specifically, we consider the setting in which a sparsely representable…

Statistics Theory · Mathematics 2009-09-29 Zvika Ben-Haim , Yonina C. Eldar

The tradeoff relation between speed and cost is a central issue in designing fast and efficient information processing devices. We derive an achievable bound on thermodynamic cost for obtaining information through finite-time…

Statistical Mechanics · Physics 2024-05-16 Rihito Nagase , Takahiro Sagawa

Identifying anomalies and contamination in datasets is important in a wide variety of settings. In this paper, we describe a new technique for estimating contamination in large, discrete valued datasets. Our approach considers the normal…

Information Theory · Computer Science 2015-06-16 Matthew L. Malloy , Scott Alfeld , Paul Barford

Bayesian analysis is a framework for parameter estimation that applies even in uncertainty regimes where the commonly used local (frequentist) analysis based on the Cram\'er-Rao bound is not well defined. In particular, it applies when no…

Quantum Physics · Physics 2021-03-17 Simon Morelli , Ayaka Usui , Elizabeth Agudelo , Nicolai Friis

In this paper, we investigate threshold effects associated with swapping of signal and noise subspaces in estimating signal parameters from compressed noisy data. The term threshold effect refers to a sharp departure of mean-squared error…

Information Theory · Computer Science 2016-05-04 Pooria Pakrooh , Louis L. Scharf , Ali Pezeshki

Measurements on a subset of the boundary are common in electrical impedance tomography, especially any electrode model can be interpreted as a partial boundary problem. The information obtained is different to full-boundary measurements as…

Numerical Analysis · Mathematics 2018-03-28 Andreas Hauptmann

Although the fundamental probabilistic theory of extremes has been well developed, there are many practical considerations that must be addressed in application. The contribution of this thesis is four-fold. The first concerns the choice of…

Methodology · Statistics 2016-11-28 Brian Bader

The estimation of parameters in a linear model is considered under the hypothesis that the noise, with finite second order statistics, can be represented in a given deterministic basis by random coefficients. An extended underdetermined…

Statistics Theory · Mathematics 2014-05-06 Piero Barone , Isabella Lari

We formulate the problem of performing optimal data compression under the constraints that compressed data can be used for accurate classification in machine learning. We show that this translates to a problem of minimizing the mutual…

Signal Processing · Electrical Eng. & Systems 2022-11-04 Jingchao Gao , Ao Tang , Weiyu Xu

In some estimation problems, especially in applications dealing with information theory, signal processing and biology, theory provides us with additional information allowing us to restrict the parameter space to a finite number of points.…

Methodology · Statistics 2012-07-25 Christine Choirat , Raffaello Seri

In this paper, we study the problem of learning multi-dimensional Gaussian Mixture Models (GMMs), with a specific focus on model order selection and efficient mixing distribution estimation. We first establish an information-theoretic lower…

Machine Learning · Statistics 2026-03-23 Xinyu Liu , Hai Zhang

In a previous paper, we studied a kernel estimate of the upper edge of a two-dimensional bounded set, based upon the extreme values of a Poisson point process. The initial paper "Geffroy J. (1964) Sur un probl\`eme d'estimation…

Statistics Theory · Mathematics 2012-09-03 Stéphane Girard , Pierre Jacob