English
Related papers

Related papers: Adaptive quantile estimation in deconvolution with…

200 papers

When data is collected in an adaptive manner, even simple methods like ordinary least squares can exhibit non-normal asymptotic behavior. As an undesirable consequence, hypothesis tests and confidence intervals based on asymptotic normality…

Statistics Theory · Mathematics 2023-03-23 Koulik Khamaru , Yash Deshpande , Tor Lattimore , Lester Mackey , Martin J. Wainwright

Density estimation is a central task in statistics and machine learning. This problem aims to determine the underlying probability density function that best aligns with an observed data set. Some of its applications include statistical…

We research adaptive maximum likelihood-type estimation for an ergodic diffusion process where the observation is contaminated by noise. This methodology leads to the asymptotic independence of the estimators for the variance of observation…

Statistics Theory · Mathematics 2017-12-05 Shogo H. Nakakita , Masayuki Uchida

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

The design of unknown-input decoupled observers and filters requires the assumption of an existence condition in the literature. This paper addresses an unknown input filtering problem where the existence condition is not satisfied. Instead…

Systems and Control · Computer Science 2020-05-05 Peng Lu , Erik-Jan van Kampen , Cornelis C. de Visser , Qiping Chu

We devise powerful algorithms based on differential evolution for adaptive many-particle quantum metrology. Our new approach delivers adaptive quantum metrology policies for feedback control that are orders-of-magnitude more efficient and…

Quantum Physics · Physics 2013-06-04 Neil B. Lovett , Cécile Crosnier , Martí Perarnau-Llobet , Barry C. Sanders

Conformal prediction is a valuable tool for quantifying predictive uncertainty of machine learning models. However, its applicability relies on the assumption of data exchangeability, a condition which is often not met in real-world…

Machine Learning · Statistics 2024-12-30 Aleksandr Podkopaev , Darren Xu , Kuang-Chih Lee

We consider the following basic learning task: given independent draws from an unknown distribution over a discrete support, output an approximation of the distribution that is as accurate as possible in $\ell_1$ distance (i.e. total…

Machine Learning · Computer Science 2015-11-12 Gregory Valiant , Paul Valiant

Finite precision approximations of discrete probability distributions are considered, applicable for distribution synthesis, e.g., probabilistic shaping. Two algorithms are presented that find the optimal $M$-type approximation $Q$ of a…

Information Theory · Computer Science 2017-05-08 Georg Böcherer , Bernhard C. Geiger

We consider the problem of discounted optimal state-feedback regulation for general unknown deterministic discrete-time systems. It is well known that open-loop instability of systems, non-quadratic cost functions and complex nonlinear…

Systems and Control · Electrical Eng. & Systems 2020-03-31 Alexandros Tanzanakis , John Lygeros

In this letter we revisit the problem of optimal design of quantum tomographic experiments. In contrast to previous approaches where an optimal set of measurements is decided in advance of the experiment, we allow for measurements to be…

Quantum Physics · Physics 2017-02-28 Ferenc Huszár , Neil M. T. Houlsby

Achieving ultimate bounds in estimation processes is the main objective of quantum metrology. In this context, several problems require measurement of multiple parameters by employing only a limited amount of resources. To this end,…

We develop a collection of methods for adjusting the predictions of quantile regression to ensure coverage. Our methods are model agnostic and can be used to correct for high-dimensional overfitting bias with only minimal assumptions.…

Methodology · Statistics 2025-11-10 Isaac Gibbs , John J. Cherian , Emmanuel J. Candès

Quantile regression is a method to estimate the quantiles of the conditional distribution of a response variable, and as such it permits a much more accurate portrayal of the relationship between the response variable and observed…

Data Structures and Algorithms · Computer Science 2014-01-08 Jiyan Yang , Xiangrui Meng , Michael W. Mahoney

Let $(Y_i,\theta_i)$, $i=1,...,n$, be independent random vectors distributed like $(Y,\theta) \sim G^*$, where the marginal distribution of $\theta$ is completely unknown, and the conditional distribution of $Y$ conditional on $\theta$ is…

Statistics Theory · Mathematics 2014-06-24 Eitan Greenshtein , Theodor Itskov

The maximum entropy principle is a powerful tool for solving underdetermined inverse problems. This paper considers the problem of discretizing a continuous distribution, which arises in various applied fields. We obtain the approximating…

Numerical Analysis · Mathematics 2020-08-05 Ken'ichiro Tanaka , Alexis Akira Toda

This work addresses the problem of fusing two random vectors with unknown cross-correlations. We present a formulation and a numerical method for computing the optimal estimate in the minimax sense. We extend our formulation to linear…

Systems and Control · Computer Science 2016-10-05 Spyridon Leonardos , Kostas Daniilidis

We develop methods for forming prediction sets in an online setting where the data generating distribution is allowed to vary over time in an unknown fashion. Our framework builds on ideas from conformal inference to provide a general…

Methodology · Statistics 2021-12-10 Isaac Gibbs , Emmanuel Candès

The statistical analysis of data stemming from dynamical systems, including, but not limited to, time series, routinely relies on the estimation of information theoretical quantities, most notably Shannon entropy. To this purpose, possibly…

Information Theory · Computer Science 2021-09-01 Leonardo Ricci , Alessio Perinelli , Michele Castelluzzo

Motivated by the desire to numerically calculate rigorous upper and lower bounds on deviation probabilities over large classes of probability distributions, we present an adaptive algorithm for the reconstruction of increasing real-valued…

Numerical Analysis · Mathematics 2021-08-12 L. Bonnet , J. -L. Akian , É. Savin , T. J. Sullivan