English
Related papers

Related papers: Appropriate and Inappropriate Estimation Technique…

200 papers

Model merging has emerged as an effective approach to combine multiple single-task models into a multitask model. This process typically involves computing a weighted average of the model parameters without any additional training. Existing…

Machine Learning · Computer Science 2025-04-28 Lu Li , Tianyu Zhang , Zhiqi Bu , Suyuchen Wang , Huan He , Jie Fu , Yonghui Wu , Jiang Bian , Yong Chen , Yoshua Bengio

Bayesian analysis is a framework for parameter estimation that applies even in uncertainty regimes where the commonly used local (frequentist) analysis based on the Cram\'er-Rao bound is not well defined. In particular, it applies when no…

Quantum Physics · Physics 2021-03-17 Simon Morelli , Ayaka Usui , Elizabeth Agudelo , Nicolai Friis

We consider the problem of estimating a random state vector when there is information about the maximum distances between its subvectors. The estimation problem is posed in a Bayesian framework in which the minimum mean square error (MMSE)…

Statistics Theory · Mathematics 2012-10-30 Dave Zachariah , Isaac Skog , Magnus Jansson , Peter Händel

Establishing bounds on the accuracy achievable by localization techniques represents a fundamental technical issue. Bounds on localization accuracy have been derived for cases in which the position of an agent is estimated on the basis of a…

Information Theory · Computer Science 2013-03-12 Francesco Montorsi , Santiago Mazuelas , Giorgio M. Vitetta , Moe Z. Win

The Median-of-Means (MoM) is a robust estimator widely used in machine learning that is known to be (minimax) optimal in scenarios where samples are i.i.d. In more grave scenarios, samples are contaminated by an adversary that can inspect…

Machine Learning · Statistics 2025-10-10 Xabier de Juan , Santiago Mazuelas

The horseshoe prior is known to possess many desirable properties for Bayesian estimation of sparse parameter vectors, yet its density function lacks an analytic form. As such, it is challenging to find a closed-form solution for the…

Machine Learning · Statistics 2022-11-08 Shu Yu Tew , Daniel F. Schmidt , Enes Makalic

Within the field of optimal transport (OT), the choice of ground cost is crucial to ensuring that the optimality of a transport map corresponds to usefulness in real-world applications. It is therefore desirable to use known information to…

Machine Learning · Statistics 2024-06-13 Samuel Howard , George Deligiannidis , Patrick Rebeschini , James Thornton

A bias-reduced estimator is proposed for the mean absolute deviation parameter of a median regression model. A workaround is devised for the lack of smoothness in the sense conventionally required in general bias-reduced estimation. A local…

Methodology · Statistics 2023-05-04 Michele Lambardi di San Miniato

In this paper, we develop a computational approach for estimating the mean value of a quantity in the presence of uncertainty. We demonstrate that, under some mild assumptions, the upper and lower bounds of the mean value are efficiently…

Statistics Theory · Mathematics 2013-11-05 Xinjia Chen

When conducting Bayesian inference, delayed acceptance (DA) Metropolis-Hastings (MH) algorithms and DA pseudo-marginal MH algorithms can be applied when it is computationally expensive to calculate the true posterior or an unbiased estimate…

Computation · Statistics 2016-06-02 Chris Sherlock , Andrew Golightly , Daniel A. Henderson

The Median of Means (MoM) is a mean estimator that has gained popularity in the context of heavy-tailed data. In this work, we analyze its performance in the task of simultaneously estimating the mean of each function in a class…

Machine Learning · Statistics 2025-06-23 Mikael Møller Høgsgaard , Andrea Paudice

Benchmarking estimation and its risk evaluation is a practically important issue in small area estimation. While Bayesian methods have been widely adopted in small area estimation, existing benchmarking approaches are often ad-hoc, such as…

Methodology · Statistics 2025-09-22 Shonosuke Sugasawa , Genya Kobayashi , Yuki Kawakubo

The paper deals with state estimation of a spatially distributed system given noisy measurements from pointwise-in-time-and-space threshold sensors spread over the spatial domain of interest. A Maximum A posteriori Probability (MAP)…

Systems and Control · Electrical Eng. & Systems 2019-09-24 Giorgio Battistelli , Luigi Chisci , Nicola Forti , Stefano Gherardini

The posterior in probabilistic programs with stochastic support decomposes as a weighted sum of the local posterior distributions associated with each possible program path. We show that making predictions with this full posterior…

Machine Learning · Computer Science 2024-04-15 Tim Reichelt , Luke Ong , Tom Rainforth

Two non-intrusive uncertainty propagation approaches are proposed for the performance analysis of engineering systems described by expensive-to-evaluate deterministic computer models with parameters defined as interval variables. These…

Signal Processing · Electrical Eng. & Systems 2022-02-15 Alice Cicirello , Filippo Giunta

Widely used methods for analyzing missing data can be biased in small samples. To understand these biases, we evaluate in detail the situation where a small univariate normal sample, with values missing at random, is analyzed using either…

Statistics Theory · Mathematics 2017-03-27 Paul T. von Hippel

The paper addresses state estimation for discrete-time systems with binary (threshold) measurements by following a Maximum A posteriori Probability (MAP) approach and exploiting a Moving Horizon (MH) approximation of the MAP cost-function.…

Systems and Control · Computer Science 2018-04-09 Giorgio Battistelli , Luigi Chisci , Nicola Forti , Stefano Gherardini

We study in this paper the consequences of using the Mean Absolute Percentage Error (MAPE) as a measure of quality for regression models. We show that finding the best model under the MAPE is equivalent to doing weighted Mean Absolute Error…

Machine Learning · Statistics 2015-06-16 Arnaud De Myttenaere , Boris Golden , Bénédicte Le Grand , Fabrice Rossi

One of the well-known challenges in optimal experimental design is how to efficiently estimate the nested integrations of the expected information gain. The Gaussian approximation and associated importance sampling have been shown to be…

Computation · Statistics 2021-08-17 Quan Long

An empirical Bayes approach to the estimation of possibly sparse sequences observed in Gaussian white noise is set out and investigated. The prior considered is a mixture of an atom of probability at zero and a heavy-tailed density \gamma,…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone , Bernard W. Silverman