English
Related papers

Related papers: Avoiding biases in binned fits

200 papers

The estimation of categorical response models using bias-reducing adjusted score equations has seen extensive theoretical research and applied use. The resulting estimates have been found to have superior frequentist properties to what…

Methodology · Statistics 2022-01-25 Ioannis Kosmidis

We ask: Can focusing on likely classes of a single, in-domain sample improve model predictions? Prior work argued ``no''. We put forward a novel rationale in favor of ``yes'': Sharedness of features among classes indicates their reliability…

Machine Learning · Computer Science 2025-12-23 Johannes Schneider

We consider an infinite balls-into-bins process with deletions where in each discrete step $t$ a coin is tossed as to whether, with probability $\beta(t) \in (0,1)$, a new ball is allocated using the Greedy[2] strategy (which places the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-17 Petra Berenbrink , Tom Friedetzky , Peter Kling , Lars Nagel

AIMS. The maximum-likelihood method is the standard approach to obtain model fits to observational data and the corresponding confidence regions. We investigate possible sources of bias in the log-likelihood function and its subsequent…

Astrophysics · Physics 2009-11-11 J. Hartlap , P. Simon , P. Schneider

State-of-the-art image-set matching techniques typically implicitly model each image-set with a Gaussian distribution. Here, we propose to go beyond these representations and model image-sets as probability distribution functions (PDFs)…

Computer Vision and Pattern Recognition · Computer Science 2015-08-03 Mehrtash Harandi , Mathieu Salzmann , Mahsa Baktashmotlagh

Regression analysis based on many covariates is becoming increasingly common. However, when the number of covariates $p$ is of the same order as the number of observations $n$, maximum likelihood regression becomes unreliable due to…

Methodology · Statistics 2023-09-06 Emanuele Massa , Marianne Jonker , Kit Roes , Anthony Coolen

Spurious correlations in training data significantly hinder the generalization capability of machine learning models when faced with distribution shifts, leading to the proposition of numberous debiasing methods. However, it remains to be…

Machine Learning · Computer Science 2025-05-22 Peng Kuang , Zhibo Wang , Zhixuan Chu , Jingyi Wang , Kui Ren

The paper described a generalized integrated glance to bin packing problems including a brief literature survey and some new problem formulations for the cases of multiset estimates of items. A new systemic viewpoint to bin packing problems…

Artificial Intelligence · Computer Science 2016-05-25 Mark Sh. Levin

We study the effectiveness of data-balancing for mitigating biases in contrastive language-image pretraining (CLIP), identifying areas of strength and limitation. First, we reaffirm prior conclusions that CLIP models can inadvertently…

Machine Learning · Computer Science 2024-03-08 Ibrahim Alabdulmohsin , Xiao Wang , Andreas Steiner , Priya Goyal , Alexander D'Amour , Xiaohua Zhai

Many statistical models in cosmology can be simulated forwards but have intractable likelihood functions. Likelihood-free inference methods allow us to perform Bayesian inference from these models using only forward simulations, free from…

Cosmology and Nongalactic Astrophysics · Physics 2018-04-11 Justin Alsing , Benjamin Wandelt , Stephen Feeney

This work proposes a new loss function targeting classification problems, utilizing a source of information overlooked by cross entropy loss. First, we derive a series of the tightest upper and lower bounds for the probability of a random…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Ali Ghobadzadeh , Amir Lashkari

Unfolding, in the context of high-energy particle physics, refers to the process of removing detector distortions in experimental data. The resulting unfolded measurements are straightforward to use for direct comparisons between…

We review recent literature that proposes to adapt ideas from classical model based optimal design of experiments to problems of data selection of large datasets. Special attention is given to bias reduction and to protection against…

Methodology · Statistics 2018-12-03 Elena Pesce , Eva Riccomagno

Positive-confidence (Pconf) classification [Ishida et al., 2018] is a promising weakly-supervised learning method which trains a binary classifier only from positive data equipped with confidence. However, in practice, the confidence may be…

Machine Learning · Statistics 2020-01-30 Kazuhiko Shinoda , Hirotaka Kaji , Masashi Sugiyama

Models for which the likelihood function can be evaluated only up to a parameter-dependent unknown normalising constant, such as Markov random field models, are used widely in computer science, statistical physics, spatial statistics, and…

Computation · Statistics 2016-02-12 Richard G. Everitt , Adam M. Johansen , Ellen Rowing , Melina Evdemon-Hogan

In many fields of science, generalized likelihood ratio tests are established tools for statistical inference. At the same time, it has become increasingly common that a simulator (or generative model) is used to describe complex processes…

Applications · Statistics 2016-03-21 Kyle Cranmer , Juan Pavez , Gilles Louppe

While the problem of estimating a probability density function (pdf) from its observations is classical, the estimation under additional shape constraints is both important and challenging. We introduce an efficient, geometric approach for…

Methodology · Statistics 2018-04-05 Sutanoy Dasgupta , Debdeep Pati , Ian H. Jermyn , Anuj Srivastava

Approximate Bayesian computation (ABC), also known as likelihood-free methods, have become a favourite tool for the analysis of complex stochastic models, primarily in population genetics but also in financial analyses. We advocated in…

Computation · Statistics 2015-03-18 Christian Robert , Jean-Michel Marin , Natesh S. Pillai

Data separation is a well-studied phenomenon that can cause problems in the estimation and inference from binary response models. Complete or quasi-complete separation occurs when there is a combination of regressors in the model whose…

Methodology · Statistics 2021-01-19 Susanne Köll , Ioannis Kosmidis , Christian Kleiber , Achim Zeileis

As Machine Learning models continue to be relied upon for making automated decisions, the issue of model bias becomes more and more prevalent. In this paper, we approach training a text classifica-tion model and optimize on bias…

Computation and Language · Computer Science 2019-08-19 Apik Ashod Zorian , Chandra Shekar Bikkanur