English
Related papers

Related papers: Nonuniform Negative Sampling and Log Odds Correcti…

200 papers

A standard approach to computing expectations with respect to a given target measure is to introduce an overdamped Langevin equation which is reversible with respect to the target distribution, and to approximate the expectation by a…

Numerical Analysis · Mathematics 2016-04-20 A. B. Duncan , T. Lelievre , G. A. Pavliotis

Propensity score (PS) methods are widely used in observational studies to reduce confounding and estimate causal treatment effects. However, the validity of PS-based causal estimators depends heavily on correct model specification, and…

Several anomaly detection and classification methods rely on large amounts of non-anomalous or "normal" samples under the assump- tion that anomalous data is typically harder to acquire. This hypothesis becomes questionable in Few-Shot…

Machine Learning · Computer Science 2025-08-01 Aymane Abdali , Bartosz Boguslawski , Lucas Drumetz , Vincent Gripon

Weighted likelihood, in which one solves Horvitz-Thompson or inverse probability weighted (IPW) versions of the likelihood equations, offers a simple and robust method for fitting models to two phase stratified samples. We consider…

Statistics Theory · Mathematics 2007-06-13 Norman E. Breslow , Jon A. Wellner

This paper evaluates six strategies for mitigating imbalanced data: oversampling, undersampling, ensemble methods, specialized algorithms, class weight adjustments, and a no-mitigation approach referred to as the baseline. These strategies…

Machine Learning · Computer Science 2023-11-13 Jacques Wainer

In this work, we introduce a new acquisition function for sequential sampling to efficiently quantify rare-event statistics of an input-to-response (ItR) system with given input probability and expensive function evaluations. Our…

Robotics · Computer Science 2023-10-24 Xianliang Gong , Yulin Pan

In this work, we present a new random sampling method for data streams where the probability of an element's inclusion in the sample is proportional to a weight associated with that element. Our method is based on sampling with replacement,…

Data Structures and Algorithms · Computer Science 2026-03-18 Adriano Meligrana , Adriano Fazzone

Importance sampling is a widely used technique to estimate properties of a distribution. This paper investigates trading-off some bias for variance by adaptively winsorizing the importance sampling estimator. The novel winsorizing…

Computation · Statistics 2021-02-10 Paulo Orenstein

In this paper we consider the estimation of unknown parameters in Bayesian inverse problems. In most cases of practical interest, there are several barriers to performing such estimation, This includes a numerical approximation of a…

Methodology · Statistics 2025-02-07 Neil K. Chada , Ajay Jasra , Mohamed Maama , Raul Tempone

In this work, an adaptive predictive control scheme for linear systems with unknown parameters and bounded additive disturbances is proposed. In contrast to related adaptive control approaches that robustly consider the parametric…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Johannes Teutsch , Christopher Narr , Sebastian Kerz , Dirk Wollherr , Marion Leibold

Low-rank matrix completion concerns the problem of estimating unobserved entries in a matrix using a sparse set of observed entries. We consider the non-uniform setting where the observed entries are sampled with highly varying…

Machine Learning · Statistics 2024-03-04 Xumei Xi , Christina Lee Yu , Yudong Chen

We consider an empirical likelihood framework for inference for a statistical model based on an informative sampling design. Covariate information is incorporated both through the weights and the estimating equations. The estimator is based…

Methodology · Statistics 2019-05-03 Sanjay Chaudhuri , Mark S. Handcock

Weighting methods in causal inference have been widely used to achieve a desirable level of covariate balancing. However, the existing weighting methods have desirable theoretical properties only when a certain model, either the propensity…

Machine Learning · Statistics 2023-05-24 Insung Kong , Yuha Park , Joonhyuk Jung , Kwonsang Lee , Yongdai Kim

Computational capability often falls short when confronted with massive data, posing a common challenge in establishing a statistical model or statistical inference method dealing with big data. While subsampling techniques have been…

Methodology · Statistics 2024-10-31 Yixiao Ruan , Zan Li , Zhaohui Li , Dennis K. J. Lin , Qingpei Hu , Dan Yu

Negative sampling methods are vital in implicit recommendation models as they allow us to obtain negative instances from massive unlabeled data. Most existing approaches focus on sampling hard negative samples in various ways. These studies…

Information Retrieval · Computer Science 2023-11-08 Fuyuan Lyu , Yaochen Hu , Xing Tang , Yingxue Zhang , Ruiming Tang , Xue Liu

The negative binomial distribution has been widely used as a more flexible model than the Poisson distribution for count data. However, when the true data-generating process is Poisson, it is often challenging to distinguish it from a…

Statistics Theory · Mathematics 2026-04-07 Yingying Yang , Niloufar Dousti Mousavi , Zhou Yu , Jie Yang

In this paper, we introduce a new algorithm for rare event estimation based on adaptive importance sampling. We consider a smoothed version of the optimal importance sampling density, which is approximated by an ensemble of interacting…

Computation · Statistics 2023-04-19 Konstantin Althaus , Iason Papaioannou , Elisabeth Ullmann

We present a new, analytic, Poisson likelihood derived, technique to account for the statistical uncertainties inherent in simulation samples of limited size. This method has better coverage properties than other techniques, is valid for…

Data Analysis, Statistics and Probability · Physics 2019-07-26 Carlos A. Argüelles , Austin Schneider , Tianlu Yuan

The use of non-probability data sources for statistical purposes and for official statistics has become increasingly popular in recent years. However, statistical inference based on non-probability samples is made more difficult by nature…

Methodology · Statistics 2025-01-10 Maciej Beręsewicz , Marcin Szymkowiak , Piotr Chlebicki

Several interesting generative learning algorithms involve a complex probability distribution over many random variables, involving intractable normalization constants or latent variable normalization. Some of them may even not have an…

Machine Learning · Computer Science 2014-05-13 Yoshua Bengio , Li Yao , Kyunghyun Cho