English
Related papers

Related papers: The inefficiency of re-weighted sampling and the c…

200 papers

The process comparing the empirical cumulative distribution function of the sample with a parametric estimate of the cumulative distribution function is known as the empirical process with estimated parameters and has been extensively…

Methodology · Statistics 2012-10-08 Ivan Kojadinovic , Jun Yan

Class imbalance problem is commonly faced while developing machine learning models for real-life issues. Due to this problem, the fitted model tends to be biased towards the majority class data, which leads to lower precision, recall, AUC,…

Machine Learning · Computer Science 2019-08-20 Md. Adnan Arefeen , Sumaiya Tabassum Nimi , M Sohel Rahman

The pseudo-marginal algorithm is a variant of the Metropolis--Hastings algorithm which samples asymptotically from a probability distribution when it is only possible to estimate unbiasedly an unnormalized version of its density.…

Computation · Statistics 2019-12-04 Sebastian M. Schmon , George Deligiannidis , Arnaud Doucet , Michael K. Pitt

In clinical settings, we often face the challenge of building prediction models based on small observational data sets. For example, such a data set might be from a medical center in a multi-center study. Differences between centers might…

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

Deep neural networks have been shown to be very powerful modeling tools for many supervised learning tasks involving complex input patterns. However, they can also easily overfit to training set biases and label noises. In addition to…

Machine Learning · Computer Science 2019-05-07 Mengye Ren , Wenyuan Zeng , Bin Yang , Raquel Urtasun

Imbalanced data occurs in a wide range of scenarios. The skewed distribution of the target variable elicits bias in machine learning algorithms. One of the popular methods to combat imbalanced data is to artificially balance the data…

Machine Learning · Computer Science 2021-10-26 Firuz Kamalov , Ashraf Elnagar

Transition path sampling is a method for estimating the rates of rare events in molecular systems based on the gradual transformation of a path distribution containing a small fraction of reactive trajectories into a biased distribution in…

Statistical Mechanics · Physics 2015-10-28 Pierre Terrier , Mihai-Cosmin Marinica , Manuel Athènes

Computing the exact likelihood of data in large Bayesian networks consisting of thousands of vertices is often a difficult task. When these models contain many deterministic conditional probability tables and when the observed values are…

Computation · Statistics 2012-06-26 Ydo Wexler , Dan Geiger

A distribution shift between the training and test data can severely harm performance of machine learning models. Importance weighting addresses this issue by assigning different weights to data points during training. We argue that…

Machine Learning · Statistics 2025-11-17 Floris Holstege , Bram Wouters , Noud van Giersbergen , Cees Diks

De novo molecule generation can suffer from data inefficiency; requiring large amounts of training data or many sampled data points to conduct objective optimization. The latter is a particular disadvantage when combining deep generative…

Computational Engineering, Finance, and Science · Computer Science 2025-10-30 Morgan Thomas , Noel M. O'Boyle , Andreas Bender , Chris De Graaf

We commonly encounter the problem of identifying an optimally weight adjusted version of the empirical distribution of observed data, adhering to predefined constraints on the weights. Such constraints often manifest as restrictions on the…

Machine Learning · Statistics 2024-01-17 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

The computational costs of inference and planning have confined Bayesian model-based reinforcement learning to one of two dismal fates: powerful Bayes-adaptive planning but only for simplistic models, or powerful, Bayesian non-parametric…

Artificial Intelligence · Computer Science 2014-02-11 Arthur Guez , David Silver , Peter Dayan

We consider a novel challenge: approximating a distribution without the ability to randomly sample from that distribution. We study how such an approximation can be obtained using *weight queries*. Given some data set of examples, a weight…

Machine Learning · Computer Science 2021-07-15 Nadav Barak , Sivan Sabato

Randomized experiments are a crucial tool for causal inference in many different fields. Rerandomization addresses any covariate imbalance in such experiments by resampling treatment assignments until certain balance criteria are satisfied.…

Methodology · Statistics 2025-05-27 Jiuyao Lu , Daogao Liu , Zhanran Lin , Xiaomeng Wang

This paper addresses the issues of conservativeness and computational complexity of probabilistic robustness analysis. We solve both issues by defining a new sampling strategy and robustness measure. The new measure is shown to be much less…

Applications · Statistics 2008-05-12 Xinjia Chen , Kemin Zhou , Jorge L. Aravena

There has been great interest in enhancing the robustness of neural network classifiers to defend against adversarial perturbations through adversarial training, while balancing the trade-off between robust accuracy and standard accuracy.…

Machine Learning · Computer Science 2022-10-24 Chester Holtz , Tsui-Wei Weng , Gal Mishne

Clinical study populations often differ meaningfully from the broader populations to which results are intended to generalize. Weighting methods such as inverse probability of sampling weights (IPSW) reweight study participants to resemble…

Methodology · Statistics 2025-12-02 William Stewart , Carly L. Brantner , Elizabeth A. Stuart , Laine Thomas

Imbalanced response variable distribution is a common occurrence in data science. In fields such as fraud detection, medical diagnostics, system intrusion detection and many others where abnormal behavior is rarely observed the data under…

Machine Learning · Computer Science 2019-11-21 Firuz Kamalov