English
Related papers

Related papers: Efficient negative-weight elimination in large hig…

200 papers

Label quality issues, such as noisy labels and imbalanced class distributions, have negative effects on model performance. Automatic reweighting methods identify problematic samples with label quality issues by recognizing their negative…

Human-Computer Interaction · Computer Science 2023-12-11 Weikai Yang , Yukai Guo , Jing Wu , Zheng Wang , Lan-Zhe Guo , Yu-Feng Li , Shixia Liu

We describe an embarrassingly parallel, anytime Monte Carlo method for likelihood-free models. The algorithm starts with the view that the stochasticity of the pseudo-samples generated by the simulator can be controlled externally by a…

Machine Learning · Computer Science 2015-12-03 Edward Meeds , Max Welling

Methods of approximate Bayesian computation (ABC) are increasingly used for analysis of complex models. A major challenge for ABC is over-coming the often inherent problem of high rejection rates in the accept/reject methods based on…

Computation · Statistics 2015-03-27 Fernando V. Bonassi , Mike West

The idea of rare event sampling is applied to the estimation of the performance of error-correcting codes. The essence of the idea is importance sampling of the pattern of noises in the channel by Multicanonical Monte Carlo, which enables…

Disordered Systems and Neural Networks · Physics 2009-11-13 Yukito Iba , Koji Hukushima

Subsampling techniques can reduce the computational costs of processing big data. Practical subsampling plans typically involve initial uniform sampling and refined sampling. With a subsample, big data inferences are generally built on the…

Methodology · Statistics 2022-09-13 Yan Fan , Yang Liu , Yukun Liu , Jing Qin

We propose a new Monte Carlo algorithm for complex discrete distributions. The algorithm is motivated by the N-Fold Way, which is an ingenious event-driven MCMC sampler that avoids rejection moves at any specific state. The N-Fold Way can…

Computation · Statistics 2012-06-26 Firas Hamze , Nando de Freitas

We demonstrate for the first time that ill-conditioned, non-smooth, constrained distributions in very high dimension, upwards of 100,000, can be sampled efficiently $\textit{in practice}$. Our algorithm incorporates constraints into the…

Machine Learning · Computer Science 2022-10-18 Yunbum Kook , Yin Tat Lee , Ruoqi Shen , Santosh S. Vempala

An important question in constructing Cross Validation (CV) estimators of the generalization error is whether rules can be established that allow "optimal" selection of the size of the training set, for fixed sample size $n$. We define the…

Statistics Theory · Mathematics 2015-11-11 Georgios Afendras , Marianthi Markatou

Studies using assays to quantify the expression of thousands of genes on tens to thousands of cell samples have been carried out for over 20 years. Such assays are based on microarrays, DNA sequencing or other molecular technologies. All…

Statistics Theory · Mathematics 2025-06-18 Jiming Jiang , Johann A. Gagnon-Bartsch , Terence P. Speed

Proposed here is a dynamic Monte-Carlo algorithm that is efficient in simulating dense systems of long flexible chain molecules. It expands on the configurational-bias Monte-Carlo method through the simultaneous generation of a large set of…

Statistical Mechanics · Physics 2018-08-29 Niels Boon

A Monte Carlo event generator is presented. An original algorithm is developed to simulate electron-positron scattering at energies and momentum transferred much more than the electron mass. The first-order electroweak radiative corrections…

High Energy Physics - Phenomenology · Physics 2007-05-23 A. B. Arbuzov

Large datasets are often affected by cell-wise outliers in the form of missing or erroneous data. However, discarding any samples containing outliers may result in a dataset that is too small to accurately estimate the covariance matrix.…

Statistics Theory · Mathematics 2023-11-13 Karim Lounici , Grégoire Pacreau

Importance sampling is a widely used technique to reduce the variance of a Monte Carlo estimator by an appropriate change of measure. In this work, we study importance sam- pling in the framework of diffusion process and consider the change…

Probability · Mathematics 2018-03-28 Carsten Hartmann , Christof Schütte , Marcus Weber , Wei Zhang

A two level sampling method is applied to variational Monte Carlo (VMC) that samples the one and two body parts of the wave function separately. The method is demonstrated on a single Li_2 molecule in free space and 32 H_2 molecules in a…

Computational Physics · Physics 2016-09-08 Mark Dewing

The performance of the Monte Carlo sampling methods relies on the crucial choice of a proposal density. The notion of optimality is fundamental to design suitable adaptive procedures of the proposal density within Monte Carlo schemes. This…

Computation · Statistics 2026-02-24 Fernando Llorente , Luca Martino

Gaussian Boson Sampling (GBS), which can be realized with a photonic quantum computing model, perform some special kind of sampling tasks. In [4], we introduced algorithms that use GBS samples to approximate Gaussian expectation problems.…

Quantum Physics · Physics 2025-02-28 Jørgen Ellegaard Andersen , Shan Shan

Importance sampling has been reported to produce algorithms with excellent empirical performance in counting problems. However, the theoretical support for its efficiency in these applications has been very limited. In this paper, we…

Probability · Mathematics 2009-08-10 Jose H. Blanchet

Precision theoretical predictions for high multiplicity scattering rely on the evaluation of increasingly complicated scattering amplitudes which come with an extremely high CPU cost. For state-of-the-art processes this can cause technical…

High Energy Physics - Phenomenology · Physics 2020-07-15 Simon Badger , Joseph Bullock

We review the basic outline of the highly successful diffusion Monte Carlo technique commonly used in contexts ranging from electronic structure calculations to rare event simulation and data assimilation, and propose a new class of…

Numerical Analysis · Mathematics 2017-10-10 Lek-Heng Lim , Jonathan Weare

Monte Carlo simulation is an important tool for modeling highly nonlinear systems (like particle colliders and cellular membranes), and random, floating-point numbers are their fuel. These random samples are frequently generated via the…

Computation · Statistics 2018-02-16 Keith Pedersen