English
Related papers

Related papers: Fast Monte Carlo Dropout and Error Correction for …

200 papers

Great successes of deep neural networks have been witnessed in various real applications. Many algorithmic and implementation techniques have been developed, however, theoretical understanding of many aspects of deep neural networks is far…

Neural and Evolutionary Computing · Computer Science 2020-07-07 Wei Gao , Zhi-Hua Zhou

Dropout, a simple and effective way to train deep neural networks, has led to a number of impressive empirical successes and spawned many recent theoretical investigations. However, the gap between dropout's training and inference phases,…

Machine Learning · Computer Science 2017-02-17 Xuezhe Ma , Yingkai Gao , Zhiting Hu , Yaoliang Yu , Yuntian Deng , Eduard Hovy

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

Computation · Statistics 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

Uncertainty analysis in the outcomes of model predictions is a key element in decision-based material design to establish confidence in the models and evaluate the fidelity of models. Uncertainty Propagation (UP) is a technique to determine…

Machine Learning · Computer Science 2023-02-13 Danial Khatamsaz , Vahid Attari , Raymundo Arroyave , Douglas L. Allaire

We propose a Multi-level Monte Carlo technique to accelerate Monte Carlo sampling for approximation of properties of materials with random defects. The computational efficiency is investigated on test problems given by tight-binding models…

Numerical Analysis · Mathematics 2016-11-30 Petr Plecháč , Erik von Schwerin

This study explores the use of neural network-based analytic continuation to extract spectra from Monte Carlo data. We apply this technique to both synthetic and Monte Carlo-generated data. The training sets for neural networks are…

Disordered Systems and Neural Networks · Physics 2023-07-18 Kai-Wei Sun , Fa Wang

Dropout is a very effective way of regularizing neural networks. Stochastically "dropping out" units with a certain probability discourages over-specific co-adaptations of feature detectors, preventing overfitting and improving network…

Neural and Evolutionary Computing · Computer Science 2017-08-04 Pietro Morerio , Jacopo Cavazza , Riccardo Volpi , Rene Vidal , Vittorio Murino

Equality-constrained models naturally arise in problems in which measurements are taken at different levels of resolution. The challenge in this setting is that the models usually induce a joint distribution which is intractable. Resorting…

Computation · Statistics 2025-04-28 Shenggang Hu , Hongsheng Dai , Fanlin Meng , Louis Aslett , Murray Pollock , Gareth O. Roberts

While the use of deep learning in drug discovery is gaining increasing attention, the lack of methods to compute reliable errors in prediction for Neural Networks prevents their application to guide decision making in domains where…

Machine Learning · Computer Science 2019-06-25 Isidro Cortes-Ciriano , Andreas Bender

Precision theoretical predictions for high multiplicity scattering rely on the evaluation of increasingly complicated scattering amplitudes which come with an extremely high CPU cost. For state-of-the-art processes this can cause technical…

High Energy Physics - Phenomenology · Physics 2020-07-15 Simon Badger , Joseph Bullock

We propose a Monte Carlo sampler from the reverse diffusion process. Unlike the practice of diffusion models, where the intermediary updates -- the score functions -- are learned with a neural network, we transform the score matching…

Machine Learning · Statistics 2024-03-14 Xunpeng Huang , Hanze Dong , Yifan Hao , Yi-An Ma , Tong Zhang

Accurate brain tumor segmentation from MRI is vital for diagnosis and treatment planning. Although Monte Carlo (MC) Dropout is widely used to estimate model uncertainty, the effectiveness of variance-based uncertainty - computed as…

Machine Learning · Computer Science 2026-05-28 Saumya B

If the conclusion of a data analysis is sensitive to dropping very few data points, that conclusion might hinge on the particular data at hand rather than representing a more broadly applicable truth. How could we check whether this…

Methodology · Statistics 2024-11-12 Tin D. Nguyen , Ryan Giordano , Rachael Meager , Tamara Broderick

Computing systems interacting with real-world processes must safely and reliably process uncertain data. The Monte Carlo method is a popular approach for computing with such uncertain values. This article introduces a framework for…

Accurate proton dose calculation using Monte Carlo (MC) is computationally demanding in workflows like robust optimisation, adaptive replanning, and probabilistic inference, which require repeated evaluations. To address this, we develop a…

Machine Learning · Statistics 2025-09-24 Aaron Pim , Tristan Pryer

The memorization effect of deep learning hinders its performance to effectively generalize on test set when learning with noisy labels. Prior study has discovered that epistemic uncertainty techniques are robust when trained with noisy…

Machine Learning · Computer Science 2021-03-23 Purvi Goel , Li Chen

Uncertainty estimation in deep models is essential in many real-world applications and has benefited from developments over the last several years. Recent evidence suggests that existing solutions dependent on simple Gaussian formulations…

Machine Learning · Computer Science 2022-05-11 Jurijs Nazarovs , Ronak R. Mehta , Vishnu Suresh Lokhande , Vikas Singh

This paper develops a deep learning method for linear and nonlinear filtering. The idea is to start with a nominal dynamic model and generate Monte Carlo sample paths. Then these samples are used to train a deep neutral network. A least…

Optimization and Control · Mathematics 2020-08-11 Qing Zhang , George Yin , Leyi Wang

We describe an efficient Monte Carlo algorithm for a restricted class of scattering problems in radiation transfer. This class includes many astrophysically interesting problems, including the scattering of ultraviolet and visible light by…

Astrophysics · Physics 2007-05-23 Alan M. Watson , William J. Henney

In high-energy particle physics, complex Monte Carlo (MC) simulations are needed to compare theory predictions to measurable quantities. Many and large MC samples are needed to be generated to take into account all the systematics.…

High Energy Physics - Experiment · Physics 2022-11-15 Valentina Guglielmi