English
Related papers

Related papers: Neural Autoregressive Control Variates for the Qua…

200 papers

Markov chain Monte Carlo (MCMC) is a powerful tool for sampling from complex probability distributions. Despite its versatility, MCMC often suffers from strong autocorrelation and the negative sign problem, leading to slowing down the…

Statistical Mechanics · Physics 2024-12-05 Synge Todo

We introduce inherent measures for effective quality control of brain segmentation based on a Bayesian fully convolutional neural network, using model uncertainty. Monte Carlo samples from the posterior distribution are efficiently…

Computer Vision and Pattern Recognition · Computer Science 2018-06-11 Abhijit Guha Roy , Sailesh Conjeti , Nassir Navab , Christian Wachinger

Stochastic gradient-based optimisation for discrete latent variable models is challenging due to the high variance of gradients. We introduce a variance reduction technique for score function estimators that makes use of double control…

Machine Learning · Statistics 2022-06-07 Michalis K. Titsias , Jiaxin Shi

The sign problem is a major obstacle in quantum Monte Carlo simulations for many-body fermion systems. We examine this problem with a new perspective based on the Majorana reflection positivity and Majorana Kramers positivity. Two…

Strongly Correlated Electrons · Physics 2018-01-19 Z. C. Wei , Congjun Wu , Yi Li , Shiwei Zhang , T. Xiang

The rise of artificial intelligence (AI) hinges on the efficient training of modern deep neural networks (DNNs) for non-convex optimization and uncertainty quantification, which boils down to a non-convex Bayesian learning problem. A…

Computation · Statistics 2023-06-01 Wei Deng

We introduce a method for non-uniform random number generation based on sampling a physical process in a controlled environment. We demonstrate one proof-of-concept implementation of the method that reduces the error of Monte Carlo…

Other Computer Science · Computer Science 2020-04-24 James Timothy Meech , Phillip Stanley-Marbell

Quantiles and expected shortfalls are usually used to measure risks of stochastic systems, which are often estimated by Monte Carlo methods. This paper focuses on the use of quasi-Monte Carlo (QMC) method, whose convergence rate is…

Numerical Analysis · Mathematics 2020-05-07 Zhijian He , Xiaoqun Wang

Various gradient compression schemes have been proposed to mitigate the communication cost in distributed training of large scale machine learning models. Sign-based methods, such as signSGD, have recently been gaining popularity because of…

Optimization and Control · Mathematics 2021-06-25 Mher Safaryan , Peter Richtárik

We consider the scenario where important signals are not strong enough to be separable from a large amount of noise. Such weak signals commonly exist in large-scale data analysis and play vital roles in many biomedical applications.…

Methodology · Statistics 2022-01-26 X. Jessie Jeng , Yifei Hu

Variance reduction techniques have been shown by others in the past to be a useful tool to reduce variance in Simulation studies. However, their application and success in the past has been mainly domain specific, with relatively little…

Computational Engineering, Finance, and Science · Computer Science 2013-06-03 Adrian Adewunmi , Uwe Aickelin

We generalize the previous study on the application of variational autoencoders to the two-dimensional Ising model to a system with anisotropy. Due to the self-duality property of the system, the critical points can be located exactly for…

Disordered Systems and Neural Networks · Physics 2023-10-31 Anshumitra Baul , Nicholas Walker , Juana Moreno , Ka-Ming Tam

Existing work on risk-sensitive reinforcement learning - both for symmetric and downside risk measures - has typically used direct Monte-Carlo estimation of policy gradients. While this approach yields unbiased gradient estimates, it also…

Machine Learning · Computer Science 2020-07-09 Thomas Spooner , Rahul Savani

Control variates are variance reduction tools for Monte Carlo estimators. They can provide significant variance reduction, but usually require a large number of samples, which can be prohibitive when sampling or evaluating the integrand is…

Methodology · Statistics 2023-06-08 Zhuo Sun , Alessandro Barp , François-Xavier Briol

We show here that a direct application of resummation-based quantum Monte Carlo (QMC) -- implemented recently for sign-problem-free SU(2)-symmetric Hamiltonians in the stochastic series expansion (SSE) framework -- does not reduce the sign…

Strongly Correlated Electrons · Physics 2023-08-15 Nisheeta Desai , Sumiran Pujari

Micro-Action Recognition (MAR) has gained increasing attention due to its crucial role as a form of non-verbal communication in social interactions, with promising potential for applications in human communication and emotion analysis.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Kun Li , Dan Guo , Guoliang Chen , Chunxiao Fan , Jingyuan Xu , Zhiliang Wu , Hehe Fan , Meng Wang

Autoregressive decoding is the only part of sequence-to-sequence models that prevents them from massive parallelization at inference time. Non-autoregressive models enable the decoder to generate all output symbols independently in…

Computation and Language · Computer Science 2018-11-13 Jindřich Libovický , Jindřich Helcl

We marry tensor network states (TNS) and projector quantum Monte Carlo (PMC) to overcome the high computational scaling of TNS and the sign problem of PMC. Using TNS as trial wavefunctions provides a route to systematically improve the sign…

Strongly Correlated Electrons · Physics 2014-07-04 Sebastian Wouters , Brecht Verstichel , Dimitri Van Neck , Garnet Kin-Lic Chan

Variational quantum algorithms hold great promise for unlocking the power of near-term quantum processors, yet high measurement costs, barren plateaus, and challenging optimization landscapes frequently hinder them. Here, we introduce…

Quantum Physics · Physics 2026-03-10 Mengzhen Ren , Yu-Cheng Chen , Yangsen Ye , Min-Hsiu Hsieh , Alice Hu , Chang-Yu Hsieh

Autoregressive models are typically applied to sequences of discrete tokens, but recent research indicates that generating sequences of continuous embeddings in an autoregressive manner is also feasible. However, such Continuous…

Machine Learning · Computer Science 2024-11-28 Marco Pasini , Javier Nistal , Stefan Lattner , George Fazekas

We study the sign problem in the Hubbard model on the hexagonal lattice away from half-filling using the Lefschetz thimbles method. We identify the saddle points, reduce their amount, and perform quantum Monte Carlo (QMC) simulations using…

Strongly Correlated Electrons · Physics 2019-06-13 Maksim Ulybyshev , Christopher Winterowd , Savvas Zafeiropoulos