English
Related papers

Related papers: Second-order optimisation strategies for neural ne…

200 papers

Monte Carlo methods use random sampling to estimate numerical quantities which are hard to compute deterministically. One important example is the use in statistical physics of rapidly mixing Markov chains to approximately compute partition…

Quantum Physics · Physics 2017-07-12 Ashley Montanaro

Neural-network quantum states (NQS) offer a versatile and expressive alternative to traditional variational ans\"atze for simulating physical systems. Energy-based frameworks, like Hopfield networks and Restricted Boltzmann Machines,…

Quantum Physics · Physics 2024-12-18 Manas Sajjan , Vinit Singh , Sabre Kais

We reformulate the projected imaginary-time evolution of Full Configuration Interaction Quantum Monte Carlo in terms of a Lagrangian minimization. This naturally leads to the admission of polynomial complex wavefunction parameterizations,…

Strongly Correlated Electrons · Physics 2017-05-03 Lauretta R. Schwarz , A. Alavi , George H. Booth

Quantum computing offers an alternative paradigm for addressing combinatorial optimization problems compared to classical computing. Despite recent hardware improvements, the execution of empirical quantum optimization experiments at scales…

The core components of many modern neural network architectures, such as transformers, convolutional, or graph neural networks, can be expressed as linear layers with $\textit{weight-sharing}$. Kronecker-Factored Approximate Curvature…

Machine Learning · Computer Science 2024-01-12 Runa Eschenhagen , Alexander Immer , Richard E. Turner , Frank Schneider , Philipp Hennig

We develop the idea of using Monte Carlo sampling of random portfolios to solve portfolio investment problems. In this first paper we explore the need for more general optimization tools, and consider the means by which constrained random…

Portfolio Management · Quantitative Finance 2010-08-24 William T. Shaw

Quantum computing was so far mainly concerned with discrete problems. Recently, E. Novak and the author studied quantum algorithms for high dimensional integration and dealt with the question, which advantages quantum computing can bring…

Quantum Physics · Physics 2016-09-08 Stefan Heinrich

In this note, variational Monte Carlo method based on neural quantum states for spin systems is reviewed. Using a neural network as the wave function allows for a more generalized expression of various types of interactions, including…

Strongly Correlated Electrons · Physics 2024-06-04 Yuntai Song

Solving the ground state of quantum many-body systems remains a fundamental challenge in physics and chemistry. Recent advancements in quantum hardware have opened new avenues for addressing this challenge. Inspired by the quantum-enhanced…

Quantum Physics · Physics 2025-06-10 Longfei Chang , Zhendong Li , Wei-Hai Fang

Recently developed neural network-based \emph{ab-initio} solutions (Pfau et. al arxiv:1909.02487v2) for finding ground states of fermionic systems can generate state-of-the-art results on a broad class of systems. In this work, we improve…

Chemical Physics · Physics 2021-03-26 Max Wilson , Nicholas Gao , Filip Wudarski , Eleanor Rieffel , Norm M. Tubman

In this study, we give an extension of Montanaro's arXiv/archive:1504.06987 quantum Monte Carlo method, tailored for computing expected values of random variables that exhibit infinite variance. This addresses a challenge in analyzing…

Quantum Physics · Physics 2024-03-08 Jose Blanchet , Mario Szegedy , Guanyang Wang

Quantum many-body problems are some of the most challenging problems in science and are central to demystifying some exotic quantum phenomena, e.g., high-temperature superconductors. The combination of neural networks (NN) for representing…

Quantum Physics · Physics 2022-12-23 Or Sharir , Garnet Kin-Lic Chan , Anima Anandkumar

Contemporary scientific studies often rely on the understanding of complex quantum systems via computer simulation. This paper initiates the statistical study of quantum simulation and proposes a Monte Carlo method for estimating…

Applications · Statistics 2011-08-04 Yazhen Wang

A notion of quantum natural evolution strategies is introduced, which provides a geometric synthesis of a number of known quantum/classical algorithms for performing classical black-box optimization. Recent work of Gomes et al. [2019] on…

Quantum Physics · Physics 2020-11-23 Tianchen Zhao , Giuseppe Carleo , James Stokes , Shravan Veerapaneni

We propose an efficient method for approximating natural gradient descent in neural networks which we call Kronecker-Factored Approximate Curvature (K-FAC). K-FAC is based on an efficiently invertible approximation of a neural network's…

Machine Learning · Computer Science 2020-06-09 James Martens , Roger Grosse

Second-order optimization methods have the ability to accelerate convergence by modifying the gradient through the curvature matrix. There have been many attempts to use second-order optimization methods for training deep neural networks.…

Machine Learning · Computer Science 2020-11-24 Kai-Xin Gao , Xiao-Lei Liu , Zheng-Hai Huang , Min Wang , Zidong Wang , Dachuan Xu , Fan Yu

Neural-network variational Monte Carlo (NNVMC) has emerged as a powerful tool for solving quantum many-body problems, yet systematic pathways for improving its accuracy remain largely heuristic. Here, we introduce a physically motivated…

Strongly Correlated Electrons · Physics 2026-04-20 Zhixuan Liu , Dongheng Qian , Jing Wang

High order perturbation theory has seen an unexpected recent revival for controlled calculations of quantum many-body systems, even at strong coupling. We adapt integration methods using low-discrepancy sequences to this problem. They…

Strongly Correlated Electrons · Physics 2020-08-27 Marjan Maček , Philipp T. Dumitrescu , Corentin Bertrand , Bill Triggs , Olivier Parcollet , Xavier Waintal

Artificial neural networks have been successfully incorporated into variational Monte Carlo method (VMC) to study quantum many-body systems. However, there have been few systematic studies of exploring quantum many-body physics using deep…

Strongly Correlated Electrons · Physics 2020-02-26 Li Yang , Zhaoqi Leng , Guangyuan Yu , Ankit Patel , Wen-Jun Hu , Han Pu

The variational quantum Monte Carlo (VQMC) method received significant attention in the recent past because of its ability to overcome the curse of dimensionality inherent in many-body quantum systems. Close parallels exist between VQMC and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-01 Tianchen Zhao , Saibal De , Brian Chen , James Stokes , Shravan Veerapaneni