English
Related papers

Related papers: Double descent: When do neural quantum states gene…

200 papers

Due to the exponential growth of the Hilbert space dimension with system size, the simulation of quantum many-body systems has remained a persistent challenge until today. Here, we review a relatively new class of variational states for the…

Disordered Systems and Neural Networks · Physics 2024-07-29 Hannah Lange , Anka Van de Walle , Atiye Abedinnia , Annabelle Bohrdt

The double descent phenomenon challenges traditional statistical learning theory by revealing scenarios where larger models do not necessarily lead to reduced performance on unseen data. While this counterintuitive behavior has been…

Neural quantum states (NQS) attract a lot of attention due to their potential to serve as a very expressive variational ansatz for quantum many-body systems. Here we study the main factors governing the applicability of NQS to frustrated…

Disordered Systems and Neural Networks · Physics 2020-04-06 Tom Westerhout , Nikita Astrakhantsev , Konstantin S. Tikhonov , Mikhail Katsnelson , Andrey A. Bagrov

Modern deep learning models employ considerably more parameters than required to fit the training data. Whereas conventional statistical wisdom suggests such models should drastically overfit, in practice these models generalize remarkably…

Machine Learning · Statistics 2020-08-18 Ben Adlam , Jeffrey Pennington

Empirically it has been observed that the performance of deep neural networks steadily improves as we increase model size, contradicting the classical view on overfitting and generalization. Recently, the double descent phenomena has been…

Machine Learning · Computer Science 2021-07-28 Ilja Kuzborskij , Csaba Szepesvári , Omar Rivasplata , Amal Rannen-Triki , Razvan Pascanu

The rapid development of neural quantum states (NQS) has established it as a promising framework for studying quantum many-body systems. In this work, by leveraging the cutting-edge transformer-based architectures and developing highly…

Strongly Correlated Electrons · Physics 2025-07-11 Yuntian Gu , Wenrui Li , Heng Lin , Bo Zhan , Ruichen Li , Yifei Huang , Di He , Yantao Wu , Tao Xiang , Mingpu Qin , Liwei Wang , Dingshun Lv

We propose a hybrid variational framework that enhances Neural Quantum States (NQS) with a Normalising Flow-based sampler to improve the expressivity and trainability of quantum many-body wavefunctions. Our approach decouples the sampling…

Quantum Physics · Physics 2025-06-17 Vishal S. Ngairangbam , Michael Spannowsky , Timur Sypchenko

`Double descent' delineates the generalization behaviour of models depending on the regime they belong to: under- or over-parameterized. The current theoretical understanding behind the occurrence of this phenomenon is primarily based on…

Machine Learning · Statistics 2022-03-15 Sidak Pal Singh , Aurelien Lucchi , Thomas Hofmann , Bernhard Schölkopf

Neural quantum state (NQS) ans\"atze have shown promise in variational Monte Carlo algorithms by their theoretical capability of representing any quantum state. However, the reason behind the practical improvement in their performance with…

Quantum Physics · Physics 2025-03-11 Sidhartha Dash , Luca Gravina , Filippo Vicentini , Michel Ferrero , Antoine Georges

Recent progress in the design and optimization of neural-network quantum states (NQSs) has made them an effective method to investigate ground-state properties of quantum many-body systems. In contrast to the standard approach of training a…

Disordered Systems and Neural Networks · Physics 2024-12-18 Riccardo Rende , Sebastian Goldt , Federico Becca , Luciano Loris Viteritti

A key challenge in building theoretical foundations for deep learning is the complex optimization dynamics of neural networks, resulting from the high-dimensional interactions between the large number of network parameters. Such non-trivial…

Machine Learning · Computer Science 2021-12-07 Mohammad Pezeshki , Amartya Mitra , Yoshua Bengio , Guillaume Lajoie

Neural quantum states (NQS) are a novel class of variational many-body wave functions that are very flexible in approximating diverse quantum states. Optimization of an NQS ansatz requires sampling from the corresponding probability…

Strongly Correlated Electrons · Physics 2021-09-15 Andrey A. Bagrov , Askar A. Iliasov , Tom Westerhout

Neural-network quantum states (NQS) are powerful neural-network ans\"atzes that have emerged as promising tools for studying quantum many-body physics through the lens of the variational principle. These architectures are known to be…

Disordered Systems and Neural Networks · Physics 2025-07-28 Jake McNaughton , Mohamed Hibat-Allah

Double-descent curves in neural networks describe the phenomenon that the generalisation error initially descends with increasing parameters, then grows after reaching an optimal number of parameters which is less than the number of data…

Machine Learning · Statistics 2023-05-29 Ouns El Harzli , Bernardo Cuenca Grau , Guillermo Valle-Pérez , Ard A. Louis

As neural networks are known to efficiently represent classes of tensor-network states as well as volume-law-entangled states, identifying which properties determine the representational capabilities of neural quantum states (NQS) remains…

Nuclear Theory · Physics 2026-03-31 James W. T. Keeble , Alessandro Lovato , Caroline E. P. Robin

Conventional statistical wisdom established a well-understood relationship between model complexity and prediction error, typically presented as a U-shaped curve reflecting a transition between under- and overfitting regimes. However,…

Machine Learning · Statistics 2023-10-31 Alicia Curth , Alan Jeffares , Mihaela van der Schaar

Combining empirical risk minimization with capacity control is a classical strategy in machine learning when trying to control the generalization gap and avoid overfitting, as the model class capacity gets larger. Yet, in modern deep…

Machine Learning · Computer Science 2024-03-18 Marc Lafon , Alexandre Thomas

We study infinite limits of neural network quantum states ($\infty$-NNQS), which exhibit representation power through ensemble statistics, and also tractable gradient descent dynamics. Ensemble averages of Renyi entropies are expressed in…

Quantum Physics · Physics 2023-09-29 Di Luo , James Halverson

The representation of a quantum wave function as a neural network quantum state (NQS) provides a powerful variational ansatz for finding the ground states of many-body quantum systems. Nevertheless, due to the complex variational landscape,…

Quantum Physics · Physics 2023-12-06 Eimantas Ledinauskas , Egidijus Anisimovas

Although overparameterized models have achieved remarkable practical success, their theoretical properties, particularly their generalization behavior, remain incompletely understood. The well known double descents phenomenon suggests that…

Machine Learning · Statistics 2026-01-06 Haoran Zhan , Yingcun Xia
‹ Prev 1 2 3 10 Next ›