English
Related papers

Related papers: Developing a Maximum-Entropy Restricted Boltzmann …

200 papers

The Restricted Boltzmann Machine (RBM) is one of the simplest generative neural networks capable of learning input distributions. Despite its simplicity, the analysis of its performance in learning from the training data is only well…

Machine Learning · Computer Science 2025-11-13 Yizhou Xu , Florent Krzakala , Lenka Zdeborová

Large-scale electrophysiological recordings now allow simultaneous monitoring of thousands of neurons across multiple brain regions, revealing structured variability in neural population activity. Understanding how these collective patterns…

Neurons and Cognition · Quantitative Biology 2026-03-12 Nicolas Béreux , Giovanni Catania , Aurélien Decelle , Francesca Mignacco , Alfonso de Jesús Navas Gómez , Beatriz Seoane

Machine learning, one of today's most rapidly growing interdisciplinary fields, promises an unprecedented perspective for solving intricate quantum many-body problems. Understanding the physical aspects of the representative artificial…

Disordered Systems and Neural Networks · Physics 2017-05-12 Dong-Ling Deng , Xiaopeng Li , S. Das Sarma

Machine learning is becoming widely used in analyzing the thermodynamics of many-body condensed matter systems. Restricted Boltzmann Machine (RBM) aided Monte Carlo simulations have sparked interest recently, as they manage to speed up…

Statistical Mechanics · Physics 2021-01-22 Daniel Alcalde Puente , Ilya M. Eremin

We investigate the Ising and Heisenberg models using the Block Renormalization Group Method (BRGM), focusing on its behavior across different system sizes. The BRGM reduces the number of spins by a factor of 1/2 (1/3) for the Ising…

The eigenvalue problem of quantum many-body systems is a fundamental and challenging subject in condensed matter physics, since the dimension of the Hilbert space (and hence the required computational memory and time) grows exponentially as…

Disordered Systems and Neural Networks · Physics 2021-05-12 Chen-Yu Liu , Daw-Wei Wang

We show that the mutual information between the representation of a learning machine and the hidden features that it extracts from data is bounded from below by the relevance, which is the entropy of the model's energy distribution. Models…

Data Analysis, Statistics and Probability · Physics 2021-01-28 O Duranthon , M Marsili , R Xie

Restricted Boltzmann Machines (RBMs) are typically trained using finite-length Gibbs chains under a fixed sampling temperature. This practice implicitly assumes that the stochastic regime remains valid as the energy landscape evolves during…

Machine Learning · Computer Science 2026-03-04 Görkem Can Süleymanoğlu

We propose a data-driven approach using a Restricted Boltzmann Machine (RBM) to solve the Schr\"odinger equation in configuration space. Traditional Configuration Interaction (CI) methods construct the wavefunction as a linear combination…

We define a message-passing algorithm for computing magnetizations in Restricted Boltzmann machines, which are Ising models on bipartite graphs introduced as neural network models for probability distributions over spin configurations. To…

Machine Learning · Computer Science 2020-12-02 Burak Çakmak , Manfred Opper

We develop a machine learning method to construct accurate ground-state wave functions of strongly interacting and entangled quantum spin as well as fermionic models on lattices. A restricted Boltzmann machine algorithm in the form of an…

Strongly Correlated Electrons · Physics 2017-11-30 Yusuke Nomura , Andrew S. Darmawan , Youhei Yamaji , Masatoshi Imada

Restricted Boltzmann machines (RBMs) are endowed with the universal power of modeling (binary) joint distributions. Meanwhile, as a result of their confining network structure, training RBMs confronts less difficulties (compared with more…

Machine Learning · Computer Science 2015-10-22 Sai Zhang

Inferring a generative model from data is a fundamental problem in machine learning. It is well-known that the Ising model is the maximum entropy model for binary variables which reproduces the sample mean and pairwise correlations.…

Statistical Mechanics · Physics 2018-06-19 Soma Turi , Alpha A. Lee

Theoretical understanding of how deep neural network (DNN) extracts features from input images is still unclear, but it is widely believed that the extraction is performed hierarchically through a process of coarse-graining. It reminds us…

High Energy Physics - Theory · Physics 2018-05-16 Satoshi Iso , Shotaro Shiba , Sumito Yokoo

We consider a special type of Restricted Boltzmann machine (RBM), namely a Gaussian-spherical RBM where the visible units have Gaussian priors while the vector of hidden variables is constrained to stay on an ${\mathbbm L}_2$ sphere. The…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle , Cyril Furtlehner

Maximum entropy inference and learning of graphical models are pivotal tasks in learning theory and optimization. This work extends algorithms for these problems, including generalized iterative scaling (GIS) and gradient descent (GD), to…

Machine Learning · Computer Science 2024-07-17 Minbo Gao , Zhengfeng Ji , Fuchao Wei

We describe a novel method to obtain thermodynamic properties of quantum systems using Baysian Inference -- Maximum Entropy techniques. The method is applicable to energy values sampled at a discrete set of temperatures from Quantum Monte…

Condensed Matter · Physics 2009-10-31 Carey Huscroft , Richard Gass , Mark Jarrell

Virtually, every ab-initio electronic structure method (Coupled Cluster, DMRG, etc.) can be viewed as an algorithm to compress the ground-state wavefunction. This compression is usually obtained by exploiting some physical structure of the…

Chemical Physics · Physics 2023-04-04 Anderson D. S. Duraes

We set up Restricted Boltzmann Machines (RBM) to reproduce the Long Range Ising (LRI) models of the Ohmic type in one dimension. The RBM parameters are tuned by using the standard machine learning procedure with an additional method of…

Statistical Mechanics · Physics 2017-01-03 Ken-Ichi Aoki , Tamao Kobayashi

The heat capacity $\mathcal{C}$ of a given probe is a fundamental quantity that determines, among other properties, the maximum precision in temperature estimation. In turn, $\mathcal{C}$ is limited by a quadratic scaling with the number of…