English
Related papers

Related papers: Using Inherent Structures to design Lean 2-layer R…

200 papers

Graphical models are powerful tools for modeling high-dimensional data, but learning graphical models in the presence of latent variables is well-known to be difficult. In this work we give new results for learning Restricted Boltzmann…

Machine Learning · Computer Science 2020-07-28 Surbhi Goel , Adam Klivans , Frederic Koehler

Many computer vision applications involve modeling complex spatio-temporal patterns in high-dimensional motion data. Recently, restricted Boltzmann machines (RBMs) have been widely used to capture and represent spatial patterns in a single…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Siqi Nie , Ziheng Wang , Qiang Ji

The great success of neural networks in recognizing hidden patterns and correlations in complex data lies in the way they take advantage of the large number of parameters and nonlinear single-unit activation, jointly. Restricted Boltzmann…

Disordered Systems and Neural Networks · Physics 2026-05-20 Giovanni di Sarra , Yasser Roudi

The Extreme Learning Machine (ELM) is a single-hidden layer feedforward neural network (SLFN) learning algorithm that can learn effectively and quickly. The ELM training phase assigns the input weights and bias randomly and does not change…

Neural and Evolutionary Computing · Computer Science 2017-08-18 Andre Pacheco , Renato Krohling , Carlos da Silva

We propose a new approach to combine Restricted Boltzmann Machines (RBMs) that can be used to solve combinatorial optimization problems. This allows synthesis of larger models from smaller RBMs that have been pretrained, thus effectively…

Machine Learning · Computer Science 2019-09-10 Saavan Patel , Sayeef Salahuddin

Understanding the results of deep neural networks is an essential step towards wider acceptance of deep learning algorithms. Many approaches address the issue of interpreting artificial neural networks, but often provide divergent…

Machine Learning · Computer Science 2021-11-16 Vadim Borisov , Johannes Meier , Johan van den Heuvel , Hamed Jalali , Gjergji Kasneci

Restricted Boltzmann Machines (RBM) are simple statistical models defined on a bipartite graph which have been successfully used in studying more complicated many-body systems, both classical and quantum. In this work, we exploit the…

Nuclear Theory · Physics 2021-01-13 Ermal Rrapaj , Alessandro Roggero

Implicit Neural Representations (INRs) have emerged as a powerful paradigm for representing signals such as images, 3D shapes, signed distance fields, and radiance fields. While significant progress has been made in architecture design…

Artificial Intelligence · Computer Science 2026-04-10 Plein Versace

The Restricted Boltzmann Machine (RBM), an important tool used in machine learning in particular for unsupervized learning tasks, is investigated from the perspective of its spectral properties. Starting from empirical observations, we…

Disordered Systems and Neural Networks · Physics 2018-01-17 Aurélien Decelle , Giancarlo Fissore , Cyril Furtlehner

Restricted Boltzmann machines (RBMs) have demonstrated considerable success as variational quantum states; however, their representational power remains incompletely understood. In this work, we present an analytical proof that RBMs can…

Quantum Physics · Physics 2025-05-29 Yuan-Hang Zhang , Zhian Jia , Yu-Chun Wu , Guang-Can Guo

We set up Restricted Boltzmann Machines (RBM) to reproduce the Long Range Ising (LRI) models of the Ohmic type in one dimension. The RBM parameters are tuned by using the standard machine learning procedure with an additional method of…

Statistical Mechanics · Physics 2017-01-03 Ken-Ichi Aoki , Tamao Kobayashi

This review deals with Restricted Boltzmann Machine (RBM) under the light of statistical physics. The RBM is a classical family of Machine learning (ML) models which played a central role in the development of deep learning. Viewing it as a…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle , Cyril Furtlehner

We consider restricted Boltzmann machines with a binary visible layer and a Gaussian hidden layer trained by an unlabelled dataset composed of noisy realizations of a single ground pattern. We develop a statistical mechanics framework to…

Disordered Systems and Neural Networks · Physics 2024-06-17 Alberto Fachechi , Elena Agliari , Miriam Aquaro , Anthony Coolen , Menno Mulder

What is the most brute-force way to install interpretable, controllable features into a model's activations? Controlling how LLMs internally represent concepts typically requires sophisticated methods to first identify, then intervene on…

Machine Learning · Computer Science 2026-02-10 Charles Ye , Jasmine Cui

Machine learning is becoming widely used in analyzing the thermodynamics of many-body condensed matter systems. Restricted Boltzmann Machine (RBM) aided Monte Carlo simulations have sparked interest recently, as they manage to speed up…

Statistical Mechanics · Physics 2021-01-22 Daniel Alcalde Puente , Ilya M. Eremin

Non-Hermitian (NH) quantum systems have emerged as a powerful framework for describing open quantum systems, non-equilibrium dynamics, and engineered quantum optical materials. However, solving the ground-state properties of NH systems is…

Quantum Physics · Physics 2025-12-17 Lavoisier Wah , Remmy Zen , Flore K. Kunst

The Restricted Boltzmann Machine (RBM) is a stochastic neural network capable of solving a variety of difficult tasks such as NP-Hard combinatorial optimization problems and integer factorization. The RBM architecture is also very compact;…

Machine Learning · Computer Science 2020-10-15 Saavan Patel , Philip Canoza , Sayeef Salahuddin

This paper describes a novel energy-based probabilistic distribution that represents complex-valued data and explains how to apply it to direct feature extraction from complex-valued spectra. The proposed model, the complex-valued…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-28 Toru Nakashika , Shinji Takaki , Junichi Yamagishi

We investigate the performance of machine learning algorithms trained exclusively with configurations obtained from importance sampling Monte Carlo simulations of the two-dimensional Ising model with conserved magnetization. For supervised…

Statistical Mechanics · Physics 2021-03-19 Ahmadreza Azizi , Michel Pleimling

Learning invariant representations is an important problem in machine learning and pattern recognition. In this paper, we present a novel framework of transformation-invariant feature learning by incorporating linear transformations into…

Machine Learning · Computer Science 2012-07-03 Kihyuk Sohn , Honglak Lee