English
Related papers

Related papers: Maximal Entropy Formalism and the Restricted Boltz…

200 papers

A restricted Boltzmann machine (RBM) learns a probability distribution over its input samples and has numerous uses like dimensionality reduction, classification and generative modeling. Conventional RBMs accept vectorized data that…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Cong Chen , Kim Batselier , Ching-Yun Ko , Ngai Wong

Quantum state reconstruction on a finite number of copies of a quantum system with informationally incomplete measurements does, as a rule, not yield a unique result. We derive a reconstruction scheme where both the likelihood and the von…

Quantum Physics · Physics 2011-07-12 Y. S. Teo , H. Zhu , B. -G. Englert , J. Rehacek , Z. Hradil

Restricted Boltzmann Machines (RBMs) are generative models which can learn useful representations from samples of a dataset in an unsupervised fashion. They have been widely employed as an unsupervised pre-training method in machine…

Machine Learning · Statistics 2013-09-13 Chris Häusler , Alex Susemihl , Martin P Nawrot , Manfred Opper

Generative models offer a direct way of modeling complex data. Energy-based models attempt to encode the statistical correlations observed in the data at the level of the Boltzmann weight associated with an energy function in the form of a…

Disordered Systems and Neural Networks · Physics 2024-04-10 Aurélien Decelle , Cyril Furtlehner , Alfonso De Jesus Navas Gómez , Beatriz Seoane

We develop a machine learning method to construct accurate ground-state wave functions of strongly interacting and entangled quantum spin as well as fermionic models on lattices. A restricted Boltzmann machine algorithm in the form of an…

Strongly Correlated Electrons · Physics 2017-11-30 Yusuke Nomura , Andrew S. Darmawan , Youhei Yamaji , Masatoshi Imada

Restricted Boltzmann Machine (RBM) is a bipartite graphical model that is used as the building block in energy-based deep generative models. Due to numerical stability and quantifiability of the likelihood, RBM is commonly used with…

Machine Learning · Statistics 2016-11-15 Chun-Liang Li , Siamak Ravanbakhsh , Barnabas Poczos

In the absence of experimental constraints, optimal measurement schemes for quantum state tomography are well understood. We consider the scenario where the experimenter doesn't have arbitrary freedom to construct their measurement set, and…

Quantum Physics · Physics 2014-01-22 Mohammadreza Mohammadi , Agata M. Branczyk

The entropy maximum approach (Maxent) was developed as a minimization of the subjective uncertainty measured by the Boltzmann--Gibbs--Shannon entropy. Many new entropies have been invented in the second half of the 20th century. Now there…

Data Analysis, Statistics and Probability · Physics 2013-11-07 A. N. Gorban

Sampling from constrained distributions has a wide range of applications, including in Bayesian optimization and robotics. Prior work establishes convergence and feasibility guarantees for constrained sampling, but assumes that the feasible…

Machine Learning · Computer Science 2026-05-13 Cornelius V. Braun , Tilman Burghoff , Marc Toussaint

The Maximum Entropy (MaxEnt) technique is applied to the derivation of the Gaussian Dispersion Plume Model as well as to more complex transport phenomena such as the one-dimensional advection equation, the one-dimensional diffusion…

Statistical Mechanics · Physics 2020-10-23 J. A. Secrest , J. M. Conroy , H. G. Miller

Inferring the input parameters of simulators from observations is a crucial challenge with applications from epidemiology to molecular dynamics. Here we show a simple approach in the regime of sparse data and approximately correct models,…

Methodology · Statistics 2022-04-06 Rainier Barrett , Mehrad Ansari , Gourab Ghoshal , Andrew D White

Restricted Boltzmann Machine (RBM) is a generative stochastic energy-based model of artificial neural network for unsupervised learning. Recently, RBM is well known to be a pre-training method of Deep Learning. In addition to visible and…

Neural and Evolutionary Computing · Computer Science 2018-07-12 Shin Kamada , Takumi Ichimura

An artificial neural network (ANN) with the restricted Boltzmann machine (RBM) architecture was recently proposed as a versatile variational quantum many-body wave function. In this work we provide physical insights into the performance of…

Disordered Systems and Neural Networks · Physics 2020-06-02 Artem Borin , Dmitry A. Abanin

We discuss the relations between restricted Boltzmann machine (RBM) states and the matrix product states (MPS) for the ground states of 1D translational invariant stabilizer codes. A generic translational invariant and finitely connected…

Strongly Correlated Electrons · Physics 2019-05-02 Yunqin Zheng , Huan He , Nicolas Regnault , B. Andrei Bernevig

Quantum Boltzmann machines (QBMs) are machine-learning models for both classical and quantum data. We give an operational definition of QBM learning in terms of the difference in expectation values between the model and target, taking into…

Quantum Physics · Physics 2025-02-13 Luuk Coopmans , Marcello Benedetti

The problem of assigning probability distributions which objectively reflect the prior information available about experiments is one of the major stumbling blocks in the use of Bayesian methods of data analysis. In this paper the method of…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

Classification of sequence data is the topic of interest for dynamic Bayesian models and Recurrent Neural Networks (RNNs). While the former can explicitly model the temporal dependencies between class variables, the latter have a capability…

Machine Learning · Computer Science 2018-03-12 Son N. Tran , Srikanth Cherla , Artur Garcez , Tillman Weyde

We investigate the thermodynamic properties of a Restricted Boltzmann Machine (RBM), a simple energy-based generative model used in the context of unsupervised learning. Assuming the information content of this model to be mainly reflected…

Disordered Systems and Neural Networks · Physics 2018-08-20 Aurélien Decelle , Giancarlo Fissore , Cyril Furtlehner

We present a theoretical analysis of Gaussian-binary restricted Boltzmann machines (GRBMs) from the perspective of density models. The key aspect of this analysis is to show that GRBMs can be formulated as a constrained mixture of…

Neural and Evolutionary Computing · Computer Science 2017-02-06 Nan Wang , Jan Melchior , Laurenz Wiskott

A Maximum Likelihood recursive state estimator is derived for non-linear and non-Gaussian state-space models. The estimator combines a particle filter to generate the conditional density and the Expectation Maximization algorithm to compute…

Methodology · Statistics 2021-03-22 Mohammad S. Ramadan , Robert R. Bitmead