English
Related papers

Related papers: Sparse generative modeling via parameter-reduction…

200 papers

A hybrid quantum-classical method for learning Boltzmann machines (BM) for a generative and discriminative task is presented. Boltzmann machines are undirected graphs with a network of visible and hidden nodes where the former is used as…

Quantum Physics · Physics 2022-07-21 Siddhartha Srivastava , Veera Sundararaghavan

Using a low-dimensional parametrization of signals is a generic and powerful way to enhance performance in signal processing and statistical inference. A very popular and widely explored type of dimensionality reduction is sparsity; another…

Statistics Theory · Mathematics 2020-04-02 Benjamin Aubin , Bruno Loureiro , Antoine Maillard , Florent Krzakala , Lenka Zdeborová

To quantify how well theoretical predictions of structural ensembles agree with experimental measurements, we depend on the accuracy of forward models. These models are computational frameworks that generate observable quantities from…

Biological Physics · Physics 2025-11-04 Robert M. Raddi , Tim Marshall , Vincent A. Voelz

Penalized transformation models (PTMs) are a semiparametric location-scale regression family that estimate a response's conditional distribution directly from the data, and model the location and scale through structured additive…

Methodology · Statistics 2025-09-22 Johannes Brachem , Paul F. V. Wiemann , Thomas Kneib

Learning Ising or Potts models from data has become an important topic in statistical physics and computational biology, with applications to predictions of structural contacts in proteins and other areas of biological data analysis. The…

Biological Physics · Physics 2018-09-19 Chen-Yi Gao , Hai-Jun Zhou , Erik Aurell

The paper focuses on the a posteriori tuning of a generative model in order to favor the generation of good instances in the sense of some external differentiable criterion. The proposed approach, called Boltzmann Tuning of Generative…

Artificial Intelligence · Computer Science 2021-04-13 Victor Berger , Michele Sebag

The ancestral sequence reconstruction problem is the inference, back in time, of the properties of common sequence ancestors from measured properties of contemporary populations. Standard algorithms for this problem assume independent…

Disordered Systems and Neural Networks · Physics 2022-02-09 Edwin Rodríguez Horta , Alejandro Lage-Castellanos , Roberto Mulet

The Restricted Boltzmann Machine (RBM) is one of the simplest generative neural networks capable of learning input distributions. Despite its simplicity, the analysis of its performance in learning from the training data is only well…

Machine Learning · Computer Science 2025-11-13 Yizhou Xu , Florent Krzakala , Lenka Zdeborová

In this work, we consider compressed sensing reconstruction from $M$ measurements of $K$-sparse structured signals which do not possess a writable correlation model. Assuming that a generative statistical model, such as a Boltzmann machine,…

Information Theory · Computer Science 2017-03-24 Eric W. Tramel , Andre Manoel , Francesco Caltagirone , Marylou Gabrié , Florent Krzakala

Restricted Boltzmann machines (RBMs) and their variants are usually trained by contrastive divergence (CD) learning, but the training procedure is an unsupervised learning approach, without any guidances of the background knowledge. To…

Machine Learning · Computer Science 2018-12-06 Jielei Chu , Hongjun Wang , Hua Meng , Peng Jin , Tianrui Li

The Boltzmann Machine (BM) is a neural network composed of stochastically firing neurons that can learn complex probability distributions by adapting the synaptic interactions between the neurons. BMs represent a very generic class of…

Mesoscale and Nanoscale Physics · Physics 2021-09-16 Brian Kiraly , Elze J. Knol , Hilbert J. Kappen , Alexander A. Khajetoorians

Restricted Boltzmann Machines (RBMs) are powerful tools for modeling complex systems and extracting insights from data, but their training is hindered by the slow mixing of Markov Chain Monte Carlo (MCMC) processes, especially with highly…

Machine Learning · Computer Science 2025-12-09 Nicolas Béreux , Aurélien Decelle , Cyril Furtlehner , Lorenzo Rosset , Beatriz Seoane

Many real-world tasks, from associative memory to symbolic reasoning, benefit from discrete, structured representations that standard continuous latent models can struggle to express. We introduce the Gaussian-Multinoulli Restricted…

Machine Learning · Computer Science 2026-03-11 Nikhil Kapasi , Mohamed Elfouly , William Whitehead , Luke Theogarajan

Understanding protein-protein interactions is central to our understanding of almost all complex biological processes. Computational tools exploiting rapidly growing genomic databases to characterize protein-protein interactions are…

Quantitative Methods · Quantitative Biology 2016-10-28 Thomas Gueudré , Carlo Baldassi , Marco Zamparo , Martin Weigt , Andrea Pagnani

Restricted Boltzmann Machines (RBMs) are a common family of undirected graphical models with latent variables. An RBM is described by a bipartite graph, with all observed variables in one layer and all latent variables in the other. We…

Machine Learning · Computer Science 2020-10-20 Guy Bresler , Rares-Darius Buhai

Restricted Boltzmann Machine (RBM) is a bipartite graphical model that is used as the building block in energy-based deep generative models. Due to numerical stability and quantifiability of the likelihood, RBM is commonly used with…

Machine Learning · Statistics 2016-11-15 Chun-Liang Li , Siamak Ravanbakhsh , Barnabas Poczos

Substantial research on structured sparsity has contributed to analysis of many different applications. However, there have been few Bayesian procedures among this work. Here, we develop a Bayesian model for structured sparsity that uses a…

Methodology · Statistics 2014-07-09 Barbara E. Engelhardt , Ryan P. Adams

Sparse variational approximations allow for principled and scalable inference in Gaussian Process (GP) models. In settings where several GPs are part of the generative model, theses GPs are a posteriori coupled. For many applications such…

Machine Learning · Statistics 2017-11-30 Vincent Adam

Recently described stochastic models of protein evolution have demonstrated that the inclusion of structural information in addition to amino acid sequences leads to a more reliable estimation of evolutionary parameters. We present a…

Populations and Evolution · Quantitative Biology 2020-09-22 Michael Golden , Eduardo García-Portugués , Michael Sørensen , Kanti V. Mardia , Thomas Hamelryck , Jotun Hein

Conditional generative models are capable of using contextual information as input to create new imaginative outputs. Conditional Restricted Boltzmann Machines (CRBMs) are one class of conditional generative models that have proven to be…

Machine Learning · Computer Science 2023-05-16 Alex H. Lang , Anton D. Loukianov , Charles K. Fisher