中文
相关论文

相关论文: Understanding Minimum Probability Flow for RBMs Un…

200 篇论文

Energy-based models (EBMs) are a powerful class of probabilistic generative models due to their flexibility and interpretability. However, relationships between potential flows and explicit EBMs remain underexplored, while contrastive…

This paper studies the problem of parameter learning in probabilistic graphical models having latent variables, where the standard approach is the expectation maximization algorithm alternating expectation (E) and maximization (M) steps.…

机器学习 · 计算机科学 2017-02-15 Hyeryung Jang , Hyungwon Choi , Yung Yi , Jinwoo Shin

The instability is shown in the existing methods of representation learning based on Euclidean distance under a broad set of conditions. Furthermore, the scarcity and high cost of labels prompt us to explore more expressive representation…

机器学习 · 计算机科学 2021-10-07 Jielei Chu , Jing Liu , Hongjun Wang , Meng Hua , Zhiguo Gong , Tianrui Li

Despite their appeal as physics-inspired, energy-based and generative nature, general Boltzmann Machines (BM) are considered intractable to train. This belief led to simplified models of BMs with restricted intralayer connections or…

新兴技术 · 计算机科学 2024-01-05 Shuvro Chowdhury , Shaila Niazi , Kerem Y. Camsari

We present Preference Flow Matching (PFM), a new framework for preference-based reinforcement learning (PbRL) that streamlines the integration of preferences into an arbitrary class of pre-trained models. Existing PbRL methods require…

机器学习 · 计算机科学 2024-10-29 Minu Kim , Yongsik Lee , Sehyeok Kang , Jihwan Oh , Song Chong , Se-Young Yun

RBM-MPC is a computationally efficient variant of Model Predictive Control (MPC) in which the Random Batch Method (RBM) is used to speed up the finite-horizon optimal control problems at each iteration. In this paper, stability and…

最优化与控制 · 数学 2024-03-08 Daniël Veldman , Alexandra Borkowski , Enrique Zuazua

By planning through a learned dynamics model, model-based reinforcement learning (MBRL) offers the prospect of good performance with little environment interaction. However, it is common in practice for the learned model to be inaccurate,…

机器学习 · 计算机科学 2021-03-31 Behzad Haghgoo , Allan Zhou , Archit Sharma , Chelsea Finn

Efficient sampling of complex data distributions can be achieved using trained invertible flows (IF), where the model distribution is generated by pushing a simple base distribution through multiple non-linear bijective transformations.…

机器学习 · 计算机科学 2021-07-13 Daniel O'Connor , Walter Vinci

Conditional flow matching (CFM) stands out as an efficient, simulation-free approach for training flow-based generative models, achieving remarkable performance for data generation. However, CFM is insufficient to ensure accuracy in…

机器学习 · 计算机科学 2026-02-03 Yuhao Huang , Taos Transue , Shih-Hsin Wang , William Feldman , Hong Zhang , Bao Wang

Restricted Boltzmann Machines (RBM) have attracted a lot of attention of late, as one the principle building blocks of deep networks. Training RBMs remains problematic however, because of the intractibility of their partition function. The…

机器学习 · 统计学 2010-12-17 Guillaume Desjardins , Aaron Courville , Yoshua Bengio

Training generative models to sample from unnormalized density functions is an important and challenging task in machine learning. Traditional training methods often rely on the reverse Kullback-Leibler (KL) divergence due to its…

机器学习 · 计算机科学 2025-03-05 Jiajun He , Wenlin Chen , Mingtian Zhang , David Barber , José Miguel Hernández-Lobato

In this paper we consider the basic version of Reinforcement Learning (RL) that involves computing optimal data driven (adaptive) policies for Markovian decision process with unknown transition probabilities. We provide a brief survey of…

机器学习 · 计算机科学 2019-09-16 Wesley Cowan , Michael N. Katehakis , Daniel Pirutinsky

Restricted Boltzmann machines are undirected neural networks which have been shown to be effective in many applications, including serving as initializations for training deep multi-layer neural networks. One of the main reasons for their…

无序系统与神经网络 · 物理学 2016-02-11 Marylou Gabrié , Eric W. Tramel , Florent Krzakala

Restricted Boltzmann Machines (RBMs) are a common family of undirected graphical models with latent variables. An RBM is described by a bipartite graph, with all observed variables in one layer and all latent variables in the other. We…

机器学习 · 计算机科学 2020-10-20 Guy Bresler , Rares-Darius Buhai

We present transductive Boltzmann machines (TBMs), which firstly achieve transductive learning of the Gibbs distribution. While exact learning of the Gibbs distribution is impossible by the family of existing Boltzmann machines due to…

机器学习 · 统计学 2018-05-22 Mahito Sugiyama , Koji Tsuda , Hiroyuki Nakahara

A Restricted Boltzmann Machine (RBM) is an unsupervised machine-learning bipartite graphical model that jointly learns a probability distribution over data and extracts their relevant statistical features. As such, RBM were recently…

机器学习 · 计算机科学 2019-02-19 Jérôme Tubiana , Simona Cocco , Rémi Monasson

Coarse-graining (CG) enables molecular dynamics (MD) simulations of larger systems and longer timescales that are otherwise infeasible with atomistic models. Machine learning potentials (MLPs), with their capacity to capture many-body…

化学物理 · 物理学 2025-12-01 Weilong Chen , Franz Görlich , Paul Fuchs , Julija Zavadlav

We present Generalized Contrastive Divergence (GCD), a novel objective function for training an energy-based model (EBM) and a sampler simultaneously. GCD generalizes Contrastive Divergence (Hinton, 2002), a celebrated algorithm for…

机器学习 · 计算机科学 2023-12-07 Sangwoong Yoon , Dohyun Kwon , Himchan Hwang , Yung-Kyun Noh , Frank C. Park

This letter presents a novel approach for identifying uncorrelated atomic configurations from extensive data sets with a non-standard neural network workflow known as random network distillation (RND) for training machine-learned…

计算物理 · 物理学 2023-09-08 Jan Finkbeiner , Samuel Tovey , Christian Holm

Deep Boltzmann machines (DBMs), one of the first ``deep'' learning methods ever studied, are multi-layered probabilistic models governed by a pairwise energy function that describes the likelihood of all variables/nodes in the network. In…

机器学习 · 计算机科学 2023-07-12 Zhili Feng , Ezra Winston , J. Zico Kolter