中文
相关论文

相关论文: Learning Multimodal Energy-Based Model with Multim…

200 篇论文

This paper studies the fundamental learning problem of the energy-based model (EBM). Learning the EBM can be achieved using the maximum likelihood estimation (MLE), which typically involves the Markov Chain Monte Carlo (MCMC) sampling, such…

机器学习 · 计算机科学 2023-12-06 Jiali Cui , Tian Han

This paper studies the fundamental problem of learning multi-layer generator models. The multi-layer generator model builds multiple layers of latent variables as a prior model on top of the generator, which benefits learning complex data…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Jiali Cui , Ying Nian Wu , Tian Han

Multimodal generative models are crucial for various applications. We propose an approach that combines an expressive energy-based model (EBM) prior with Markov Chain Monte Carlo (MCMC) inference in the latent space for multimodal…

机器学习 · 计算机科学 2024-08-21 Shiyu Yuan , Carlo Lipizzi , Tian Han

Multimodal generative models have recently gained significant attention for their ability to learn representations across various modalities, enhancing joint and cross-generation coherence. However, most existing works use standard Gaussian…

机器学习 · 计算机科学 2024-10-01 Shiyu Yuan , Jiali Cui , Hanao Li , Tian Han

Learning energy-based model (EBM) requires MCMC sampling of the learned model as an inner loop of the learning algorithm. However, MCMC sampling of EBMs in high-dimensional data space is generally not mixing, because the energy function,…

机器学习 · 统计学 2022-03-17 Erik Nijkamp , Ruiqi Gao , Pavel Sountsov , Srinivas Vasudevan , Bo Pang , Song-Chun Zhu , Ying Nian Wu

Due to the intractable partition function, training energy-based models (EBMs) by maximum likelihood requires Markov chain Monte Carlo (MCMC) sampling to approximate the gradient of the Kullback-Leibler divergence between data and model…

机器学习 · 统计学 2021-12-28 Jianwen Xie , Zilong Zheng , Ping Li

We propose to learn energy-based model (EBM) in the latent space of a generator model, so that the EBM serves as a prior model that stands on the top-down network of the generator model. Both the latent space EBM and the top-down network…

机器学习 · 统计学 2020-10-30 Bo Pang , Tian Han , Erik Nijkamp , Song-Chun Zhu , Ying Nian Wu

This paper proposes a joint training method to learn both the variational auto-encoder (VAE) and the latent energy-based model (EBM). The joint training of VAE and latent EBM are based on an objective function that consists of three…

计算机视觉与模式识别 · 计算机科学 2020-06-12 Tian Han , Erik Nijkamp , Linqi Zhou , Bo Pang , Song-Chun Zhu , Ying Nian Wu

This paper studies the fundamental problem of multi-layer generator models in learning hierarchical representations. The multi-layer generator model that consists of multiple layers of latent variables organized in a top-down architecture…

机器学习 · 计算机科学 2023-10-17 Jiali Cui , Ying Nian Wu , Tian Han

This work studies the learning problem of the energy-based prior model and the multi-layer generator model. The multi-layer generator model, which contains multiple layers of latent variables organized in a top-down hierarchical structure,…

机器学习 · 计算机科学 2024-05-29 Jiali Cui , Tian Han

Energy-based models (EBMs) offer a flexible framework for parameterizing probability distributions using neural networks. However, learning EBMs by exact maximum likelihood estimation (MLE) is generally intractable, due to the need to…

机器学习 · 计算机科学 2025-08-20 Michael E. Sander , Vincent Roulet , Tianlin Liu , Mathieu Blondel

Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in generative modeling. Fueled by its flexibility in the formulation and strong modeling power of the latent space, recent works built…

机器学习 · 计算机科学 2023-10-06 Peiyu Yu , Sirui Xie , Xiaojian Ma , Baoxiong Jia , Bo Pang , Ruiqi Gao , Yixin Zhu , Song-Chun Zhu , Ying Nian Wu

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

机器学习 · 计算机科学 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

We introduce the Generalized Energy Based Model (GEBM) for generative modelling. These models combine two trained components: a base distribution (generally an implicit model), which can learn the support of data with low intrinsic…

机器学习 · 统计学 2021-12-22 Michael Arbel , Liang Zhou , Arthur Gretton

Energy based models (EBMs) are appealing due to their generality and simplicity in likelihood modeling, but have been traditionally difficult to train. We present techniques to scale MCMC based EBM training on continuous neural networks,…

机器学习 · 计算机科学 2020-07-01 Yilun Du , Igor Mordatch

Maximum likelihood (ML) learning for energy-based models (EBMs) is challenging, partly due to non-convergence of Markov chain Monte Carlo.Several variations of ML learning have been proposed, but existing methods all fail to achieve both…

机器学习 · 统计学 2023-04-24 Xinwei Zhang , Zhiqiang Tan , Zhijian Ou

An energy-based model (EBM) is a popular generative framework that offers both explicit density and architectural flexibility, but training them is difficult since it is often unstable and time-consuming. In recent years, various training…

机器学习 · 计算机科学 2023-03-07 Hankook Lee , Jongheon Jeong , Sejun Park , Jinwoo Shin

This paper studies the fundamental problem of learning energy-based model (EBM) in the latent space of the generator model. Learning such prior model typically requires running costly Markov Chain Monte Carlo (MCMC). Instead, we propose to…

机器学习 · 计算机科学 2022-09-20 Zhisheng Xiao , Tian Han

Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in the field of generative modeling due to its flexibility in the formulation and strong modeling power of the latent space. However,…

机器学习 · 计算机科学 2023-10-06 Peiyu Yu , Yaxuan Zhu , Sirui Xie , Xiaojian Ma , Ruiqi Gao , Song-Chun Zhu , Ying Nian Wu

This work proposes a method for using any generator network as the foundation of an Energy-Based Model (EBM). Our formulation posits that observed images are the sum of unobserved latent variables passed through the generator network and a…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Mitch Hill , Erik Nijkamp , Jonathan Mitchell , Bo Pang , Song-Chun Zhu
‹ 上一页 1 2 3 10 下一页 ›