English
Related papers

Related papers: Learning Energy-Based Models by Cooperative Diffus…

200 papers

Energy based models (EBMs) are appealing due to their generality and simplicity in likelihood modeling, but have been traditionally difficult to train. We present techniques to scale MCMC based EBM training on continuous neural networks,…

Machine Learning · Computer Science 2020-07-01 Yilun Du , Igor Mordatch

Green buildings (GBs) with renewable energy and building energy management systems (BEMS) enable efficient energy use and support sustainable development. Electric vehicles (EVs), as flexible storage resources, enhance system flexibility…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Chi Liu , Zhezhuang Xu , Jiawei Zhou , Yazhou Yuan , Kai Ma , Meng Yuan

Energy-Based Models (EBMs) assign unnormalized log-probability to data samples. This functionality has a variety of applications, such as sample synthesis, data denoising, sample restoration, outlier detection, Bayesian reasoning, and many…

Machine Learning · Statistics 2019-12-23 Zengyi Li , Yubei Chen , Friedrich T. Sommer

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

We tackle a common scenario in imitation learning (IL), where agents try to recover the optimal policy from expert demonstrations without further access to the expert or environment reward signals. Except the simple Behavior Cloning (BC)…

Machine Learning · Computer Science 2021-04-16 Minghuan Liu , Tairan He , Minkai Xu , Weinan Zhang

Energy-based latent variable models (EBLVMs) are more expressive than conventional energy-based models. However, its potential on visual tasks are limited by its training process based on maximum likelihood estimate that requires sampling…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ge Kan , Jinhu Lü , Tian Wang , Baochang Zhang , Aichun Zhu , Lei Huang , Guodong Guo , Hichem Snoussi

Molecules in equilibrium follow a Boltzmann distribution, making the underlying energy landscape a physically grounded modeling objective. However, such landscapes are difficult to learn from data and, once learned, hard to sample from.…

Machine Learning · Computer Science 2026-05-19 Christoph Griesbacher , Lea Bogensperger , Andreas Habring , Thomas Pock

This work studies the learning problem of the energy-based prior model and the multi-layer generator model. The multi-layer generator model, which contains multiple layers of latent variables organized in a top-down hierarchical structure,…

Machine Learning · Computer Science 2024-05-29 Jiali Cui , Tian Han

Deep metric learning has been widely applied in many computer vision tasks, and recently, it is more attractive in \emph{zero-shot image retrieval and clustering}(ZSRC) where a good embedding is requested such that the unseen classes can be…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Binghui Chen , Weihong Deng

Deep energy-based models (EBMs) are very flexible in distribution parametrization but computationally challenging because of the intractable partition function. They are typically trained via maximum likelihood, using contrastive divergence…

Machine Learning · Computer Science 2020-07-22 Lantao Yu , Yang Song , Jiaming Song , Stefano Ermon

Contrastive learning is a method of learning visual representations by training Deep Neural Networks (DNNs) to increase the similarity between representations of positive pairs (transformations of the same image) and reduce the similarity…

Machine Learning · Computer Science 2022-10-26 Beomsu Kim , Jong Chul Ye

Energy-based models (EBMs) are powerful probabilistic models, but suffer from intractable sampling and density evaluation due to the partition function. As a result, inference in EBMs relies on approximate sampling algorithms, leading to a…

Machine Learning · Computer Science 2020-01-10 Dieterich Lawson , George Tucker , Bo Dai , Rajesh Ranganath

State-of-the-art deep learning models have achieved significant performance levels on various benchmarks. However, the excellent performance comes at a cost of inefficient computational cost. Light-weight architectures, on the other hand,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Mohammad Akbari , Amin Banitalebi-Dehkordi , Yong Zhang

A crucial design decision for any robot learning pipeline is the choice of policy representation: what type of model should be used to generate the next set of robot actions? Owing to the inherent multi-modal nature of many robotic tasks,…

Robotics · Computer Science 2023-09-13 Sumeet Singh , Stephen Tu , Vikas Sindhwani

Recent work has shown that representation learning plays a critical role in sample-efficient reinforcement learning (RL) from pixels. Unfortunately, in real-world scenarios, representation learning is usually fragile to task-irrelevant…

Machine Learning · Computer Science 2023-02-27 Qiyuan Liu , Qi Zhou , Rui Yang , Jie Wang

This work presents strategies to learn an Energy-Based Model (EBM) according to the desired length of its MCMC sampling trajectories. MCMC trajectories of different lengths correspond to models with different purposes. Our experiments cover…

Machine Learning · Statistics 2022-05-25 Mitch Hill , Jonathan Mitchell , Chu Chen , Yuan Du , Mubarak Shah , Song-Chun Zhu

This paper introduces DiffCarl, a diffusion-modeled carbon- and risk-aware reinforcement learning algorithm for intelligent operation of multi-microgrid systems. With the growing integration of renewables and increasing system complexity,…

Machine Learning · Computer Science 2025-07-24 Yunyi Zhao , Wei Zhang , Cheng Xiang , Hongyang Du , Dusit Niyato , Shuhua Gao

Distribution Matching Distillation (DMD) facilitates efficient inference by distilling multi-step diffusion models into few-step variants. Concurrently, Reinforcement Learning (RL) has emerged as a vital tool for aligning generative models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Dengyang Jiang , Dongyang Liu , Zanyi Wang , Qilong Wu , Liuzhuozheng Li , Hengzhuang Li , Xin Jin , David Liu , Changsheng Lu , Zhen Li , Bo Zhang , Mengmeng Wang , Steven Hoi , Peng Gao , Harry Yang

Energy-based models (EBMs) offer a flexible framework for probabilistic modelling across various data domains. However, training EBMs on data in discrete or mixed state spaces poses significant challenges due to the lack of robust and fast…

Machine Learning · Statistics 2024-12-03 Tobias Schröder , Zijing Ou , Yingzhen Li , Andrew B. Duncan

By planning through a learned dynamics model, model-based reinforcement learning (MBRL) offers the prospect of good performance with little environment interaction. However, it is common in practice for the learned model to be inaccurate,…

Machine Learning · Computer Science 2021-03-31 Behzad Haghgoo , Allan Zhou , Archit Sharma , Chelsea Finn