English
Related papers

Related papers: Learning Latent Space Energy-Based Prior Model

200 papers

In this paper, we focus on the problem of integrating Energy-based Models (EBM) as guiding priors for motion optimization. EBMs are a set of neural networks that can represent expressive probability density distributions in terms of a Gibbs…

Robotics · Computer Science 2023-01-13 Julen Urain , An T. Le , Alexander Lambert , Georgia Chalvatzaki , Byron Boots , Jan Peters

Maximum likelihood estimation is widely used in training Energy-based models (EBMs). Training requires samples from an unnormalized distribution, which is usually intractable, and in practice, these are obtained by MCMC algorithms such as…

Machine Learning · Computer Science 2021-04-23 Zhisheng Xiao , Qing Yan , Yali Amit

Energy-based models (EBMs) have become increasingly popular within computer vision in recent years. While they are commonly employed for generative image modeling, recent work has applied EBMs also for regression tasks, achieving…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Fredrik K. Gustafsson , Martin Danelljan , Radu Timofte , Thomas B. Schön

Energy-based models (EBMs) exhibit a variety of desirable properties in predictive tasks, such as generality, simplicity and compositionality. However, training EBMs on high-dimensional datasets remains unstable and expensive. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Xiulong Yang , Shihao Ji

Energy-based language models (ELMs) parameterize an unnormalized distribution for natural sentences and are radically different from popular autoregressive language models (ALMs). As an important application, ELMs have been successfully…

Computation and Language · Computer Science 2023-05-30 Hong Liu , Zhaobiao Lv , Zhijian Ou , Wenbo Zhao , Qing Xiao

Energy-based models (EBMs) are a powerful class of probabilistic generative models due to their flexibility and interpretability. However, relationships between potential flows and explicit EBMs remain underexplored, while contrastive…

In this paper, we show that the performance of a learnt generative model is closely related to the model's ability to accurately represent the inferred \textbf{latent data distribution}, i.e. its topology and structural properties. We…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Shuyu Lin , Ronald Clark

This work presents strategies to learn an Energy-Based Model (EBM) according to the desired length of its MCMC sampling trajectories. MCMC trajectories of different lengths correspond to models with different purposes. Our experiments cover…

Machine Learning · Statistics 2022-05-25 Mitch Hill , Jonathan Mitchell , Chu Chen , Yuan Du , Mubarak Shah , Song-Chun Zhu

This paper proposes StrEBM, a structured latent energy-based model for source-wise structured representation learning. The framework is motivated by a broader goal of promoting identifiable and decoupled latent organization by assigning…

Machine Learning · Statistics 2026-04-21 Yuan-Hao Wei

Generative models have shown strong generation ability while efficient likelihood estimation is less explored. Energy-based models~(EBMs) define a flexible energy function to parameterize unnormalized densities efficiently but are notorious…

Machine Learning · Computer Science 2024-06-11 Cong Geng , Tian Han , Peng-Tao Jiang , Hao Zhang , Jinwei Chen , Søren Hauberg , Bo Li

Energy-based latent variable models (EBLVMs) are more expressive than conventional energy-based models. However, its potential on visual tasks are limited by its training process based on maximum likelihood estimate that requires sampling…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ge Kan , Jinhu Lü , Tian Wang , Baochang Zhang , Aichun Zhu , Lei Huang , Guodong Guo , Hichem Snoussi

Energy-based modeling is a promising approach to unsupervised learning, which yields many downstream applications from a single model. The main difficulty in learning energy-based models with the "contrastive approaches" is the generation…

Machine Learning · Computer Science 2021-11-30 Kirill Neklyudov , Priyank Jaini , Max Welling

Planning is a powerful approach to reinforcement learning with several desirable properties. However, it requires a model of the world, which is not readily available in many real-life problems. In this paper, we propose to learn a world…

Machine Learning · Computer Science 2020-11-24 Thor V. A. N. Olesen , Dennis T. T. Nguyen , Rasmus Berg Palm , Sebastian Risi

Model-based offline reinforcement learning is brittle under distribution shift: policy improvement drives rollouts into state--action regions weakly supported by the dataset, where compounding model error yields severe value overestimation.…

Machine Learning · Computer Science 2026-02-04 Zeyu Fang , Zuyuan Zhang , Mahdi Imani , Tian Lan

The ability to accurately model random fields plays a critical role in science and engineering for problems involving uncertain, spatially-varying quantities such as heterogeneous material properties and turbulent flows. Deep generative…

This work proposes a learning method to accelerate robotic pick-and-place planning by predicting shared grasps. Shared grasps are defined as grasp poses feasible to both the initial and goal object configurations in a pick-and-place task.…

Robotics · Computer Science 2025-06-23 Liang Qin , Weiwei Wan , Jun Takahashi , Ryo Negishi , Masaki Matsushita , Kensuke Harada

Autoregressive models (ARMs) currently constitute the dominant paradigm for large language models (LLMs). Energy-based models (EBMs) represent another class of models, which have historically been less prevalent in LLM development, yet…

Machine Learning · Computer Science 2026-05-26 Mathieu Blondel , Michael E. Sander , Germain Vivier-Ardisson , Tianlin Liu , Vincent Roulet

Energy-based models (EBMs) are generative models that are usually trained via maximum likelihood estimation. This approach becomes challenging in generic situations where the trained energy is non-convex, due to the need to sample the Gibbs…

Machine Learning · Computer Science 2022-02-16 Carles Domingo-Enrich , Alberto Bietti , Marylou Gabrié , Joan Bruna , Eric Vanden-Eijnden

Latent-variable energy-based models (LVEBMs) assign a single normalized energy to joint pairs of observed data and latent variables, offering expressive generative modeling while capturing hidden structure. We recast maximum-likelihood…

Machine Learning · Computer Science 2025-10-20 Shiqin Tang , Shuxin Zhuang , Rong Feng , Runsheng Yu , Hongzong Li , Youzhi Zhang

Modeling the time-dependent evolution of electron density is essential for understanding quantum mechanical behaviors of condensed matter and enabling predictive simulations in spectroscopy, photochemistry, and ultrafast science. Yet, while…

Computational Physics · Physics 2025-09-03 Yuan Chiang , Youngsoo Choi , Daniel Osei-Kuffuor