中文
相关论文

相关论文: Generating Physically Consistent Molecules with En…

200 篇论文

Energy-based models (EBMs) are generative models inspired by statistical physics with a wide range of applications in unsupervised learning. Their performance is best measured by the cross-entropy (CE) of the model distribution relative to…

机器学习 · 计算机科学 2023-12-14 Davide Carbone , Mengjian Hua , Simon Coste , Eric Vanden-Eijnden

Energy-based models (EBMs) are a powerful class of probabilistic generative models due to their flexibility and interpretability. However, relationships between potential flows and explicit EBMs remain underexplored, while contrastive…

This work studies the learning problem of the energy-based prior model and the multi-layer generator model. The multi-layer generator model, which contains multiple layers of latent variables organized in a top-down hierarchical structure,…

机器学习 · 计算机科学 2024-05-29 Jiali Cui , Tian Han

Energy-based models (EBMs) are flexible generative architectures inspired by statistical physics, but their learning and generative properties remain poorly understood. Here, we analyze a solvable EBM in the high-dimensional limit: the…

机器学习 · 计算机科学 2026-05-12 Thomas Tulinski , Simona Cocco , Rémi Monasson , Jorge Fernandez-De-Cossio-Diaz

Energy-based modeling is a promising approach to unsupervised learning, which yields many downstream applications from a single model. The main difficulty in learning energy-based models with the "contrastive approaches" is the generation…

机器学习 · 计算机科学 2021-11-30 Kirill Neklyudov , Priyank Jaini , Max Welling

Learning energy-based model (EBM) requires MCMC sampling of the learned model as an inner loop of the learning algorithm. However, MCMC sampling of EBMs in high-dimensional data space is generally not mixing, because the energy function,…

机器学习 · 统计学 2022-03-17 Erik Nijkamp , Ruiqi Gao , Pavel Sountsov , Srinivas Vasudevan , Bo Pang , Song-Chun Zhu , Ying Nian Wu

While energy-based models (EBMs) exhibit a number of desirable properties, training and sampling on high-dimensional datasets remains challenging. Inspired by recent progress on diffusion probabilistic models, we present a diffusion…

机器学习 · 计算机科学 2021-03-30 Ruiqi Gao , Yang Song , Ben Poole , Ying Nian Wu , Diederik P. Kingma

Deep Generative Models (DGMs), including Energy-Based Models (EBMs) and Score-based Generative Models (SGMs), have advanced high-fidelity data generation and complex continuous distribution approximation. However, their application in…

机器学习 · 计算机科学 2024-10-03 Yangming Li , Chieh-Hsin Lai , Carola-Bibiane Schönlieb , Yuki Mitsufuji , Stefano Ermon

We propose Energy-based generator matching (EGM), a modality-agnostic approach to train generative models from energy functions in the absence of data. Extending the recently proposed generator matching, EGM enables training of arbitrary…

机器学习 · 计算机科学 2025-11-20 Dongyeop Woo , Minsu Kim , Minkyu Kim , Kiyoung Seong , Sungsoo Ahn

Machine learning has recently emerged as a powerful tool for generating new molecular and material structures. The success of state-of-the-art models stems from their ability to incorporate physical symmetries, such as translation,…

机器学习 · 计算机科学 2024-05-16 Bingqing Cheng

Energy-based models (EBMs) offer a flexible framework for probabilistic modelling across various data domains. However, training EBMs on data in discrete or mixed state spaces poses significant challenges due to the lack of robust and fast…

机器学习 · 统计学 2024-12-03 Tobias Schröder , Zijing Ou , Yingzhen Li , Andrew B. Duncan

Energy-Based Models (EBMs) assign unnormalized log-probability to data samples. This functionality has a variety of applications, such as sample synthesis, data denoising, sample restoration, outlier detection, Bayesian reasoning, and many…

机器学习 · 统计学 2019-12-23 Zengyi Li , Yubei Chen , Friedrich T. Sommer

Energy-based models (EBMs) are a flexible class of deep generative models and are well-suited to capture complex dependencies in multimodal data. However, learning multimodal EBM by maximum likelihood requires Markov Chain Monte Carlo…

机器学习 · 计算机科学 2026-05-04 Jiali Cui , Zhiqiang Lao , Heather Yu

The ensemble average of physical properties of molecules is closely related to the distribution of molecular conformations, and sampling such distributions is a fundamental challenge in physics and chemistry. Traditional methods like…

机器学习 · 计算机科学 2025-08-06 Liya Guo , Zun Wang , Chang Liu , Junzhe Li , Pipi Hu , Yi Zhu

Molecule synthesis through machine learning is one of the fundamental problems in drug discovery. Current data-driven strategies employ one-step retrosynthesis models and search algorithms to predict synthetic routes in a top-bottom manner.…

机器学习 · 计算机科学 2024-06-05 Songtao Liu , Hanjun Dai , Yue Zhao , Peng Liu

Energy-Based Models (EBMs) provide a flexible framework for generative modeling, but their training remains theoretically challenging due to the need to approximate normalization constants and efficiently sample from complex, multi-modal…

机器学习 · 计算机科学 2025-06-10 Davide Carbone

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

机器学习 · 计算机科学 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

We propose to learn energy-based model (EBM) in the latent space of a generator model, so that the EBM serves as a prior model that stands on the top-down network of the generator model. Both the latent space EBM and the top-down network…

机器学习 · 统计学 2020-10-30 Bo Pang , Tian Han , Erik Nijkamp , Song-Chun Zhu , Ying Nian Wu

Deep energy-based models (EBMs) are very flexible in distribution parametrization but computationally challenging because of the intractable partition function. They are typically trained via maximum likelihood, using contrastive divergence…

机器学习 · 计算机科学 2020-07-22 Lantao Yu , Yang Song , Jiaming Song , Stefano Ermon

Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in the field of generative modeling due to its flexibility in the formulation and strong modeling power of the latent space. However,…

机器学习 · 计算机科学 2023-10-06 Peiyu Yu , Yaxuan Zhu , Sirui Xie , Xiaojian Ma , Ruiqi Gao , Song-Chun Zhu , Ying Nian Wu