English
Related papers

Related papers: Energy-Weighted Flow Matching for Offline Reinforc…

200 papers

A commonly used family of RL algorithms for diffusion policies conducts softmax reweighting over samples from the behavior policy, which often induces an overgreedy policy and fails to utilize feedback from negative samples. In this work,…

Machine Learning · Computer Science 2026-05-26 Haitong Ma , Chenxiao Gao , Tianyi Chen , Na Li , Bo Dai

We propose Energy-based generator matching (EGM), a modality-agnostic approach to train generative models from energy functions in the absence of data. Extending the recently proposed generator matching, EGM enables training of arbitrary…

Machine Learning · Computer Science 2025-11-20 Dongyeop Woo , Minsu Kim , Minkyu Kim , Kiyoung Seong , Sungsoo Ahn

Implicit policies parameterized by generative models, such as Diffusion Policy, have become the standard for policy learning and Vision-Language-Action (VLA) models in robotics. However, these approaches often suffer from high computational…

Robotics · Computer Science 2025-11-03 Travis Davies , Yiqi Huang , Alexi Gladstone , Yunxin Liu , Xiang Chen , Heng Ji , Huxian Liu , Luhui Hu

This paper develops an ensemble learning-based linearization approach for power flow, which differs from the network-parameter based direct current (DC) power flow or other extended versions of linearization. As a novel data-driven…

Systems and Control · Electrical Eng. & Systems 2019-10-22 Ren Hu , QiFeng Li

Reinforcement learning (RL) is a powerful paradigm for learning to make sequences of decisions. However, RL has yet to be fully leveraged in robotics, principally due to its lack of scalability. Offline RL offers a promising avenue by…

Machine Learning · Computer Science 2025-10-10 Nicolas Espinosa-Dice , Kiante Brantley , Wen Sun

Classifier free guidance has shown strong potential in diffusion-based reinforcement learning. However, existing methods rely on joint training of the guidance module and the diffusion model, which can be suboptimal during the early stages…

Machine Learning · Computer Science 2025-06-05 Zhaoyang Chen , Cody Fleming

Energy-based models for discrete domains, such as graphs, explicitly capture relative likelihoods, naturally enabling composable probabilistic inference tasks like conditional generation or enforcing constraints at test-time. However,…

We present a maximum entropy inverse reinforcement learning (IRL) approach for improving the sample quality of diffusion generative models, especially when the number of generation time steps is small. Similar to how IRL trains a policy…

Machine Learning · Computer Science 2024-11-01 Sangwoong Yoon , Himchan Hwang , Dohyun Kwon , Yung-Kyun Noh , Frank C. Park

Energy-Based Models (EBMs) have proven to be a highly effective approach for modelling densities on finite-dimensional spaces. Their ability to incorporate domain-specific choices and constraints into the structure of the model through…

Machine Learning · Computer Science 2023-02-24 Jen Ning Lim , Sebastian Vollmer , Lorenz Wolf , Andrew Duncan

We present a diffusion-based approach to quadrupedal locomotion that simultaneously addresses the limitations of learning and interpolating between multiple skills and of (modes) offline adapting to new locomotion behaviours after training.…

Robotics · Computer Science 2025-06-04 Reece O'Mahoney , Alexander L. Mitchell , Wanming Yu , Ingmar Posner , Ioannis Havoutis

Generating physically realistic 3D molecular structures remains a core challenge in molecular generative modeling. While diffusion models equipped with equivariant neural networks have made progress in capturing molecular geometries, they…

Machine Learning · Computer Science 2025-08-25 Zhijian Zhou , Junyi An , Zongkai Liu , Yunfei Shi , Xuan Zhang , Fenglei Cao , Chao Qu , Yuan Qi

Offline reinforcement learning (RL) holds promise as a means to learn high-reward policies from a static dataset, without the need for further environment interactions. However, a key challenge in offline RL lies in effectively stitching…

Machine Learning · Computer Science 2023-09-14 Siddarth Venkatraman , Shivesh Khaitan , Ravi Tej Akella , John Dolan , Jeff Schneider , Glen Berseth

Diffusion models have recently gained prominence in offline reinforcement learning due to their ability to effectively learn high-performing, generalizable policies from static datasets. Diffusion-based planners facilitate long-horizon…

Machine Learning · Computer Science 2025-10-27 Donghyeon Ki , JunHyeok Oh , Seong-Woong Shim , Byung-Jun Lee

Motivated by the problem of pursuit-evasion, we present a motion planning framework that combines energy-based diffusion models with artificial potential fields for robust real time trajectory generation in complex environments. Our…

Robotics · Computer Science 2025-10-17 Wondmgezahu Teshome , Kian Behzad , Octavia Camps , Michael Everett , Milad Siami , Mario Sznaier

Generative models for 3D molecular conformations must respect Euclidean symmetries and concentrate probability mass on thermodynamically favorable, mechanically stable structures. However, E(3)-equivariant diffusion models often reproduce…

Machine Learning · Computer Science 2026-01-30 Yunyang Li , Lin Huang , Luojia Xia , Wenhe Zhang , Mark Gerstein

Accurate emulation of multi-scale physical systems governed by PDEs demands models that remain stable over long autoregressive rollouts while preserving fine-scale structures. Deterministic emulators produce overly-smoothed predictions,…

Offline reinforcement learning (RL) recovers the optimal policy $\pi$ given historical observations of an agent. In practice, $\pi$ is modeled as a weighted version of the agent's behavior policy $\mu$, using a weight function $w$ working…

Machine Learning · Computer Science 2025-12-24 Augusto Tagle , Javier Ruiz-del-Solar , Felipe Tobar

This paper introduces EnergyFlow, a framework that unifies generative action modeling with inverse reinforcement learning by parameterizing a scalar energy function whose gradient is the denoising field. We establish that under…

Robotics · Computer Science 2026-05-12 Yanbiao Ji , Qiuchang Li , Yuting Hu , Shaokai Wu , Wenyuan Xie , Guodong Zhang , Qicheng He , Deyi Ji , Yue Ding , Hongtao Lu

This paper proposes a data-driven approach for optimal power flow (OPF) based on the stacked extreme learning machine (SELM) framework. SELM has a fast training speed and does not require the time-consuming parameter tuning process compared…

Systems and Control · Electrical Eng. & Systems 2020-06-02 Xingyu Lei , Zhifang Yang , Juan Yu , Junbo Zhao , Qian Gao , Hongxin Yu

Reinforcement learning has been widely applied to diffusion and flow models for visual tasks such as text-to-image generation. However, these tasks remain challenging because diffusion models have intractable likelihoods, which creates a…

Machine Learning · Computer Science 2026-05-20 Jaemoo Choi , Yuchen Zhu , Wei Guo , Petr Molodyk , Bo Yuan , Jinbin Bai , Yi Xin , Molei Tao , Yongxin Chen