English
Related papers

Related papers: Evaluating GFlowNet from partial episodes for stab…

200 papers

Deep learning is emerging as an effective tool in drug discovery, with potential applications in both predictive and generative models. Generative Flow Networks (GFlowNets/GFNs) are a recently introduced method recognized for the ability to…

Machine Learning · Computer Science 2023-11-08 Elaine Lau , Nikhil Vemgal , Doina Precup , Emmanuel Bengio

Flow-based policies have recently emerged as a powerful tool in offline and offline-to-online reinforcement learning, capable of modeling the complex, multimodal behaviors found in pre-collected datasets. However, the full potential of…

Machine Learning · Computer Science 2025-09-30 Deshu Chen , Yuchen Liu , Zhijian Zhou , Chao Qu , Yuan Qi

Generative Flow Networks (GFlowNets) are recently proposed models for learning stochastic policies that generate compositional objects by sequences of actions with the probability proportional to a given reward function. The central problem…

Machine Learning · Computer Science 2022-10-03 Anh Do , Duy Dinh , Tan Nguyen , Khuong Nguyen , Stanley Osher , Nhat Ho

Unitary Synthesis, the decomposition of a unitary matrix into a sequence of quantum gates, is a fundamental challenge in quantum compilation. Prevailing reinforcement learning (RL) approaches are often hampered by sparse reward signals,…

Quantum Physics · Physics 2026-03-05 Inhoe Koo , Hyunho Cha , Jungwoo Lee

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

Machine Learning · Computer Science 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang

Multimedia systems underpin modern digital interactions, facilitating seamless integration and optimization of resources across diverse multimedia applications. To meet growing personalization demands, multimedia systems must efficiently…

Multimedia · Computer Science 2025-08-26 Yili Jin , Ling Pan , Rui-Xiao Zhang , Jiangchuan Liu , Xue Liu

Diffusion and flow matching policies offer expressive, multimodal action modeling, yet they are frequently unstable in online reinforcement learning (RL) due to intractable likelihoods and gradients propagating through long sampling chains.…

Machine Learning · Computer Science 2026-03-10 Chubin Zhang , Zhenglin Wan , Feng Chen , Fuchao Yang , Lang Feng , Yaxin Zhou , Xingrui Yu , Yang You , Ivor Tsang , Bo An

Robots can acquire complex manipulation skills by learning policies from expert demonstrations, which is often known as vision-based imitation learning. Generating policies based on diffusion and flow matching models has been shown to be…

Robotics · Computer Science 2024-12-17 Qinglun Zhang , Zhen Liu , Haoqiang Fan , Guanghui Liu , Bing Zeng , Shuaicheng Liu

Likelihood-based policy gradient methods are the dominant approach for training robot control policies from rewards. These methods rely on differentiable action likelihoods, which constrain policy outputs to simple distributions like…

Counterfactual explanations (CFs) provide human-interpretable insights into model's predictions by identifying minimal changes to input features that would alter the model's output. However, existing methods struggle to generate multiple…

Machine Learning · Computer Science 2026-02-20 Oleksii Furman , Patryk Marszałek , Jan Masłowski , Piotr Gaiński , Maciej Zięba , Marek Śmieja

Flow-based generative models, including diffusion models, excel at modeling continuous distributions in high-dimensional spaces. In this work, we introduce Flow Policy Optimization (FPO), a simple on-policy reinforcement learning algorithm…

Machine Learning · Computer Science 2025-08-04 David McAllister , Songwei Ge , Brent Yi , Chung Min Kim , Ethan Weber , Hongsuk Choi , Haiwen Feng , Angjoo Kanazawa

Generative policies based on diffusion models and flow matching have shown strong promise for offline reinforcement learning (RL), but their applicability remains largely confined to continuous action spaces. To address a broader range of…

Machine Learning · Computer Science 2026-05-14 Fairoz Nower Khan , Nabuat Zaman Nahim , Ruiquan Huang , Haibo Yang , Peizhong Ju

Recent advances in diffusion$/$flow-matching policies have enabled imitation learning of complex, multi-modal action trajectories. However, they are computationally expensive because they sample a trajectory of trajectories: a…

Generative Flow Networks, or GFlowNets, offer a promising framework for molecular design, but their internal decision policies remain opaque. This limits adoption in drug discovery, where chemists require clear and interpretable rationales…

Machine Learning · Computer Science 2025-11-25 Amirtha Varshini A S , Duminda S. Ranasinghe , Hok Hei Tam

Generative Flow Networks (GFlowNets) have demonstrated significant performance improvements for generating diverse discrete objects $x$ given a reward function $R(x)$, indicating the utility of the object and trained independently from the…

Machine Learning · Computer Science 2022-11-03 Chanakya Ekbote , Moksh Jain , Payel Das , Yoshua Bengio

Generative policies based on expressive model classes, such as diffusion and flow matching, are well-suited to complex control problems with highly multimodal action distributions. Their expressivity, however, comes at a significant…

Machine Learning · Computer Science 2026-05-13 Christos Ziakas , Alessandra Russo , Avishek Joey Bose

Generative modeling has recently shown remarkable promise for visuomotor policy learning, enabling flexible and expressive control across diverse embodied AI tasks. However, existing generative policies often struggle with data…

Robotics · Computer Science 2025-12-16 Jianlei Chang , Ruofeng Mei , Wei Ke , Xiangyu Xu

Reinforcement Learning (RL) algorithms aim to learn an optimal policy by iteratively sampling actions to learn how to maximize the total expected return, $R(x)$. GFlowNets are a special class of algorithms designed to generate diverse…

Machine Learning · Computer Science 2023-07-19 Nikhil Vemgal , Elaine Lau , Doina Precup

Training expressive flow-based policies with off-policy reinforcement learning is notoriously unstable due to gradient pathologies in the multi-step action sampling process. We trace this instability to a fundamental connection: the flow…

Robotics · Computer Science 2026-01-15 Yixian Zhang , Shu'ang Yu , Tonghe Zhang , Mo Guang , Haojia Hui , Kaiwen Long , Yu Wang , Chao Yu , Wenbo Ding

Generative Flow Networks (GFlowNets), a class of generative models have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from unnormalized reward distributions. Previous works…

Machine Learning · Computer Science 2024-09-17 Mohit Pandey , Gopeshh Subbaraj , Emmanuel Bengio