中文
相关论文

相关论文: Evaluating GFlowNet from partial episodes for stab…

200 篇论文

Deep learning is emerging as an effective tool in drug discovery, with potential applications in both predictive and generative models. Generative Flow Networks (GFlowNets/GFNs) are a recently introduced method recognized for the ability to…

机器学习 · 计算机科学 2023-11-08 Elaine Lau , Nikhil Vemgal , Doina Precup , Emmanuel Bengio

Flow-based policies have recently emerged as a powerful tool in offline and offline-to-online reinforcement learning, capable of modeling the complex, multimodal behaviors found in pre-collected datasets. However, the full potential of…

机器学习 · 计算机科学 2025-09-30 Deshu Chen , Yuchen Liu , Zhijian Zhou , Chao Qu , Yuan Qi

Generative Flow Networks (GFlowNets) are recently proposed models for learning stochastic policies that generate compositional objects by sequences of actions with the probability proportional to a given reward function. The central problem…

机器学习 · 计算机科学 2022-10-03 Anh Do , Duy Dinh , Tan Nguyen , Khuong Nguyen , Stanley Osher , Nhat Ho

Unitary Synthesis, the decomposition of a unitary matrix into a sequence of quantum gates, is a fundamental challenge in quantum compilation. Prevailing reinforcement learning (RL) approaches are often hampered by sparse reward signals,…

量子物理 · 物理学 2026-03-05 Inhoe Koo , Hyunho Cha , Jungwoo Lee

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

机器学习 · 计算机科学 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang

Multimedia systems underpin modern digital interactions, facilitating seamless integration and optimization of resources across diverse multimedia applications. To meet growing personalization demands, multimedia systems must efficiently…

多媒体 · 计算机科学 2025-08-26 Yili Jin , Ling Pan , Rui-Xiao Zhang , Jiangchuan Liu , Xue Liu

Diffusion and flow matching policies offer expressive, multimodal action modeling, yet they are frequently unstable in online reinforcement learning (RL) due to intractable likelihoods and gradients propagating through long sampling chains.…

机器学习 · 计算机科学 2026-03-10 Chubin Zhang , Zhenglin Wan , Feng Chen , Fuchao Yang , Lang Feng , Yaxin Zhou , Xingrui Yu , Yang You , Ivor Tsang , Bo An

Robots can acquire complex manipulation skills by learning policies from expert demonstrations, which is often known as vision-based imitation learning. Generating policies based on diffusion and flow matching models has been shown to be…

机器人学 · 计算机科学 2024-12-17 Qinglun Zhang , Zhen Liu , Haoqiang Fan , Guanghui Liu , Bing Zeng , Shuaicheng Liu

Likelihood-based policy gradient methods are the dominant approach for training robot control policies from rewards. These methods rely on differentiable action likelihoods, which constrain policy outputs to simple distributions like…

Counterfactual explanations (CFs) provide human-interpretable insights into model's predictions by identifying minimal changes to input features that would alter the model's output. However, existing methods struggle to generate multiple…

机器学习 · 计算机科学 2026-02-20 Oleksii Furman , Patryk Marszałek , Jan Masłowski , Piotr Gaiński , Maciej Zięba , Marek Śmieja

Flow-based generative models, including diffusion models, excel at modeling continuous distributions in high-dimensional spaces. In this work, we introduce Flow Policy Optimization (FPO), a simple on-policy reinforcement learning algorithm…

机器学习 · 计算机科学 2025-08-04 David McAllister , Songwei Ge , Brent Yi , Chung Min Kim , Ethan Weber , Hongsuk Choi , Haiwen Feng , Angjoo Kanazawa

Generative policies based on diffusion models and flow matching have shown strong promise for offline reinforcement learning (RL), but their applicability remains largely confined to continuous action spaces. To address a broader range of…

机器学习 · 计算机科学 2026-05-14 Fairoz Nower Khan , Nabuat Zaman Nahim , Ruiquan Huang , Haibo Yang , Peizhong Ju

Recent advances in diffusion$/$flow-matching policies have enabled imitation learning of complex, multi-modal action trajectories. However, they are computationally expensive because they sample a trajectory of trajectories: a…

Generative Flow Networks, or GFlowNets, offer a promising framework for molecular design, but their internal decision policies remain opaque. This limits adoption in drug discovery, where chemists require clear and interpretable rationales…

机器学习 · 计算机科学 2025-11-25 Amirtha Varshini A S , Duminda S. Ranasinghe , Hok Hei Tam

Generative Flow Networks (GFlowNets) have demonstrated significant performance improvements for generating diverse discrete objects $x$ given a reward function $R(x)$, indicating the utility of the object and trained independently from the…

机器学习 · 计算机科学 2022-11-03 Chanakya Ekbote , Moksh Jain , Payel Das , Yoshua Bengio

Generative policies based on expressive model classes, such as diffusion and flow matching, are well-suited to complex control problems with highly multimodal action distributions. Their expressivity, however, comes at a significant…

机器学习 · 计算机科学 2026-05-13 Christos Ziakas , Alessandra Russo , Avishek Joey Bose

Generative modeling has recently shown remarkable promise for visuomotor policy learning, enabling flexible and expressive control across diverse embodied AI tasks. However, existing generative policies often struggle with data…

机器人学 · 计算机科学 2025-12-16 Jianlei Chang , Ruofeng Mei , Wei Ke , Xiangyu Xu

Reinforcement Learning (RL) algorithms aim to learn an optimal policy by iteratively sampling actions to learn how to maximize the total expected return, $R(x)$. GFlowNets are a special class of algorithms designed to generate diverse…

机器学习 · 计算机科学 2023-07-19 Nikhil Vemgal , Elaine Lau , Doina Precup

Training expressive flow-based policies with off-policy reinforcement learning is notoriously unstable due to gradient pathologies in the multi-step action sampling process. We trace this instability to a fundamental connection: the flow…

机器人学 · 计算机科学 2026-01-15 Yixian Zhang , Shu'ang Yu , Tonghe Zhang , Mo Guang , Haojia Hui , Kaiwen Long , Yu Wang , Chao Yu , Wenbo Ding

Generative Flow Networks (GFlowNets), a class of generative models have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from unnormalized reward distributions. Previous works…

机器学习 · 计算机科学 2024-09-17 Mohit Pandey , Gopeshh Subbaraj , Emmanuel Bengio