中文
相关论文

相关论文: Generative Flow Networks as Entropy-Regularized RL

200 篇论文

Multi-task reinforcement learning and meta-reinforcement learning have been developed to quickly adapt to new tasks, but they tend to focus on tasks with higher rewards and more frequent occurrences, leading to poor performance on tasks…

机器学习 · 计算机科学 2023-06-19 Xinyuan Ji , Xu Zhang , Wei Xi , Haozhi Wang , Olga Gadyatskaya , Yinchuan Li

This paper studies Generative Flow Networks (GFlowNets), which learn to sample objects proportionally to a given reward function through the trajectory of state transitions. In this work, we observe that GFlowNets tend to under-exploit the…

机器学习 · 计算机科学 2024-10-30 Hyosoon Jang , Yunhui Jang , Minsu Kim , Jinkyoo Park , Sungsoo Ahn

Multimedia systems underpin modern digital interactions, facilitating seamless integration and optimization of resources across diverse multimedia applications. To meet growing personalization demands, multimedia systems must efficiently…

多媒体 · 计算机科学 2025-08-26 Yili Jin , Ling Pan , Rui-Xiao Zhang , Jiangchuan Liu , Xue Liu

Generative Flow Networks (GFlowNets) treat sampling from distributions over compositional discrete spaces as a sequential decision-making problem, training a stochastic policy to construct objects step by step. Recent studies have revealed…

机器学习 · 计算机科学 2024-06-21 Nikita Morozov , Daniil Tiapkin , Sergey Samsonov , Alexey Naumov , Dmitry Vetrov

Deep learning is emerging as an effective tool in drug discovery, with potential applications in both predictive and generative models. Generative Flow Networks (GFlowNets/GFNs) are a recently introduced method recognized for the ability to…

机器学习 · 计算机科学 2023-11-08 Elaine Lau , Nikhil Vemgal , Doina Precup , Emmanuel Bengio

We present GFlowState, a visual analytics system designed to illuminate the training process of Generative Flow Networks (GFlowNets or GFNs). GFlowNets are a probabilistic framework for generating samples proportionally to a reward…

机器学习 · 计算机科学 2026-04-24 Florian Holeczek , Andreas Hinterreiter , Alex Hernandez-Garcia , Marc Streit , Christina Humer

We present energy-based generative flow networks (EB-GFN), a novel probabilistic modeling algorithm for high-dimensional discrete data. Building upon the theory of generative flow networks (GFlowNets), we model the generation process by a…

机器学习 · 计算机科学 2022-06-10 Dinghuai Zhang , Nikolay Malkin , Zhen Liu , Alexandra Volokhova , Aaron Courville , Yoshua Bengio

Generative Flow Networks (GFlowNets) offer a powerful framework for sampling graphs in proportion to their rewards. However, existing approaches suffer from systematic biases due to inaccuracies in state transition probability computations.…

机器学习 · 统计学 2025-10-17 Hohyun Kim , Seunggeun Lee , Min-hwan Oh

Traditional reinforcement learning often struggles to generate diverse, high-reward solutions, especially in domains like drug design and black-box function optimization. Markov Chain Monte Carlo (MCMC) methods provide an alternative method…

机器学习 · 计算机科学 2024-10-02 Siyi He

Generative Flow Networks (GFlowNets), a new family of probabilistic samplers, have recently emerged as a promising framework for learning stochastic policies that generate high-quality and diverse objects proportionally to their rewards.…

机器学习 · 计算机科学 2024-06-05 Chunhui Li , Cheng-Hao Liu , Dianbo Liu , Qingpeng Cai , Ling Pan

Graph generation is a fundamental task with broad applications, such as drug discovery. Recently, discrete flow matching-based graph generation, \aka, graph flow model (GFM), has emerged due to its superior performance and flexible…

机器学习 · 计算机科学 2026-03-12 Baoheng Zhu , Deyu Bo , Delvin Ce Zhang , Xiao Wang

Generative Flow Networks (GFlowNets) are a class of generative models that sample objects in proportion to a specified reward function through a learned policy. They can be trained either on-policy or off-policy, needing a balance between…

机器学习 · 计算机科学 2025-03-04 Dominic Phillips , Flaviu Cipcigan

Unitary Synthesis, the decomposition of a unitary matrix into a sequence of quantum gates, is a fundamental challenge in quantum compilation. Prevailing reinforcement learning (RL) approaches are often hampered by sparse reward signals,…

量子物理 · 物理学 2026-03-05 Inhoe Koo , Hyunho Cha , Jungwoo Lee

Generative Flow Networks (GFlowNets), a class of generative models have recently emerged as a suitable framework for generating diverse and high-quality molecular structures by learning from unnormalized reward distributions. Previous works…

机器学习 · 计算机科学 2024-09-17 Mohit Pandey , Gopeshh Subbaraj , Emmanuel Bengio

Modern reinforcement learning (RL) algorithms have found success by using powerful probabilistic models, such as transformers, energy-based models, and diffusion/flow-based models. To this end, RL researchers often choose to pay the price…

机器学习 · 计算机科学 2025-06-05 Raj Ghugare , Benjamin Eysenbach

Generative Flow Networks (GFlowNets or GFNs) are probabilistic models predicated on Markov flows, and they employ specific amortization algorithms to learn stochastic policies that generate compositional substances including biomolecules,…

机器学习 · 计算机科学 2025-03-21 Shuai Guo , Jielei Chu , Lin Ma , Zhaoyu Li , Tianrui Li

Reasoning is a fundamental substrate for solving novel and complex problems. Deliberate efforts in learning and developing frameworks around System 2 reasoning have made great strides, yet problems of sufficient complexity remain largely…

计算与语言 · 计算机科学 2024-10-18 Matthew Ho , Vincent Zhu , Xiaoyin Chen , Moksh Jain , Nikolay Malkin , Edwin Zhang

Generative Flow Networks (GFNs) were initially introduced on directed acyclic graphs to sample from an unnormalized distribution density. Recent works have extended the theoretical framework for generative methods allowing more flexibility…

机器学习 · 计算机科学 2025-05-07 Leo Maxime Brunswic , Mateo Clemente , Rui Heng Yang , Adam Sigal , Amir Rasouli , Yinchuan Li

Achieving both accuracy and diverse reasoning remains challenging for Large Language Models (LLMs) in complex domains like mathematics. A key bottleneck is evaluating intermediate reasoning steps to guide generation without costly human…

机器学习 · 计算机科学 2025-10-14 Adam Younsi , Ahmed Attia , Abdalgader Abubaker , Mohamed El Amine Seddik , Hakim Hacid , Salem Lahlou

Generative speech enhancement offers a promising alternative to traditional discriminative methods by modeling the distribution of clean speech conditioned on noisy inputs. Post-training alignment via reinforcement learning (RL) effectively…

音频与语音处理 · 电气工程与系统科学 2026-01-26 Haoxu Wang , Biao Tian , Yiheng Jiang , Zexu Pan , Shengkui Zhao , Bin Ma , Daren Chen , Xiangang Li