中文
相关论文

相关论文: GFlowNet Fine-tuning for Diverse Correct Solutions…

200 篇论文

The Generative Flow Network (GFlowNet) is a probabilistic framework in which an agent learns a stochastic policy and flow functions to sample objects proportionally to an unnormalized reward function. A number of recent works explored…

机器学习 · 计算机科学 2025-06-03 Haoran He , Emmanuel Bengio , Qingpeng Cai , Ling Pan

We consider the problem of sampling from a discrete and structured distribution as a sequential decision problem, where the objective is to find a stochastic policy such that objects are sampled at the end of this sequential process…

机器学习 · 计算机科学 2024-05-29 Tristan Deleu , Padideh Nouri , Nikolay Malkin , Doina Precup , Yoshua Bengio

Mathematical reasoning is a central challenge for large language models (LLMs), requiring not only correct answers but also faithful reasoning processes. Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising…

机器学习 · 计算机科学 2025-12-02 Md Tanvirul Alam , Nidhi Rastogi

This work applies Generative Flow Networks (GFlowNets) to three graph optimization problems: the Traveling Salesperson Problem, Minimum Spanning Tree, and Shortest Path. GFlowNets are generative models that learn to sample solutions…

人工智能 · 计算机科学 2025-10-28 Mark Phillip Matovic

Despite the success of Large-Vision Language Models (LVLMs), general optimization objectives (e.g., standard MLE) fail to constrain visual trajectories, leading to language bias and hallucination. To mitigate this, current methods introduce…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Yangfu Li , Yuning Gong , Hongjian Zhan , Teng Li , Yuanhuiyi Lyu , Tianyi Chen , Qi Liu , Ziyuan Huang , Zhihang Zhong , Dandan Zheng , Yue Lu

Large language models (LLMs) excel at many supervised tasks but often struggle with structured reasoning in unfamiliar settings. This discrepancy suggests that standard fine-tuning pipelines may instill narrow, domain-specific heuristics…

机器学习 · 计算机科学 2025-06-06 Zhen Hao Wong , Jingwen Deng , Runming He , Zirong Chen , Qijie You , Hejun Dong , Hao Liang , Chengyu Shen , Bin Cui , Wentao Zhang

Generative Flow Networks (GFlowNets) are a new family of probabilistic samplers where an agent learns a stochastic policy for generating complex combinatorial structure through a series of decision-making steps. Despite being inspired from…

机器学习 · 计算机科学 2024-02-20 Dinghuai Zhang , Ling Pan , Ricky T. Q. Chen , Aaron Courville , Yoshua Bengio

Understanding real-world videos with complex semantics and long temporal dependencies remains a fundamental challenge in computer vision. Recent progress in multimodal large language models (MLLMs) has demonstrated strong capabilities in…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Hongyu Li , Songhao Han , Yue Liao , Junfeng Luo , Jialin Gao , Shuicheng Yan , Si Liu

Generative Flow Networks (GFNs) have emerged as a powerful tool for sampling discrete objects from unnormalized distributions, offering a scalable alternative to Markov Chain Monte Carlo (MCMC) methods. While GFNs draw inspiration from…

机器学习 · 计算机科学 2025-02-24 Sobhan Mohammadpour , Emmanuel Bengio , Emma Frejinger , Pierre-Luc Bacon

Generative Flow Networks (GFlowNets) are amortized sampling methods that learn a distribution over discrete objects proportional to their rewards. GFlowNets exhibit a remarkable ability to generate diverse samples, yet occasionally struggle…

机器学习 · 计算机科学 2024-03-26 Minsu Kim , Taeyoung Yun , Emmanuel Bengio , Dinghuai Zhang , Yoshua Bengio , Sungsoo Ahn , Jinkyoo Park

Generative Flow Networks or GFlowNets are related to Monte-Carlo Markov chain methods (as they sample from a distribution specified by an energy function), reinforcement learning (as they learn a policy to sample composed objects through a…

机器学习 · 计算机科学 2023-06-21 Ling Pan , Nikolay Malkin , Dinghuai Zhang , Yoshua Bengio

Reinforcement learning (RL) has demonstrated strong potential in training large language models (LLMs) capable of complex reasoning for real-world problem solving. More recently, RL has been leveraged to create sophisticated LLM-based…

计算与语言 · 计算机科学 2025-05-22 Bowen Jin , Jinsung Yoon , Priyanka Kargupta , Sercan O. Arik , Jiawei Han

Reward models have been increasingly critical for improving the reasoning capability of LLMs. Existing research has shown that a well-trained reward model can substantially improve model performances at inference time via search. However,…

机器学习 · 计算机科学 2024-11-28 Jiaxuan Gao , Shusheng Xu , Wenjie Ye , Weilin Liu , Chuyi He , Wei Fu , Zhiyu Mei , Guangju Wang , Yi Wu

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over the years. Existing literature mainly focus on selecting a subgraph, through combinatorial optimization, to provide faithful…

机器学习 · 计算机科学 2023-03-07 Wenqian Li , Yinchuan Li , Zhigang Li , Jianye Hao , Yan Pang

Reinforcement learning (RL) for mathematical reasoning can suffer from reward sparsity: for challenging problems, LLM fails to sample any correct trajectories, preventing RL from receiving meaningful positive feedback. At the same time,…

机器学习 · 计算机科学 2026-03-06 Yangzhen Wu , Shanda Li , Zixin Wen , Xin Zhou , Ameet Talwalkar , Yiming Yang , Wenhao Huang , Tianle Cai

Generative Flow Networks (GFlowNets), a new family of probabilistic samplers, have demonstrated remarkable capabilities to generate diverse sets of high-reward candidates, in contrast to standard return maximization approaches (e.g.,…

机器学习 · 计算机科学 2025-02-25 Haoran He , Can Chang , Huazhe Xu , Ling Pan

While the reasoning abilities of large language models (LLMs) continue to advance, it remains unclear how such ability varies across languages in multilingual LLMs and whether different languages produce reasoning paths that complement each…

计算与语言 · 计算机科学 2025-09-22 Sara Rajaee , Rochelle Choenni , Ekaterina Shutova , Christof Monz

Generative Flow Networks (GFlowNets) are recently proposed models for learning stochastic policies that generate compositional objects by sequences of actions with the probability proportional to a given reward function. The central problem…

机器学习 · 计算机科学 2022-10-03 Anh Do , Duy Dinh , Tan Nguyen , Khuong Nguyen , Stanley Osher , Nhat Ho

Reinforcement learning (RL) has become a standard technique for post-training diffusion-based image synthesis models, as it enables learning from reward signals to explicitly improve desirable aspects such as image quality and prompt…

计算机视觉与模式识别 · 计算机科学 2026-03-16 David McAllister , Miika Aittala , Tero Karras , Janne Hellsten , Angjoo Kanazawa , Timo Aila , Samuli Laine

Flow Matching (FM) has shown remarkable ability in modeling complex distributions and achieves strong performance in offline imitation learning for cloning expert behaviors. However, despite its behavioral cloning expressiveness, FM-based…

机器学习 · 计算机科学 2025-10-14 Zhenglin Wan , Jingxuan Wu , Xingrui Yu , Chubin Zhang , Mingcong Lei , Bo An , Ivor Tsang