English
Related papers

Related papers: Planning-Augmented Sampling with Early Guidance fo…

200 papers

Adaptive sampling and planning in robotic environmental monitoring are challenging when the target environmental process varies over space and time. The underlying environmental dynamics require the planning module to integrate future…

Robotics · Computer Science 2023-06-19 Weizhe Chen , Lantao Liu

Generative Flow Networks or GFlowNets are related to Monte-Carlo Markov chain methods (as they sample from a distribution specified by an energy function), reinforcement learning (as they learn a policy to sample composed objects through a…

Machine Learning · Computer Science 2023-06-21 Ling Pan , Nikolay Malkin , Dinghuai Zhang , Yoshua Bengio

Generative Flow Networks (GFlowNets) aim to generate diverse trajectories from a distribution in which the final states of the trajectories are proportional to the reward, serving as a powerful alternative to reinforcement learning for…

Artificial Intelligence · Computer Science 2024-08-14 Shuang Luo , Yinchuan Li , Shunyu Liu , Xu Zhang , Yunfeng Shao , Chao Wu

Generative Flow Networks (GFlowNets), a new family of probabilistic samplers, have recently emerged as a promising framework for learning stochastic policies that generate high-quality and diverse objects proportionally to their rewards.…

Machine Learning · Computer Science 2024-06-05 Chunhui Li , Cheng-Hao Liu , Dianbo Liu , Qingpeng Cai , Ling Pan

Design of de novo biological sequences with desired properties, like protein and DNA sequences, often involves an active loop with several rounds of molecule ideation and expensive wet-lab evaluations. These experiments can consist of…

Generative flow networks (GFlowNets) are a family of algorithms for training a sequential sampler of discrete objects under an unnormalized target density and have been successfully used for various probabilistic modeling tasks. Existing…

In the last decades, the capacity to generate large amounts of data in science and engineering applications has been growing steadily. Meanwhile, machine learning has progressed to become a suitable tool to process and utilise the available…

Machine Learning · Computer Science 2024-09-04 Alex Hernandez-Garcia , Nikita Saxena , Moksh Jain , Cheng-Hao Liu , Yoshua Bengio

Unitary Synthesis, the decomposition of a unitary matrix into a sequence of quantum gates, is a fundamental challenge in quantum compilation. Prevailing reinforcement learning (RL) approaches are often hampered by sparse reward signals,…

Quantum Physics · Physics 2026-03-05 Inhoe Koo , Hyunho Cha , Jungwoo Lee

Diffusion models have recently gained prominence in offline reinforcement learning due to their ability to effectively learn high-performing, generalizable policies from static datasets. Diffusion-based planners facilitate long-horizon…

Machine Learning · Computer Science 2025-10-27 Donghyeon Ki , JunHyeok Oh , Seong-Woong Shim , Byung-Jun Lee

Generative Flow Networks (GFlowNets) were developed to learn policies for efficiently sampling combinatorial candidates by interpreting their generative processes as trajectories in directed acyclic graphs. In the value-based training…

Machine Learning · Computer Science 2026-03-03 Puhua Niu , Shili Wu , Xiaoning Qian

The autonomous exploration of environments by multi-robot systems is a critical task with broad applications in rescue missions, exploration endeavors, and beyond. Current approaches often rely on either greedy frontier selection or…

Robotics · Computer Science 2024-10-28 Gengyuan Cai , Luosong Guo , Xiangmao Chang

Retrieval-Augmented Generation (RAG) based on knowledge graphs (KGs) enhances large language models (LLMs) by providing structured and interpretable external knowledge. However, existing KG-based RAG methods struggle to retrieve accurate…

Artificial Intelligence · Computer Science 2025-10-21 Junchi Yu , Yujie Liu , Jindong Gu , Philip Torr , Dongzhan Zhou

Monte Carlo Tree Search is a popular method for solving decision making problems. Faster implementations allow for more simulations within the same wall clock time, directly improving search performance. To this end, we present an…

Artificial Intelligence · Computer Science 2025-08-29 James Ragan , Fred Y. Hadaegh , Soon-Jo Chung

Generative flow networks utilize a flow-matching loss to learn a stochastic policy for generating objects from a sequence of actions, such that the probability of generating a pattern can be proportional to the corresponding given reward.…

Machine Learning · Computer Science 2025-09-26 Leo Maxime Brunswic , Haozhi Wang , Shuang Luo , Jianye Hao , Amir Rasouli , Yinchuan Li

While large language models (LLMs) are increasingly adapted for recommendation systems via supervised fine-tuning (SFT), this approach amplifies popularity bias due to its likelihood maximization objective, compromising recommendation…

Information Retrieval · Computer Science 2025-05-13 Chongming Gao , Mengyao Gao , Chenxiao Fan , Shuai Yuan , Wentao Shi , Xiangnan He

We present GFlowState, a visual analytics system designed to illuminate the training process of Generative Flow Networks (GFlowNets or GFNs). GFlowNets are a probabilistic framework for generating samples proportionally to a reward…

Machine Learning · Computer Science 2026-04-24 Florian Holeczek , Andreas Hinterreiter , Alex Hernandez-Garcia , Marc Streit , Christina Humer

Generative Flow Networks, or GFlowNets, offer a promising framework for molecular design, but their internal decision policies remain opaque. This limits adoption in drug discovery, where chemists require clear and interpretable rationales…

Machine Learning · Computer Science 2025-11-25 Amirtha Varshini A S , Duminda S. Ranasinghe , Hok Hei Tam

Group Relative Policy Optimization (GRPO) is a powerful technique for aligning generative models, but its effectiveness is bottlenecked by the conflict between large group sizes and prohibitive computational costs. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shiran Ge , Chenyi Huang , Yuang Ai , Qihang Fan , Huaibo Huang , Ran He

Finding effective prompts for language models (LMs) is critical yet notoriously difficult: the prompt space is combinatorially large, rewards are sparse due to expensive target-LM evaluation. Yet, existing RL-based prompt optimizers often…

Artificial Intelligence · Computer Science 2026-02-04 Junmo Cho , Suhan Kim , Sangjune An , Minsu Kim , Dong Bok Lee , Heejun Lee , Sung Ju Hwang , Hae Beom Lee

Due to limited resources and fast economic growth, designing optimal transportation road networks with traffic simulation and validation in a cost-effective manner is vital for developing countries, where extensive manual testing is…

Artificial Intelligence · Computer Science 2023-10-06 Zarif Ikram , Ling Pan , Dianbo Liu