English
Related papers

Related papers: Flow-Factory: A Unified Framework for Reinforcemen…

200 papers

Flow Matching (FM) is a recent generative modelling technique: we aim to learn how to sample from distribution $\mathfrak{X}_1$ by flowing samples from some distribution $\mathfrak{X}_0$ that is easy to sample from. The key trick is that…

Differential Geometry · Mathematics 2025-10-24 Finn M. Sherry , Bart M. N. Smets

Recent advancements in reinforcement learning (RL) have achieved great success in fine-tuning diffusion-based generative models. However, fine-tuning continuous flow-based generative models to align with arbitrary user-defined reward…

Machine Learning · Computer Science 2025-02-11 Jiajun Fan , Shuaike Shen , Chaoran Cheng , Yuxin Chen , Chumeng Liang , Ge Liu

Diffusion Models (DMs), as a leading class of generative models, offer key advantages for reinforcement learning (RL), including multi-modal expressiveness, stable training, and trajectory-level planning. This survey delivers a…

Machine Learning · Computer Science 2025-10-15 Changfu Xu , Jianxiong Guo , Yuzhu Liang , Haiyang Huang , Haodong Zou , Xi Zheng , Shui Yu , Xiaowen Chu , Jiannong Cao , Tian Wang

Diffusion-based planners have emerged as a promising approach for human-like trajectory generation in autonomous driving. Recent works incorporate reinforcement fine-tuning to enhance the robustness of diffusion planners through…

While visuomotor policy has made advancements in recent years, contact-rich tasks still remain a challenge. Robotic manipulation tasks that require continuous contact demand explicit handling of compliance and force. However, most…

Robotics · Computer Science 2026-04-17 Tianyu Li , Yihan Li , Zizhe Zhang , Nadia Figueroa

Federated learning enables a collaborative training and optimization of global models among a group of devices without sharing local data samples. However, the heterogeneity of data in federated learning can lead to unfair representation of…

Machine Learning · Computer Science 2023-11-03 Weikang Chen , Junping Du , Yingxia Shao , Jia Wang , Yangxi Zhou

Diffusion and flow-matching models achieve remarkable generative performance but at the cost of many sampling steps, this slows inference and limits applicability to time-critical tasks. The ReFlow procedure can accelerate sampling by…

Machine Learning · Computer Science 2024-10-11 Beomsu Kim , Yu-Guan Hsieh , Michal Klein , Marco Cuturi , Jong Chul Ye , Bahjat Kawar , James Thornton

We introduce ContinualFlow, a principled framework for targeted unlearning in generative models via Flow Matching. Our method leverages an energy-based reweighting loss to softly subtract undesired regions of the data distribution without…

Machine Learning · Computer Science 2025-06-24 Lorenzo Simone , Davide Bacciu , Shuangge Ma

Modern software development demands code that is maintainable, testable, and scalable by organizing the implementation into modular components with iterative reuse of existing codes. We formalize this iterative, multi-turn paradigm as…

Software Engineering · Computer Science 2026-04-16 Sizhe Wang , Zhengren Wang , Dongsheng Ma , Yongan Yu , Rui Ling , Zhiyu Li , Feiyu Xiong , Wentao Zhang

Language model (LM) agents have gained significant attention for their ability to autonomously complete tasks through interactions with environments, tools, and APIs. LM agents are primarily built with prompt engineering or supervised…

Artificial Intelligence · Computer Science 2025-07-22 Renxi Wang , Rifo Ahmad Genadi , Bilal El Bouardi , Yongxin Wang , Fajri Koto , Zhengzhong Liu , Timothy Baldwin , Haonan Li

Accurate and real-time radio map (RM) generation is crucial for next-generation wireless systems, yet diffusion-based approaches often suffer from large model sizes, slow iterative denoising, and high inference latency, which hinder…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Haozhe Jia , Wenshuo Chen , Xiucheng Wang , Nan Cheng , Hongbo Zhang , Kuimou Yu , Songning Lai , Nanjian Jia , Bowen Tian , Hongru Xiao , Yutao Yue

It is well known that it is difficult to have a reliable and robust framework to link multi-agent deep reinforcement learning algorithms with practical multi-robot applications. To fill this gap, we propose and build an open-source…

Robotics · Computer Science 2022-09-29 Junfeng Chen , Fuqin Deng , Yuan Gao , Junjie Hu , Xiyue Guo , Guanqi Liang , Tin Lun Lam

Modern ML methods excel when training data is IID, large-scale, and well labeled. Learning in less ideal conditions remains an open challenge. The sub-fields of few-shot, continual, transfer, and representation learning have made…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Matthew Wallingford , Aditya Kusupati , Keivan Alizadeh-Vahid , Aaron Walsman , Aniruddha Kembhavi , Ali Farhadi

Diffusion models offer powerful generative capabilities for robot trajectory planning, yet their practical deployment on robots is hindered by a critical bottleneck: a reliance on imitation learning from expert demonstrations. This paradigm…

Robotics · Computer Science 2026-02-25 Lei Ye , Haibo Gao , Peng Xu , Zhelin Zhang , Junqi Shan , Ao Zhang , Wei Zhang , Ruyi Zhou , Zongquan Deng , Liang Ding

This tutorial provides a comprehensive survey of methods for fine-tuning diffusion models to optimize downstream reward functions. While diffusion models are widely known to provide excellent generative modeling capability, practical…

Machine Learning · Computer Science 2024-07-19 Masatoshi Uehara , Yulai Zhao , Tommaso Biancalani , Sergey Levine

Current mainstream methods of aligning diffusion models with human preferences typically employ VLM-based reward models. However, these reward models, pre-trained for semantic alignment, struggle to capture the essential perceptual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jaxon Zhang , Binxin Yang , Hubery Yin , Chen Li , Jing Lyu

Video generation models produce visually coherent content but struggle with tasks requiring spatial reasoning and multi-step planning. Reinforcement learning (RL) offers a path to improve generalization, but its effectiveness in video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ming Liu , Yunbei Zhang , Shilong Liu , Liwen Wang , Wensheng Zhang

Reinforcement Learning (RL) has achieved significant success in application domains such as robotics, games and health care. However, training RL agents is very time consuming. Current implementations exhibit poor performance due to…

Machine Learning · Computer Science 2021-12-24 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

Reinforcement learning (RL) in few-shot scenarios with limited sensor data is challenging due to insufficient training samples, particularly in applications like Dynamic Voltage and Frequency Scaling (DVFS) where sensor readings are…

Machine Learning · Computer Science 2026-01-13 Mohammad Pivezhandi , Abusayeed Saifullah

The occurrence of diffusion on a graph is a prevalent and significant phenomenon, as evidenced by the spread of rumors, influenza-like viruses, smart grid failures, and similar events. Comprehending the behaviors of flow is a formidable…

Social and Information Networks · Computer Science 2023-08-09 Zijian Zhang , Zonghan Zhang , Zhiqian Chen