English
Related papers

Related papers: Composite Flow Matching for Reinforcement Learning…

200 papers

Continuous Integration and Continuous Deployment (CI/CD) pipelines are central to modern software delivery, yet their static workflows often introduce inefficiencies as systems scale. This paper proposes a reinforcement learning (RL) based…

Diffusion and flow-matching have emerged as powerful methodologies for generative modeling, with remarkable success in capturing complex data distributions and enabling flexible guidance at inference time. Many downstream applications,…

Machine Learning · Computer Science 2026-04-28 Zeyang Li , Kaveh Alim , Navid Azizan

Combinatorial Optimization underpins many real-world applications and yet, designing performant algorithms to solve these complex, typically NP-hard, problems remains a significant research challenge. Reinforcement Learning (RL) provides a…

Video generation models trained on heterogeneous data with likelihood-surrogate objectives can produce visually plausible rollouts that violate physical constraints in embodied manipulation. Although reinforcement-learning post-training…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhenyang Ni , Yijiang Li , Ruochen Jiao , Simon Sinong Zhan , Sipeng Chen , Zhenfei Yin , Minshuo Chen , Philip Torr , Zhaoran Wang , Qi Zhu

Offline reinforcement learning (RL) aims to learn an optimal policy from a static dataset, making it particularly valuable in scenarios where data collection is costly, such as robotics. A major challenge in offline RL is distributional…

Machine Learning · Computer Science 2025-07-16 Motoki Omura , Yusuke Mukuta , Kazuki Ota , Takayuki Osa , Tatsuya Harada

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults. This study…

Robotics · Computer Science 2026-03-02 Shingo Ayabe , Hiroshi Kera , Kazuhiko Kawamoto

We introduce AdvantageFlow, a forward-process reinforcement learning algorithm for rectified flow models. Unlike Flow-GRPO, which optimizes the reverse process, we optimize an advantage-weighted forward-process prediction loss. This…

Machine Learning · Computer Science 2026-05-26 Branislav Kveton , Anup Rao , Subhojyoti Mukherjee , Krishna Kumar Singh , Viet Dac Lai

We explore an online reinforcement learning (RL) paradigm to dynamically optimize parallel particle tracing performance in distributed-memory systems. Our method combines three novel components: (1) a work donation algorithm, (2) a…

Graphics · Computer Science 2022-02-14 Jiayi Xu , Hanqi Guo , Han-Wei Shen , Mukund Raj , Skylar W. Wurster , Tom Peterka

This work presents, to the best of the authors' knowledge, the first generalizable and fully data-driven adaptive framework designed to stabilize deep learning (DL) autoregressive forecasting models over long time horizons, with the goal of…

Fluid Dynamics · Physics 2025-05-06 Rodrigo Abadía-Heredia , Manuel Lopez-Martin , Soledad Le Clainche

Offline reinforcement learning (RL) optimizes the policy on a previously collected dataset without any interactions with the environment, yet usually suffers from the distributional shift problem. To mitigate this issue, a typical solution…

Machine Learning · Computer Science 2023-09-06 Qisen Yang , Shenzhi Wang , Qihang Zhang , Gao Huang , Shiji Song

Diffusion and flow matching policies offer expressive, multimodal action modeling, yet they are frequently unstable in online reinforcement learning (RL) due to intractable likelihoods and gradients propagating through long sampling chains.…

Machine Learning · Computer Science 2026-03-10 Chubin Zhang , Zhenglin Wan , Feng Chen , Fuchao Yang , Lang Feng , Yaxin Zhou , Xingrui Yu , Yang You , Ivor Tsang , Bo An

Recently, it has been shown that for offline deep reinforcement learning (DRL), pre-training Decision Transformer with a large language corpus can improve downstream performance (Reid et al., 2022). A natural question to ask is whether this…

Artificial Intelligence · Computer Science 2024-05-28 Zecheng Wang , Che Wang , Zixuan Dong , Keith Ross

Recent advances in hierarchical robot systems leverage a high-level planner to propose task plans and a low-level policy to generate robot actions. This design allows training the planner on action-free or even non-robot data sources (e.g.,…

Robotics · Computer Science 2026-02-13 Yitian Zheng , Zhangchen Ye , Weijun Dong , Shengjie Wang , Yuyang Liu , Chongjie Zhang , Chuan Wen , Yang Gao

This paper studies tabular reinforcement learning (RL) in the hybrid setting, which assumes access to both an offline dataset and online interactions with the unknown environment. A central question boils down to how to efficiently utilize…

Machine Learning · Computer Science 2023-05-18 Gen Li , Wenhao Zhan , Jason D. Lee , Yuejie Chi , Yuxin Chen

We consider real-world reinforcement learning (RL) of robotic manipulation tasks that involve both visuomotor skills and contact-rich skills. We aim to train a policy that maps multimodal sensory observations (vision and force) to a…

Robotics · Computer Science 2022-03-01 Jun Jin , Daniel Graves , Cameron Haigh , Jun Luo , Martin Jagersand

The amount of data moved over dedicated and non-dedicated network links increases much faster than the increase in the network capacity, but the current solutions fail to guarantee even the promised achievable transfer throughputs. In this…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-28 MD S Q Zulkar Nine , Kemal Guner , Ziyun Huang , Xiangyu Wang , Jinhui Xu , Tevfik Kosar

Flow matching has emerged as a powerful generative framework, with recent few-step methods achieving remarkable inference acceleration. However, we identify a critical yet overlooked limitation: these models suffer from severe diversity…

Machine Learning · Computer Science 2026-04-15 Yexiong Lin , Jia Shi , Shanshan Ye , Wanyu Wang , Yu Yao , Tongliang Liu

Training a generalizable agent to continually learn a sequence of tasks from offline trajectories is a natural requirement for long-lived agents, yet remains a significant challenge for current offline reinforcement learning (RL)…

Machine Learning · Computer Science 2024-11-19 Shengchao Hu , Yuhang Zhou , Ziqing Fan , Jifeng Hu , Li Shen , Ya Zhang , Dacheng Tao

Offline reinforcement learning learns an effective policy on offline datasets without online interaction, and it attracts persistent research attention due to its potential of practical application. However, extrapolation error generated by…

Machine Learning · Computer Science 2023-01-18 Ke Jiang , Jiayu Yao , Xiaoyang Tan

Offline reinforcement learning is used to train policies in scenarios where real-time access to the environment is expensive or impossible. As a natural consequence of these harsh conditions, an agent may lack the resources to fully observe…

Machine Learning · Computer Science 2021-12-09 Jayanth Reddy Regatti , Aniket Anand Deshmukh , Frank Cheng , Young Hun Jung , Abhishek Gupta , Urun Dogan