English
Related papers

Related papers: Composite Flow Matching for Reinforcement Learning…

200 papers

Offline meta reinforcement learning (OMRL) has emerged as a promising approach for interaction avoidance and strong generalization performance by leveraging pre-collected data and meta-learning techniques. Previous context-based approaches…

Machine Learning · Computer Science 2025-02-04 Hai Zhang , Boyuan Zheng , Tianying Ji , Jinhang Liu , Anqi Guo , Junqiao Zhao , Lanqing Li

Reinforcement learning (RL) with diverse offline datasets can have the advantage of leveraging the relation of multiple tasks and the common skills learned across those tasks, hence allowing us to deal with real-world complex problems…

Machine Learning · Computer Science 2024-08-29 Minjong Yoo , Sangwoo Cho , Honguk Woo

Learning the inverse dynamics of soft continuum robots remains challenging due to high-dimensional nonlinearities and complex actuation coupling. Conventional feedback-based controllers often suffer from control chattering due to corrective…

Robotics · Computer Science 2026-04-06 Hang Yang , Fangju Yang , Yangming Zhang , Ibrahim Alsarraj , Yuhao Wang , Zhenye Luo , Zixi Chen , Ke Wu

Meta-reinforcement learning (RL) methods can meta-train policies that adapt to new tasks with orders of magnitude less data than standard RL, but meta-training itself is costly and time-consuming. If we can meta-train on offline data, then…

Machine Learning · Computer Science 2022-07-08 Vitchyr H. Pong , Ashvin Nair , Laura Smith , Catherine Huang , Sergey Levine

Sample efficiency and exploration remain critical challenges in Deep Reinforcement Learning (DRL), particularly in complex domains. Offline RL, which enables agents to learn optimal policies from static, pre-collected datasets, has emerged…

Machine Learning · Computer Science 2025-12-23 Gaurav Chaudhary , Wassim Uddin Mondal , Laxmidhar Behera

The interpretation of ego motion and scene change is a fundamental task for mobile robots. Optical flow information can be employed to estimate motion in the surroundings. Recently, unsupervised optical flow estimation has become a research…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Hengli Wang , Rui Fan , Ming Liu

Data collection is crucial for learning robust world models in model-based reinforcement learning. The most prevalent strategies are to actively collect trajectories by interacting with the environment during online training or training on…

Machine Learning · Computer Science 2025-09-09 Jiaqi Chen , Ji Shi , Cansu Sancaktar , Jonas Frey , Georg Martius

Projection-based reduced order models rely on offline-online model decomposition, where the data-based energetic spatial basis is used in the expensive offline stage to obtain equations of reduced states that evolve in time during the…

Fluid Dynamics · Physics 2024-02-01 Aviral Prakash , Yongjie Jessica Zhang

Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause…

Machine Learning · Computer Science 2019-03-01 Anusha Nagabandi , Ignasi Clavera , Simin Liu , Ronald S. Fearing , Pieter Abbeel , Sergey Levine , Chelsea Finn

End-to-end learning robotic manipulation with high data efficiency is one of the key challenges in robotics. The latest methods that utilize human demonstration data and unsupervised representation learning has proven to be a promising…

Robotics · Computer Science 2021-10-22 Jin Li , Xianyuan Zhan , Zixu Xiao , Guyue Zhou

The goal in offline data-driven decision-making is synthesize decisions that optimize a black-box utility function, using a previously-collected static dataset, with no active interaction. These problems appear in many forms: offline…

Machine Learning · Computer Science 2022-11-28 Han Qi , Yi Su , Aviral Kumar , Sergey Levine

Modeling an unknown dynamical system is crucial in order to predict the future behavior of the system. A standard approach is training recurrent models on measurement data. While these models typically provide exact short-term predictions,…

Machine Learning · Computer Science 2023-03-02 Katharina Ensinger , Sebastian Ziesche , Barbara Rakitsch , Michael Tiemann , Sebastian Trimpe

We introduce Coupled Flow Matching (CPFM), a framework that integrates controllable dimensionality reduction and high-fidelity reconstruction. CPFM learns coupled continuous flows for both the high-dimensional data x and the low-dimensional…

Machine Learning · Statistics 2025-10-28 Wenxi Cai , Yuheng Wang , Naichen Shi

Scene flow estimation is a crucial component in the development of autonomous driving and 3D robotics, providing valuable information for environment perception and navigation. Despite the advantages of learning-based scene flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Rahul Ahuja , Chris Baker , Wilko Schwarting

This study presents a dynamic safety margin-based reinforcement learning framework for local motion planning in dynamic and uncertain environments. The proposed planner integrates real-time trajectory optimization with adaptive gap…

Robotics · Computer Science 2025-05-20 Tengfei Liu , Haoyang Zhong , Jiazheng Hu , Tan Zhang

Offline reinforcement learning (RL) can in principle synthesize more optimal behavior from a dataset consisting only of suboptimal trials. One way that this can happen is by "stitching" together the best parts of otherwise suboptimal…

Machine Learning · Computer Science 2023-11-01 Joey Hong , Anca Dragan , Sergey Levine

We propose Flow-Anchored Noise-conditioned Q-Learning (FAN), a highly efficient and high-performing offline reinforcement learning (RL) algorithm. Recent work has shown that expressive flow policies and distributional critics improve…

Machine Learning · Computer Science 2026-05-29 Sungyoung Lee , Dohyeong Kim , Eshan Balachandar , Zelal Su Mustafaoglu , Keshav Pingali

Prior flow matching methods in robotics have primarily learned velocity fields to morph one distribution of trajectories into another. In this work, we extend flow matching to capture second-order trajectory dynamics, incorporating…

Robotics · Computer Science 2025-03-11 Khang Nguyen , An T. Le , Tien Pham , Manfred Huber , Jan Peters , Minh Nhat Vu

We consider the hybrid reinforcement learning setting where the agent has access to both offline data and online interactive access. While Reinforcement Learning (RL) research typically assumes offline data contains complete action, reward…

Machine Learning · Computer Science 2024-06-12 Yuda Song , J. Andrew Bagnell , Aarti Singh

Diffusion and flow matching have emerged as expressive policy classes in reinforcement learning, but their reliance on multi-step denoising imposes substantial computational overhead at inference time, which is particularly problematic in…

Machine Learning · Computer Science 2026-05-25 Kyungyoon Kim , Donghyeon Ki , Hee-Jun Ahn , Byung-Jun Lee