English
Related papers

Related papers: ScoRe-Flow: Complete Distributional Control via Sc…

200 papers

This work reports the application of a model-free deep-reinforcement-learning-based (DRL) flow control strategy to suppress perturbations evolving in the 1-D linearised Kuramoto-Sivashinsky (KS) equation and 2-D boundary layer flows. The…

Fluid Dynamics · Physics 2023-01-18 Da Xu , Mengqi Zhang

The post-training pipeline for diffusion models currently has two stages: supervised fine-tuning (SFT) on curated data and reinforcement learning (RL) with reward models. A fundamental gap separates them. SFT optimizes the denoiser only on…

Machine Learning · Computer Science 2026-04-20 You Qin , Linqing Wang , Hao Fei , Roger Zimmermann , Liefeng Bo , Qinglin Lu , Chunyu Wang

Denoising-based models, such as diffusion and flow matching, have been a critical component of robotic manipulation for their strong distribution-fitting and scaling capacity. Concurrently, several works have demonstrated that simple…

Robotics · Computer Science 2025-11-25 Weixi Song , Zhetao Chen , Tao Xu , Xianchao Zeng , Xinyu Zhou , Lixin Yang , Donglin Wang , Cewu Lu , Yong-Lu Li

We present a novel method for training score-based generative models which uses nonlinear noising dynamics to improve learning of structured distributions. Generalizing to a nonlinear drift allows for additional structure to be incorporated…

Machine Learning · Statistics 2025-07-10 Jeremiah Birrell , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang , Wei Zhu

Diffusion-based unsupervised image registration has been explored for cardiac cine MR, but expensive multi-step inference limits practical use. We propose FlowReg, a flow-matching framework in displacement field space that achieves strong…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Yunguan Fu , Wenjia Bai , Wen Yan , Matthew J Clarkson , Rhodri Huw Davies , Yipeng Hu

Model-based reinforcement learning (MBRL) has gained much attention for its ability to learn complex behaviors in a sample-efficient way: planning actions by generating imaginary trajectories with predicted rewards. Despite its success, we…

Machine Learning · Computer Science 2024-02-20 Vint Lee , Pieter Abbeel , Youngwoon Lee

Generative models, particularly diffusion model, have emerged as powerful tools for sequential recommendation. However, accurately modeling user preferences remains challenging due to the noise perturbations inherent in the forward and…

Information Retrieval · Computer Science 2025-05-23 Feng Liu , Lixin Zou , Xiangyu Zhao , Min Tang , Liming Dong , Dan Luo , Xiangyang Luo , Chenliang Li

Offline reinforcement learning (RL) harnesses the power of massive datasets for resolving sequential decision problems. Most existing papers only discuss defending against out-of-distribution (OOD) actions while we investigate a broader…

Machine Learning · Computer Science 2023-11-02 Zhihong Deng , Zuyue Fu , Lingxiao Wang , Zhuoran Yang , Chenjia Bai , Tianyi Zhou , Zhaoran Wang , Jing Jiang

Imitation learning is an efficient method for teaching robots a variety of tasks. Diffusion Policy, which uses a conditional denoising diffusion process to generate actions, has demonstrated superior performance, particularly in learning…

Robotics · Computer Science 2025-08-14 Zhuoqun Chen , Xiu Yuan , Tongzhou Mu , Hao Su

A linear flow control strategy designed for weak disturbances may not remain effective in sequences of strong disturbances due to nonlinear interactions, but it is sensible to leverage it for developing a better strategy. In the present…

Fluid Dynamics · Physics 2025-11-11 Zhecheng Liu , Jeff D. Eldredge

Reinforcement learning (RL) with combinatorial action spaces remains challenging because feasible action sets are exponentially large and governed by complex feasibility constraints, making direct policy parameterization impractical.…

Machine Learning · Computer Science 2026-02-02 Lingkai Kong , Anagha Satish , Hezi Jiang , Akseli Kangaslahti , Andrew Ma , Wenbo Chen , Mingxiao Song , Lily Xu , Milind Tambe

Diffusion-based models for robotic control, including vision-language-action (VLA) and vision-action (VA) policies, have demonstrated significant capabilities. Yet their advancement is constrained by the high cost of acquiring large-scale…

Inferring the number of distinct components contributing to an observation, while simultaneously estimating their parameters, remains a long-standing challenge across signal processing, astrophysics, and neuroscience. Classical…

Instrumentation and Methods for Astrophysics · Physics 2025-12-01 Niklas Houba , Giovanni Giarda , Lorenzo Speri

Robotic assembly presents a long-standing challenge due to its requirement for precise, contact-rich manipulation. While simulation-based learning has enabled the development of robust assembly policies, their performance often degrades…

Robotics · Computer Science 2026-02-27 Yijie Guo , Iretiayo Akinola , Lars Johannsmeier , Hugo Hadfield , Abhishek Gupta , Yashraj Narang

Feedback-driven recurrent spiking neural networks (RSNNs) are powerful computational models that can mimic dynamical systems. However, the presence of a feedback loop from the readout to the recurrent layer de-stabilizes the learning…

Artificial Intelligence · Computer Science 2022-05-30 Ankita Paul , Stefan Wagner , Anup Das

Reinforcement learning (RL) has become a standard technique for post-training diffusion-based image synthesis models, as it enables learning from reward signals to explicitly improve desirable aspects such as image quality and prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 David McAllister , Miika Aittala , Tero Karras , Janne Hellsten , Angjoo Kanazawa , Timo Aila , Samuli Laine

Recent advances in generative modeling have led to promising results in robot motion planning, particularly through diffusion and flow matching (FM)-based models that capture complex, multimodal trajectory distributions. However, these…

Robotics · Computer Science 2025-11-13 Xiaobing Dai , Zewen Yang , Dian Yu , Fangzhou Liu , Hamid Sadeghian , Sami Haddadin , Sandra Hirche

A random recurrent neural network, called a reservoir, can be used to learn robot movements conditioned on context inputs that encode task goals. The Learning is achieved by mapping the random dynamics of the reservoir modulated by context…

Robotics · Computer Science 2024-11-19 Zahra Koulaeizadeh , Erhan Oztop

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for robotic manipulation. However, existing post-training methods face a dilemma between stability and exploration: Supervised Fine-Tuning (SFT) is constrained by…

Robotics · Computer Science 2026-03-17 Jiashun Li , Xiaoyu Shi , Hong Xie , Mingsheng Shang , Yun Lu

Imitation learning holds tremendous promise in learning policies efficiently for complex decision making problems. Current state-of-the-art algorithms often use inverse reinforcement learning (IRL), where given a set of expert…

Robotics · Computer Science 2023-02-22 Siddhant Haldar , Vaibhav Mathur , Denis Yarats , Lerrel Pinto