English
Related papers

Related papers: Action-to-Action Flow Matching

200 papers

Flow matching has emerged as a powerful generative modeling approach with flexible choices of source distribution. While Gaussian distributions are commonly used, the potential for better alternatives in high-dimensional data generation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Junho Lee , Kwanseok Kim , Joonseok Lee

Flow models are effective at progressively generating realistic images, but they generally struggle to capture long-range dependencies during the generation process as they compress all the information from previous time steps into a single…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mude Hui , Rui-Jie Zhu , Songlin Yang , Yu Zhang , Zirui Wang , Yuyin Zhou , Jason Eshraghian , Cihang Xie

Flow matching has emerged as a competitive framework for learning high-quality generative policies in robotics; however, we find that generalisation arises and saturates early along the flow trajectory, in accordance with recent findings in…

Robotics · Computer Science 2026-03-03 Zidong Chen , Zihao Guo , Peng Wang , ThankGod Itua Egbe , Yan Lyu , Chenghao Qian

In this work, we present an approach to construct a video-based robot policy capable of reliably executing diverse tasks across different robots and environments from few video demonstrations without using any action annotations. Our method…

Robotics · Computer Science 2023-10-13 Po-Chen Ko , Jiayuan Mao , Yilun Du , Shao-Hua Sun , Joshua B. Tenenbaum

We propose Instruct2Attack (I2A), a language-guided semantic attack that generates semantically meaningful perturbations according to free-form language instructions. We make use of state-of-the-art latent diffusion models, where we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Jiang Liu , Chen Wei , Yuxiang Guo , Heng Yu , Alan Yuille , Soheil Feizi , Chun Pong Lau , Rama Chellappa

The performance of flow matching and diffusion models can be greatly improved at inference time using reward alignment algorithms, yet efficiency remains a major limitation. While several algorithms were proposed, we demonstrate that a…

Machine Learning · Computer Science 2026-02-12 Peter Holderrieth , Uriel Singer , Tommi Jaakkola , Ricky T. Q. Chen , Yaron Lipman , Brian Karrer

Offline reinforcement learning endeavors to leverage offline datasets to craft effective agent policy without online interaction, which imposes proper conservative constraints with the support of behavior policies to tackle the…

Machine Learning · Computer Science 2024-11-12 Yunpeng Qing , Shunyu liu , Jingyuan Cong , Kaixuan Chen , Yihe Zhou , Mingli Song

Bifurcation phenomena in nonlinear dynamical systems often lead to multiple coexisting stable solutions, particularly in the presence of symmetry breaking. Deterministic machine learning models are unable to capture this multiplicity,…

Machine Learning · Computer Science 2026-01-26 Fleur Hendriks , Ondřej Rokoš , Martin Doškář , Marc G. D. Geers , Vlado Menkovski

Reinforcement learning algorithms rely on exploration to discover new behaviors, which is typically achieved by following a stochastic policy. In continuous control tasks, policies with a Gaussian distribution have been widely adopted.…

Machine Learning · Computer Science 2019-03-28 Dmytro Korenkevych , A. Rupam Mahmood , Gautham Vasan , James Bergstra

Text-to-video models have demonstrated impressive capabilities in producing diverse and captivating video content, showcasing a notable advancement in generative AI. However, these models generally lack fine-grained control over motion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Tuna Han Salih Meral , Hidir Yesiltepe , Connor Dunlop , Pinar Yanardag

Agentic workflows in large language model systems integrate retrieval, reasoning, and memory, but existing frameworks suffer from scalability and reproducibility limitations due to fragmented data orchestration, serialization overhead, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Arup Kumar Sarker , Mills Staylor , Aymen Alsaadi , Gregor von Laszewski , Shantenu Jha , Geoffrey Fox

Simulation-to-decision learning enables safe policy training in digital environments without risking real-world deployment, and has become essential in mission-critical domains such as supply chains and industrial systems. However,…

Machine Learning · Computer Science 2026-03-11 Hongyu Cao , Jinghan Zhang , Kunpeng Liu , Dongjie Wang , Feng Xia , Haifeng Chen , Xiaohua Hu , Yanjie Fu

Recent Vision-Language-Action (VLA) models equipped with Flow Matching (FM) action heads achieve state-of-the-art performance in complex robot manipulation. However, the multi-step iterative ODE solving required by FM introduces inference…

Robotics · Computer Science 2026-03-19 Zhou Fang , Jiaqi Wang , Yi Zhou , Qiongfeng Shi

Large language models (LLMs) have shown strong potential in automating the design of agentic workflows. However, existing methods still rely heavily on manually predefined operators, limiting generalization and scalability. To address this…

Artificial Intelligence · Computer Science 2025-11-27 Mingming Zhao , Xiaokang Wei , Yuanqi Shao , Kaiwen Zhou , Lin Yang , Siwei Rao , Junhui Zhan , Zhitang Chen

Deep generative models provide state-of-the-art performance across a wide array of applications, with recent studies showing increasing applicability for science and engineering. Despite a growing corpus of literature focused on the…

Machine Learning · Computer Science 2026-05-14 Jacob K. Christopher , James E. Warner , Ferdinando Fioretto

Developing efficient and accurate visuomotor policies poses a central challenge in robotic imitation learning. While recent rectified flow approaches have advanced visuomotor policy learning, they suffer from a key limitation: After…

Robotics · Computer Science 2025-11-12 Rong Xue , Jiageng Mao , Mingtong Zhang , Yue Wang

Generative models have shown robust performance on speech enhancement and restoration tasks, but most prior approaches operate offline with high latency, making them unsuitable for streaming applications. In this work, we investigate the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-21 Tsun-An Hsieh , Sebastian Braun

Diffusion models generate samples through an iterative denoising process, guided by a neural network. While training the denoiser on real-world data is computationally demanding, the sampling procedure itself is more flexible. This…

Machine Learning · Computer Science 2026-02-10 Constant Bourdrez , Alexandre Vérine , Olivier Cappé

This work proposes an efficient method to enhance the quality of corrupted speech signals by leveraging both acoustic and visual cues. While existing diffusion-based approaches have demonstrated remarkable quality, their applicability is…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-14 Chaeyoung Jung , Suyeon Lee , Ji-Hoon Kim , Joon Son Chung

Generative flow and diffusion models provide the continuous, multimodal action distributions needed for high-precision robotic policies. However, their reliance on iterative sampling introduces severe inference latency, degrading control…

Robotics · Computer Science 2026-03-16 Shaolong Li , Lichao Sun , Yongchao Chen