English
Related papers

Related papers: FASTER: Rethinking Real-Time Flow VLAs

200 papers

Diffusion models have achieved remarkable success across various domains. However, their slow generation speed remains a critical challenge. Existing acceleration methods, while aiming to reduce steps, often compromise sample quality,…

Machine Learning · Computer Science 2025-03-26 Huiyang Shao , Xin Xia , Yuhong Yang , Yuxi Ren , Xing Wang , Xuefeng Xiao

Vision-Language-Action (VLA) models have demonstrated remarkable capabilities in visuomotor control, yet ensuring their robustness in unstructured real-world environments remains a persistent challenge. In this paper, we investigate…

Solving complex, long-horizon robotic manipulation tasks requires a deep understanding of physical interactions, reasoning about their long-term consequences, and precise high-level planning. Vision-Language Models (VLMs) offer a general…

Robotics · Computer Science 2026-02-24 Yanting Yang , Shenyuan Gao , Qingwen Bu , Li Chen , Dimitris N. Metaxas

Reinforcement learning (RL) can enable task-oriented dialogue systems to steer the conversation towards successful task completion. In an end-to-end setting, a response can be constructed in a word-level sequential decision making process…

Computation and Language · Computer Science 2020-11-19 Nurul Lubis , Christian Geishauser , Michael Heck , Hsien-chin Lin , Marco Moresi , Carel van Niekerk , Milica Gašić

Modern robotic policies increasingly rely on action chunking to execute complex tasks in the physical world. While action chunking improves temporal consistency at moderate action frequencies, it becomes insufficient when the action…

Robotics · Computer Science 2026-05-26 Kunyun Wang , Yuhang Zheng , Yupeng Zheng , Jieru Zhao , Wenchao Ding

Embodied Chain-of-Thought (ECoT) reasoning enhances vision-language-action (VLA) models by improving performance and interpretability through intermediate reasoning steps. However, its sequential autoregressive token generation introduces…

Robotics · Computer Science 2025-09-23 Zhekai Duan , Yuan Zhang , Shikai Geng , Gaowen Liu , Joschka Boedecker , Chris Xiaoxuan Lu

Flow matching policies learn continuous velocity fields that transport noise to actions, enabling fast deterministic inference for robot manipulation. However, standard training optimizes a pointwise velocity objective while inference…

Robotics · Computer Science 2026-05-12 Riad Ahmed , Sujosh Nag , Moniruzzaman Akash , Mostafa Hussein , Momotaz Begum

Typical video classification methods often divide a video into short clips, do inference on each clip independently, then aggregate the clip-level predictions to generate the video-level results. However, processing visually similar clips…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Linchao Zhu , Laura Sevilla-Lara , Du Tran , Matt Feiszli , Yi Yang , Heng Wang

Test-Time Optimization enables models to adapt to new data during inference by updating parameters on-the-fly. Recent advances in Vision-Language Models (VLMs) have explored learning prompts at test time to improve performance in downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dhruv Sarkar , Aprameyo Chakrabartty , Bibhudatta Bhanja

Vision-Language-Action (VLA) models enable generalist robotic manipulation but suffer from high inference latency. This bottleneck stems from the massive number of visual tokens processed by large language backbones. Existing methods either…

Robotics · Computer Science 2026-03-12 Yuquan Li , Lianjie Ma , Han Ding , Lijun Zhu

While autoregressive (AR) Vision-Language-Action (VLA) models have demonstrated formidable reasoning capabilities in robotic tasks, their sequential decoding process often incurs high inference latency and may amplify error accumulation…

Robotics · Computer Science 2026-05-14 Ruiheng Wang , Shuanghao Bai , Haoran Zhang , Badong Chen , Xiangyu Xu

Diffusion Language Models (DLMs) enable parallel decoding via iterative denoising, where remasking strategies play a critical role in balancing inference speed and output quality. Existing methods predominantly rely on static confidence…

Computation and Language · Computer Science 2026-02-24 Xinhao Sun , Huaijin Zhao , Maoliang Li , Zihao Zheng , Jiayu Chen , Yun Liang , Xiang Chen

Autonomous racing presents unique challenges due to its non-linear dynamics, the high speed involved, and the critical need for real-time decision-making under dynamic and unpredictable conditions. Most traditional Reinforcement Learning…

Robotics · Computer Science 2025-05-13 Benedict Hildisch , Edoardo Ghignone , Nicolas Baumann , Cheng Hu , Andrea Carron , Michele Magno

Recent advances in Vision-Language-Action (VLA) models have established a two-component architecture, where a pre-trained Vision-Language Model (VLM) encodes visual observations and task descriptions, and an action decoder maps these…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Denis Tarasov , Alexander Nikulin , Ilya Zisman , Albina Klepach , Nikita Lyubaykin , Andrei Polubarov , Alexander Derevyagin , Vladislav Kurenkov

Previous dominant methods for scene flow estimation focus mainly on input from two consecutive frames, neglecting valuable information in the temporal domain. While recent trends shift towards multi-frame reasoning, they suffer from rapidly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Qingwen Zhang , Xiaomeng Zhu , Yushan Zhang , Yixi Cai , Olov Andersson , Patric Jensfelt

High-speed trajectory planning through unknown environments requires algorithmic techniques that enable fast reaction times while maintaining safety as new information about the operating environment is obtained. The requirement of…

Robotics · Computer Science 2020-05-15 Jesus Tordesillas , Brett T. Lopez , Jonathan P. How

The quadratic computational complexity of standard attention mechanisms presents a severe scalability bottleneck for LLMs in long-context scenarios. While hybrid attention mechanisms combining Full Attention (FA) and Sparse Attention (SA)…

Machine Learning · Computer Science 2026-04-10 Quantong Qiu , Zhiyi Hong , Yi Yang , Haitian Wang , Kebin Liu , Qingqing Dang , Juntao Li , Min Zhang

We propose Flow-Anchored Noise-conditioned Q-Learning (FAN), a highly efficient and high-performing offline reinforcement learning (RL) algorithm. Recent work has shown that expressive flow policies and distributional critics improve…

Machine Learning · Computer Science 2026-05-29 Sungyoung Lee , Dohyeong Kim , Eshan Balachandar , Zelal Su Mustafaoglu , Keshav Pingali

Vision-Language-Action (VLA) models have emerged as a promising paradigm for general-purpose robotic control, with test-time scaling (TTS) gaining attention to enhance robustness beyond training. However, existing TTS methods for VLAs…

Robotics · Computer Science 2026-02-05 Hyeonbeom Choi , Daechul Ahn , Youhan Lee , Taewook Kang , Seongwon Cho , Jonghyun Choi

Learning expressive and efficient policy functions is a promising direction in reinforcement learning (RL). While flow-based policies have recently proven effective in modeling complex action distributions with a fast deterministic sampling…

Machine Learning · Computer Science 2026-03-10 Guojian Zhan , Letian Tao , Pengcheng Wang , Yixiao Wang , Yiheng Li , Yuxin Chen , Hongyang Li , Masayoshi Tomizuka , Shengbo Eben Li