English
Related papers

Related papers: A Dual Process VLA: Efficient Robotic Manipulation…

200 papers

Many robotic manipulation tasks require sensing and responding to force signals such as torque to assess whether the task has been successfully completed and to enable closed-loop control. However, current Vision-Language-Action (VLA)…

Robotics · Computer Science 2025-09-10 Zongzheng Zhang , Haobo Xu , Zhuo Yang , Chenghao Yue , Zehao Lin , Huan-ang Gao , Ziwei Wang , Hao Zhao

Recent advances in vision-language-action (VLA) models have shown promise in integrating image generation with action prediction to improve generalization and reasoning in robot manipulation. However, existing methods are limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Wenyao Zhang , Hongsi Liu , Zekun Qi , Yunnan Wang , Xinqiang Yu , Jiazhao Zhang , Runpei Dong , Jiawei He , Fan Lu , He Wang , Zhizheng Zhang , Li Yi , Wenjun Zeng , Xin Jin

Vision-Language-Action (VLA) models are a powerful paradigm for generalist robotic control. However, their high computational cost and limited control frequency hinder real-time robotic manipulation, especially when large vision-language…

Robotics · Computer Science 2026-05-29 Ye Li , Huanan Liu , Kangye Ji , Yuan Meng , Jiajun Fan , Yuansong Wang , Shiyu Qin , Chenglei Wu , Shu-Tao Xia , Zhi Wang

Vision-Language-Action models (VLAs) achieve strong performance in general robotic manipulation tasks by scaling imitation learning. However, existing VLAs are limited to predicting short-sighted next-action, which struggle with…

Robotics · Computer Science 2026-03-03 Wenkai Guo , Guanxing Lu , Haoyuan Deng , Zhenyu Wu , Yansong Tang , Ziwei Wang

Dexterous manipulation is essential for real-world robot autonomy, mirroring the central role of human hand coordination in daily activity. Humans rely on rich multimodal perception--vision, sound, and language-guided intent--to perform…

Vision-language-action (VLA) models finetuned from vision-language models (VLMs) hold the promise of leveraging rich pretrained representations to build generalist robots across diverse tasks and environments. However, direct fine-tuning on…

Robotics · Computer Science 2025-09-18 Shresth Grover , Akshay Gopalkrishnan , Bo Ai , Henrik I. Christensen , Hao Su , Xuanlin Li

A fundamental objective in robot manipulation is to enable models to comprehend visual scenes and execute actions. Although existing Vision-Language-Action (VLA) models for robots can handle a range of basic tasks, they still face…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiaming Liu , Mengzhen Liu , Zhenyu Wang , Pengju An , Xiaoqi Li , Kaichen Zhou , Senqiao Yang , Renrui Zhang , Yandong Guo , Shanghang Zhang

Enabling robots to perform diverse tasks across varied environments is a central challenge in robot learning. While vision-language-action (VLA) models have shown promise for generalizable robot skills, realizing their full potential…

Robotics · Computer Science 2025-08-12 Junjie Wen , Yichen Zhu , Jinming Li , Zhibin Tang , Chaomin Shen , Feifei Feng

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical…

While autoregressive Large Vision-Language Models (VLMs) have achieved remarkable success, their sequential generation often limits their efficacy in complex visual planning and dynamic robotic control. In this work, we investigate the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jiacheng Ye , Shansan Gong , Jiahui Gao , Junming Fan , Shuang Wu , Wei Bi , Haoli Bai , Lifeng Shang , Lingpeng Kong

Vision-language-action (VLA) models have significantly advanced robotic manipulation by integrating vision-language models (VLMs), and action decoders into a unified architecture. However, their deployment on resource-constrained edge…

Robotics · Computer Science 2025-10-30 Jiahong Chen , Jing Wang , Long Chen , Chuwei Cai , Jinghui Lu

Vision-language-action (VLA) models demonstrate strong generalization in robotic manipulation but face challenges in complex, real-world tasks. While supervised fine-tuning with demonstrations is constrained by data quality, reinforcement…

Robotics · Computer Science 2025-09-18 Piaopiao Jin , Qi Wang , Guokang Sun , Ziwen Cai , Pinjia He , Yangwei You

Vision-Language-Action (VLA) models have demonstrated remarkable capabilities in robotic manipulation,enabling robots to execute natural language commands through end-to-end learning from visual observations.However, deploying large-scale…

Robotics · Computer Science 2025-12-16 Abdullah Yahya Abdullah Omaisan , Ibrahim Sheikh Mohamed

Vision-Language-Action (VLA) models, as large foundation models for embodied control, have shown strong performance in manipulation tasks. However, their performance comes at high inference cost. To improve efficiency, recent methods adopt…

Robotics · Computer Science 2026-04-06 Zihua Wang , Zhitao Lin , Ruibo Li , Yu Zhang , Xu Yang , Siya Mi , Xiu-Shen Wei

The important manifestation of robot intelligence is the ability to naturally interact and autonomously make decisions. Traditional approaches to robot control often compartmentalize perception, planning, and decision-making, simplifying…

Robotics · Computer Science 2025-02-05 Pengxiang Ding , Han Zhao , Wenjie Zhang , Wenxuan Song , Min Zhang , Siteng Huang , Ningxi Yang , Donglin Wang

Recent research looks to harness the general knowledge and reasoning of large language models (LLMs) into agents that accomplish user-specified goals in interactive environments. Vision-language models (VLMs) extend LLMs to multi-modal data…

Machine Learning · Computer Science 2025-05-07 Jake Grigsby , Yuke Zhu , Michael Ryoo , Juan Carlos Niebles

Reinforcement learning (RL) enables high-frequency, closed-loop control for robotic manipulation, but scaling to long-horizon tasks with sparse or imperfect rewards remains difficult due to inefficient exploration and poor credit…

Machine Learning · Computer Science 2026-04-16 Angelo Moroncelli , Roberto Zanetti , Marco Maccarini , Loris Roveda

Vision-language-action (VLA) models have achieved great success on general robotic tasks, but still face challenges in fine-grained spatiotemporal manipulation. Typically, existing methods mainly embed spatiotemporal knowledge into visual…

Robotics · Computer Science 2026-04-21 Chuanhao Ma , Hanyu Zhou , Shihan Peng , Yan Li , Tao Gu , Luxin Yan

Reasoning Vision Language Action (VLA) models improve robotic instruction-following by generating step-by-step textual plans before low-level actions, an approach inspired by Chain-of-Thought (CoT) reasoning in language models. Yet even…

Robotics · Computer Science 2026-01-15 Yilin Wu , Anqi Li , Tucker Hermans , Fabio Ramos , Andrea Bajcsy , Claudia Pérez-D'Arpino

Recent advancements in vision-language-action (VLA) models have shown promise in robotic manipulation, yet they continue to struggle with long-horizon, multi-step tasks. Existing methods lack internal reasoning mechanisms that can identify…