English
Related papers

Related papers: MemoryVLA: Perceptual-Cognitive Memory in Vision-L…

200 papers

Navigating and understanding complex environments over extended periods of time is a significant challenge for robots. People interacting with the robot may want to ask questions like where something happened, when it occurred, or how long…

Robotics · Computer Science 2024-09-23 Abrar Anwar , John Welsh , Joydeep Biswas , Soha Pouya , Yan Chang

Vision-language-action (VLA) models have advanced robot manipulation through large-scale pretraining, but real-world deployment remains challenging due to partial observability and delayed feedback. Reinforcement learning addresses this via…

Vision-Language-Action (VLA) models have recently emerged as a powerful paradigm for robotic manipulation. Despite substantial progress enabled by large-scale pretraining and supervised fine-tuning (SFT), these models face two fundamental…

Vision-Language-Action (VLA) models offer a promising autonomous driving paradigm for leveraging world knowledge and reasoning capabilities, especially in long-tail scenarios. However, existing VLA models often struggle with the high…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zewei Zhou , Ruining Yang , Xuewei , Qi , Yiluan Guo , Sherry X. Chen , Tao Feng , Kateryna Pistunova , Yishan Shen , Lili Su , Jiaqi Ma

To utilize Foundation Vision Language Models (VLMs) for robotic tasks and motion planning, the community has proposed different methods for injecting action components into VLMs and building the Vision-Language-Action models (VLAs). In this…

Vision-Language-Action (VLA) models offer a promising paradigm for generalist robotic policies, yet their adaptation is hindered by data inefficiency and poor generalization. We argue that these bottlenecks stem from the prevailing Direct…

Robotics · Computer Science 2026-05-28 Yutai Li , Shaohui Peng , Jiaming Guo , Di Huang , Zihao Zhang , Yuxuan Guo , Yunkai Gao , Siming Lan , Ling Li , Xing Hu , Yunji Chen

Continual learning is a long-standing challenge in robot policy learning, where a policy must acquire new skills over time without catastrophically forgetting previously learned ones. While prior work has extensively studied continual…

Machine Learning · Computer Science 2026-03-19 Huihan Liu , Changyeon Kim , Bo Liu , Minghuan Liu , Yuke Zhu

Vision-language-action (VLA) models are emerging as embodied foundation models for robotic manipulation, but their deployment introduces a new unlearning challenge: removing unsafe, spurious, or privacy-sensitive behaviors without degrading…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Ravi Ranjan , Agoritsa Polyzou

We propose a standalone autoregressive (AR) Action Expert that generates actions as a continuous causal sequence while conditioning on refreshable vision-language prefixes. In contrast to existing Vision-Language-Action (VLA) models and…

Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for robotic manipulation, in which reliable action prediction critically depends on accurately interpreting and integrating visual observations conditioned on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yulin Luo , Hao Chen , Zhuangzhe Wu , Bowen Sui , Jiaming Liu , Chenyang Gu , Zhuoyang Liu , Qiuxuan Feng , Jiale Yu , Shuo Gu , Peng Jia , Pheng-Ann Heng , Shanghang Zhang

Vision-language-action (VLA) models hold promise as generalist robotics solutions by translating visual and linguistic inputs into robot actions, yet they lack reliability due to their black-box nature and sensitivity to environmental…

Robotics · Computer Science 2025-02-10 Hong Lu , Hengxu Li , Prithviraj Singh Shahani , Stephanie Herbers , Matthias Scheutz

Vision-language-action (VLA) models trained on large-scale internet data and robot demonstrations have the potential to serve as generalist robot policies. However, despite their large-scale training, VLAs are often brittle to…

Robotics · Computer Science 2024-10-04 Asher J. Hancock , Allen Z. Ren , Anirudha Majumdar

A fundamental objective in robot manipulation is to enable models to comprehend visual scenes and execute actions. Although existing Vision-Language-Action (VLA) models for robots can handle a range of basic tasks, they still face…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiaming Liu , Mengzhen Liu , Zhenyu Wang , Pengju An , Xiaoqi Li , Kaichen Zhou , Senqiao Yang , Renrui Zhang , Yandong Guo , Shanghang Zhang

Achieving truly adaptive embodied intelligence requires agents that learn not just by imitating static demonstrations, but by continuously improving through environmental interaction, which is akin to how humans master skills through…

Robotics · Computer Science 2025-12-17 Zechen Bai , Chen Gao , Mike Zheng Shou

Vision-language-action (VLA) models that directly predict multi-step action chunks from current observations face inherent limitations due to constrained scene understanding and weak future anticipation capabilities. In contrast, video…

Many robotic manipulation tasks require sensing and responding to force signals such as torque to assess whether the task has been successfully completed and to enable closed-loop control. However, current Vision-Language-Action (VLA)…

Robotics · Computer Science 2025-09-10 Zongzheng Zhang , Haobo Xu , Zhuo Yang , Chenghao Yue , Zehao Lin , Huan-ang Gao , Ziwei Wang , Hao Zhao

Vision-language-action (VLA) models have advanced the field of embodied manipulation by harnessing broad world knowledge and strong generalization. However, current VLA models still face several key challenges, including limited reasoning…

Robotics · Computer Science 2026-05-29 Wenhao Li , Xiu Su , Dan Niu , Yichao Cao , Hongyan Xu , Zhe Qu , Lei Fan , Shan You , Chang Xu

Vision-Language-Action (VLA) models have shown great potential for embodied AI by integrating visual perception, language understanding, and action execution. In real-time deployment, these models must process continuous visual streams,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Ziyan Liu , Yeqiu Chen , Hongyi Cai , Tao Lin , Shuo Yang , Zheng Liu , Bo Zhao

Memory capacity is a critical factor determining the performance of Vision-Language-Action (VLA) models in long-horizon manipulation tasks. Existing memory-augmented architectures primarily rely on linear or flat storage, lacking structural…

Robotics · Computer Science 2026-05-13 Yanbin Hu , Jin Cui , Jiayi Lu , Ruixuan Yang , Jun Ye , Boran Zhao , Xingyu Chen , Xuguang Lan , Pengju Ren

Autonomous driving requires generating safe and reliable trajectories from complex multimodal inputs. Traditional modular pipelines separate perception, prediction, and planning, while recent end-to-end (E2E) systems learn them jointly.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Qihang Peng , Xuesong Chen , Chenye Yang , Shaoshuai Shi , Hongsheng Li