English
Related papers

Related papers: Capability and Robustness Cannot Both Be Free: An …

200 papers

With the increase in deep learning, it becomes increasingly difficult to understand the model in which AI systems can identify objects. Thus, an adversary could aim to modify an image by adding unseen elements, which will confuse the AI in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Jonathon Fox , William J Buchanan , Pavlos Papadopoulos

Recent high-capacity vision-language-action (VLA) models have demonstrated impressive performance on a range of robotic manipulation tasks by imitating human demonstrations. However, exploiting offline data with limited visited states will…

Robotics · Computer Science 2025-05-27 Guanxing Lu , Wenkai Guo , Chubin Zhang , Yuheng Zhou , Haonan Jiang , Zifeng Gao , Yansong Tang , Ziwei Wang

While vision-language-action (VLA) models for embodied agents integrate perception, reasoning, and control, they remain constrained by two critical weaknesses: first, during grasping tasks, the action tokens generated by the language model…

Robotics · Computer Science 2026-02-03 Wentao Zhang , Aolan Sun , Wentao Mo , Xiaoyang Qu , Yuxin Zheng , Jianzong Wang

Vision-Language-Action (VLA) models have demonstrated remarkable generalization capabilities in robotic manipulation tasks, yet their substantial computational overhead remains a critical obstacle to real-world deployment. Improving…

Robotics · Computer Science 2026-02-03 Yujie Wei , Jiahan Fan , Jiyu Guo , Ruichen Zhen , Rui Shao , Xiu Su , Zeke Xie , Shuo Yang

Vision-Language-Action (VLA) models adapt large vision-language backbones to map images and instructions into robot actions. However, prevailing VLAs either generate actions auto-regressively in a fixed left-to-right order or attach…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zhixuan Liang , Yizhuo Li , Tianshuo Yang , Chengyue Wu , Sitong Mao , Tian Nian , Liuao Pei , Shunbo Zhou , Xiaokang Yang , Jiangmiao Pang , Yao Mu , Ping Luo

Vision-Language-Action (VLA) models have shown strong performance on embodied manipulation, yet they remain brittle under visual observation changes, paraphrased language instructions, and compounded perturbations. This limitation suggests…

Robotics · Computer Science 2026-05-20 Jingzhou Luo , Yifan Wen , Yongjie Bai , Xinshuai Song , Yang Liu , Liang Lin

Vision language action (VLA) models enable generalist robotic agents but often exhibit language ignorance, relying on visual shortcuts and remaining insensitive to instruction changes. We present Prospective Grounding and Alignment VLA…

Robotics · Computer Science 2026-04-14 Nastaran Darabi , Amit Ranjan Trivedi

The evaluation of Vision-Language-Action (VLA) agents is hindered by the coarse, end-task success metric that fails to provide precise skill diagnosis or measure robustness to real-world perturbations. This challenge is exacerbated by a…

Robotics · Computer Science 2025-10-22 Jierui Peng , Yanyan Zhang , Yicheng Duan , Tuo Liang , Vipin Chaudhary , Yu Yin

Vision-Language-Action (VLA) models, trained via flow-matching or diffusion objectives, excel at learning complex behaviors from large-scale, multi-modal datasets (e.g., human teleoperation, scripted policies). However, since VLAs…

Robotics · Computer Science 2025-12-03 Siyuan Yang , Yang Zhang , Haoran He , Ling Pan , Xiu Li , Chenjia Bai , Xuelong Li

Vision-Language-Action models (VLAs) represent a significant frontier in embodied intelligence, aiming to bridge digital knowledge with physical-world interaction. Despite their remarkable performance, foundational VLAs are hindered by the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zhaoshu Yu , Bo Wang , Pengpeng Zeng , Haonan Zhang , Ji Zhang , Zheng Wang , Lianli Gao , Jingkuan Song , Nicu Sebe , Heng Tao Shen

Reinforcement Learning with Verifiable Reward (RLVR) has significantly advanced the complex reasoning abilities of Large Language Models (LLMs). However, it struggles to break through the inherent capability boundaries of the base LLM, due…

Artificial Intelligence · Computer Science 2026-04-16 Yihong Dong , Xue Jiang , Yongding Tao , Huanyu Liu , Kechi Zhang , Lili Mou , Rongyu Cao , Yingwei Ma , Jue Chen , Binhua Li , Zhi Jin , Fei Huang , Yongbin Li , Ge Li

Vision-Language-Action (VLA) models are promising for generalist robot control, but on-robot deployment is bottlenecked by real-time inference under tight cost and energy budgets. Most prior evaluations rely on desktop-grade GPUs, obscuring…

Robotics · Computer Science 2026-04-28 Kaijun Zhou , Qiwei Chen , Da Peng , Zhiyang Li , Xijun Li , Jinyu Gu

Vision-language models (VLMs) are increasingly deployed as trusted authorities -- fact-checking images on social media, comparing products, and moderating content. Users implicitly trust that these systems perceive the same visual content…

Cryptography and Security · Computer Science 2026-05-07 Jie Zhang , Pura Peetathawatchai , Florian Tramèr , Avital Shafran

While large vision-language-action (VLA) models and generative world models (WM) have advanced long-horizon embodied intelligence, their practical deployment remains challenged by uncertainty in learning-based action generation. Low-quality…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Zhen Sun , Yongjian Guo , Haoran Sun , Luqiao Wang , Wei Lu , Jiachi Ji , Shengzhe Ji , Junwu Xiong , Zhijun Meng

Current vision-language-action (VLA) models, pre-trained on large-scale robotic data, exhibit strong multi-task capabilities and generalize well to variations in visual and language instructions for manipulation. However, their success rate…

Robotics · Computer Science 2025-10-17 Han Zhao , Jiaxuan Zhang , Wenxuan Song , Pengxiang Ding , Donglin Wang

It is infeasible to encompass all possible disturbances within the training dataset. This raises a critical question regarding the robustness of Vision-Language-Action (VLA) models when encountering unseen real-world visual disturbances,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yiyang Fu , Chubin Zhang , Shukai Gong , Yufan Deng , Kaiwei Sun , Qiyang Min , Qibin Hou , Yansong Tang , Jianan Wang , Daquan Zhou

Lifelong learning is critical for embodied agents in open-world environments, where reinforcement learning fine-tuning has emerged as an important paradigm to enable Vision-Language-Action (VLA) models to master dexterous manipulation…

Artificial Intelligence · Computer Science 2026-02-04 Qixin Zeng , Shuo Zhang , Hongyin Zhang , Renjie Wang , Han Zhao , Libang Zhao , Runze Li , Donglin Wang , Chao Huang

Despite their strong performance in embodied tasks, recent Vision-Language-Action (VLA) models remain highly fragile under multimodal perturbations, where visual corruption and linguistic noise jointly induce distribution shifts that…

Robotics · Computer Science 2026-04-15 Yuhan Xie , Yuping Yan , Yunqi Zhao , Handing Wang , Yaochu Jin

Vision-Language-Action (VLA) models, particularly diffusion-based architectures, demonstrate transformative potential for embodied intelligence but are severely hampered by high computational and memory demands stemming from extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Yantai Yang , Yuhao Wang , Zichen Wen , Luo Zhongwei , Chang Zou , Zhipeng Zhang , Chuan Wen , Linfeng Zhang

Scaling Vision-Language-Action (VLA) models by upgrading the vision encoder is expected to improve downstream manipulation performance--as it does in vision-language modeling. We show that this expectation fails when actions are represented…

Robotics · Computer Science 2026-04-06 Takuya Shiba