English
Related papers

Related papers: TRAP: Hijacking VLA CoT-Reasoning via Adversarial …

200 papers

Large language models exhibit high-level commonsense reasoning abilities, especially with enhancement methods like Chain-of-Thought (CoT). However, we find these CoT-like methods lead to a considerable number of originally correct answers…

Computation and Language · Computer Science 2024-10-15 Jiachun Li , Pengfei Cao , Chenhao Wang , Zhuoran Jin , Yubo Chen , Daojian Zeng , Kang Liu , Jun Zhao

Vision-Language-Action (VLA) models with integrated reasoning have been proposed for end-to-end autonomous driving, assuming a tight coupling between reasoning and trajectory generation. However, the robustness of such systems under…

Cryptography and Security · Computer Science 2026-05-29 Mohammadreza Teymoorianfard , Jean-Philippe Monteuuis , Jonathan Petit , Amir Houmansadr

Autonomous driving represents a prominent application of artificial intelligence. Recent approaches have shifted from focusing solely on common scenarios to addressing complex, long-tail situations such as subtle human behaviors, traffic…

Robotics · Computer Science 2025-11-26 Dapeng Zhang , Fei Shen , Rui Zhao , Yinda Chen , Peng Zhi , Chenyang Li , Rui Zhou , Qingguo Zhou

Vision-Language Models (VLMs) struggle to translate high-level instructions into the precise spatial affordances required for robotic manipulation. While visual Chain-of-Thought (CoT) methods exist, they are often computationally intensive.…

Robotics · Computer Science 2025-11-05 Sangyun Park , Jin Kim , Yuchen Cui , Matthew S. Brown

Vision-Language-Action (VLA) models leverage pretrained vision-language models (VLMs) to couple perception with robotic control, offering a promising path toward general-purpose embodied intelligence. However, current SOTA VLAs are…

Robotics · Computer Science 2025-10-10 Yandu Chen , Kefan Gu , Yuqing Wen , Yucheng Zhao , Tiancai Wang , Liqiang Nie

A key limitation of learned robot control policies is their inability to generalize outside their training data. Recent works on vision-language-action models (VLAs) have shown that the use of large, internet pre-trained vision-language…

Robotics · Computer Science 2025-03-10 Michał Zawalski , William Chen , Karl Pertsch , Oier Mees , Chelsea Finn , Sergey Levine

While reasoning technology like Chain of Thought (CoT) has been widely adopted in Vision Language Action (VLA) models, it demonstrates promising capabilities in end to end autonomous driving. However, recent efforts to integrate CoT…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuechen Luo , Fang Li , Shaoqing Xu , Zhiyi Lai , Lei Yang , Qimao Chen , Ziang Luo , Zixun Xie , Shengyin Jiang , Jiaxin Liu , Long Chen , Bing Wang , Zhi-xin Yang

Vision-Language-Action (VLA) tasks require reasoning over complex visual scenes and executing adaptive actions in dynamic environments. While recent studies on reasoning VLAs show that explicit chain-of-thought (CoT) can improve…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Chi-Pin Huang , Yunze Man , Zhiding Yu , Min-Hung Chen , Jan Kautz , Yu-Chiang Frank Wang , Fu-En Yang

Video reasoning, the task of enabling machines to infer from dynamic visual content through multi-step logic, is crucial for advanced AI. While the Chain-of-Thought (CoT) mechanism has enhanced reasoning in text-based tasks, its application…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Mi Luo , Zihui Xue , Alex Dimakis , Kristen Grauman

Chain-of-Thought (CoT) prompting has been widely recognized for its ability to enhance reasoning capabilities in large language models (LLMs). However, our study reveals a surprising contradiction to this prevailing perspective within the…

Computation and Language · Computer Science 2025-11-04 Tianshi Zheng , Yixiang Chen , Chengxi Li , Chunyang Li , Qing Zong , Haochen Shi , Baixuan Xu , Yangqiu Song , Ginny Y. Wong , Simon See

Vision-Language Pre-training (VLP) methods based on object detection enjoy the rich knowledge of fine-grained object-text alignment but at the cost of computationally expensive inference. Recent Visual-Transformer (ViT)-based approaches…

Multimedia · Computer Science 2024-02-27 Chaoya Jiang , Haiyang Xu , Wei Ye , Qinghao Ye , Chenliang Li , Ming Yan , Bin Bi , Shikun Zhang , Ji Zhang , Fei Huang

Chain-of-Thought (CoT) empowers Large Language Models (LLMs) to tackle complex problems, but remains constrained by the computational cost and reasoning path collapse when grounded in discrete token spaces. Recent latent reasoning…

Artificial Intelligence · Computer Science 2026-02-05 Jiecong Wang , Hao Peng , Chunyang Liu

Vision-Language-Action models have emerged as essential generalist robot policies for diverse manipulation tasks, conventionally relying on directly translating multimodal inputs into actions via Vision-Language Model embeddings. Recent…

Robotics · Computer Science 2026-03-31 Linqing Zhong , Yi Liu , Yifei Wei , Ziyu Xiong , Maoqing Yao , Si Liu , Guanghui Ren

Addressing the escalating security vulnerabilities in Vision-Language-Action (VLA) models, this study investigates backdoor attacks targeting the visual pathway. We identify a core obstacle causing the failure of traditional attack…

Robotics · Computer Science 2026-05-12 Kewei Chen , Yayu Long , Shuai Li , Mingsheng Shang

While Vision-Language-Action (VLA) models generalize well to generic instructions, they struggle with personalized commands such as "bring my cup," where the robot must act on one specific instance among visually similar objects. We study…

Robotics · Computer Science 2026-01-30 Sangoh Lee , Sangwoo Mo , Wook-Shin Han

Multi-turn jailbreak attacks have proven effective against text-only large language models (LLMs), where malicious content is gradually introduced to bypass safety alignment. However, effectively extending such attacks to large…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 In Chong Choi , Jiacheng Zhang , Feng Liu , Yiliao Song

Vision-Language-Action (VLA) models aim to unify perception, language understanding, and action generation, offering strong cross-task and cross-scene generalization with broad impact on embodied AI. However, current VLA models often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Angen Ye , Zeyu Zhang , Boyuan Wang , Xiaofeng Wang , Dapeng Zhang , Zheng Zhu

Chain-of-Thought (CoT) prompting has emerged as a powerful technique for enhancing language model's reasoning capabilities. However, generating long and correct CoT trajectories is challenging. Recent studies have demonstrated that Looped…

Computation and Language · Computer Science 2025-02-13 Qifan Yu , Zhenyu He , Sijie Li , Xun Zhou , Jun Zhang , Jingjing Xu , Di He

Vision-Language-Action (VLA) models have demonstrated remarkable capabilities and generalization in embodied manipulation. However, their decision-making relies on a fast, instinctive process that lacks deliberation. This strategy often…

Robotics · Computer Science 2026-05-29 Wenhao Li , Xiu Su , Yichao Cao , Hongyan Xu , Xiaobo Xia , Shan You , Yi Chen , Chang Xu

Vision-Language-Action (VLA) models enable robots to interpret natural-language instructions and perform diverse tasks, yet their integration of perception, language, and control introduces new safety vulnerabilities. Despite growing…

Cryptography and Security · Computer Science 2025-11-18 Jiayu Li , Yunhan Zhao , Xiang Zheng , Zonghuan Xu , Yige Li , Xingjun Ma , Yu-Gang Jiang