English
Related papers

Related papers: TRAP: Hijacking VLA CoT-Reasoning via Adversarial …

200 papers

Studying adversarial attacks on artificial intelligence (AI) systems helps discover model shortcomings, enabling the construction of a more robust system. Most existing adversarial attack methods only concentrate on single-task single-model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Qingyuan Zeng , Yunpeng Gong , Min Jiang

Chain of Thought (CoT) reasoning has demonstrated remarkable deep reasoning capabilities in both large language models (LLMs) and multimodal large language models (MLLMs). However, its reliability is often undermined by the accumulation of…

Artificial Intelligence · Computer Science 2025-11-26 Zijun Chen , Wenbo Hu , Richang Hong

Vision-language models (VLMs) have significantly advanced autonomous driving (AD) by enhancing reasoning capabilities; however, these models remain highly susceptible to adversarial attacks. While existing research has explored white-box…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Lu Wang , Tianyuan Zhang , Yang Qu , Siyuan Liang , Yuwei Chen , Aishan Liu , Xianglong Liu , Dacheng Tao

Chain-of-Thought (CoT) monitoring has emerged as a compelling method for detecting harmful behaviors such as reward hacking for reasoning models, under the assumption that models' reasoning processes are informative of such behaviors. In…

Machine Learning · Computer Science 2026-03-10 Nikolaus Howe , Micah Carroll

Reasoning language models improve performance on complex tasks by generating long chains of thought (CoTs), but this process can also increase harmful outputs in adversarial settings. In this work, we ask whether the long CoTs can be…

Computation and Language · Computer Science 2025-10-08 Yik Siu Chan , Zheng-Xin Yong , Stephen H. Bach

Chain-of-thought (CoT) reasoning has become the standard paradigm for enabling Large Language Models (LLMs) to solve complex problems. However, recent studies reveal a sharp performance drop in reasoning hop generalization scenarios, where…

Computation and Language · Computer Science 2026-05-04 Zhaoyi Li , Jiatong Li , Gangwei Jiang , Linqi Song , Defu Lian , Ying Wei

Vision language action (VLA) models enable generalist robotic agents but often exhibit language ignorance, relying on visual shortcuts and remaining insensitive to instruction changes. We present Prospective Grounding and Alignment VLA…

Robotics · Computer Science 2026-04-14 Nastaran Darabi , Amit Ranjan Trivedi

Vision-Language-Action systems follow instructions to execute multi-step tasks in multimodal environments. Recent VLA approaches typically rely on post-hoc correction mechanisms or operate under fixed task decompositions and alignment…

Artificial Intelligence · Computer Science 2026-05-12 Xiyin Zeng , Yuyu Sun , Haoyang Li , Shouqiang Liu , Hao Wang

Autonomous Vehicles (AVs), especially vision-based AVs, are rapidly being deployed without human operators. As AVs operate in safety-critical environments, understanding their robustness in an adversarial environment is an important…

Cryptography and Security · Computer Science 2026-05-05 Qi Sun , Ahmed Abdo , Luis Burbano , Ziyang Li , Yaxing Yao , Alvaro Cardenas , Yinzhi Cao

Jailbreak attacks have been observed to largely fail against recent reasoning models enhanced by Chain-of-Thought (CoT) reasoning. However, the underlying mechanism remains underexplored, and relying solely on reasoning capacity may raise…

Artificial Intelligence · Computer Science 2025-05-26 Chengda Lu , Xiaoyu Fan , Yu Huang , Rongwu Xu , Jijie Li , Wei Xu

The security issue of mobile robots has attracted considerable attention in recent years. In this paper, we propose an intelligent physical attack to trap mobile robots into a preset position by learning the obstacle-avoidance mechanism…

Robotics · Computer Science 2022-08-23 Yushan Li , Jianping He , Cailian Chen , Xinping Guan

Autonomous vehicles increasingly utilize the vision-based perception module to acquire information about driving environments and detect obstacles. Correct detection and classification are important to ensure safe driving decisions.…

Cryptography and Security · Computer Science 2024-01-02 Wenjun Zhu , Xiaoyu Ji , Yushi Cheng , Shibo Zhang , Wenyuan Xu

Chain-of-thought (CoT) prompting combined with few-shot in-context learning (ICL) has unlocked significant reasoning capabilities in large language models (LLMs). However, ICL with CoT examples is ineffective on novel tasks when the…

Computation and Language · Computer Science 2025-12-08 Vignesh Kothapalli , Ata Fatahibaarzi , Hamed Firooz , Maziar Sanjabi

Achieving robot transparency is a critical step toward effective human-robot collaboration. To be transparent, a robot's natural language communication must be consistent with its actions and explicitly grounded in the task and environment.…

Robotics · Computer Science 2026-04-08 Theodor Wulff , Federico Tavella , Rahul Singh Maharjan , Manith Adikari , Angelo Cangelosi

Large Language Models (LLMs) have shown impressive performance on complex tasks through Chain-of-Thought (CoT) reasoning. However, conventional CoT relies on explicitly verbalized intermediate steps, which constrains its broader…

Computation and Language · Computer Science 2025-11-04 Xinghao Chen , Anhao Zhao , Heming Xia , Xuan Lu , Hanlin Wang , Yanjun Chen , Wei Zhang , Jian Wang , Wenjie Li , Xiaoyu Shen

Vision-Language-Action (VLA) models map multimodal perception and language instructions to executable robot actions, making them particularly vulnerable to behavioral backdoor manipulation: a hidden trigger introduced during training can…

Cryptography and Security · Computer Science 2026-03-10 Zonghuan Xu , Jiayu Li , Yunhan Zhao , Xiang Zheng , Xingjun Ma , Yu-Gang Jiang

Transfer adversarial attack is a non-trivial black-box adversarial attack that aims to craft adversarial perturbations on the surrogate model and then apply such perturbations to the victim model. However, the transferability of…

Machine Learning · Computer Science 2021-12-14 Shuman Fang , Jie Li , Xianming Lin , Rongrong Ji

Are foundation models secure against malicious actors? In this work, we focus on the image input to a vision-language model (VLM). We discover image hijacks, adversarial images that control the behaviour of VLMs at inference time, and…

Machine Learning · Computer Science 2024-09-19 Luke Bailey , Euan Ong , Stuart Russell , Scott Emmons

Pre-trained programming language (PL) models (such as CodeT5, CodeBERT, GraphCodeBERT, etc.,) have the potential to automate software engineering tasks involving code understanding and code generation. However, these models operate in the…

Computation and Language · Computer Science 2023-04-20 Akshita Jha , Chandan K. Reddy

Chain-of-Thought (CoT) is an efficient prompting method that enables the reasoning ability of large language models by augmenting the query using multiple examples with multiple intermediate steps. Despite the empirical success, the…

Machine Learning · Computer Science 2025-05-27 Hongkang Li , Songtao Lu , Pin-Yu Chen , Xiaodong Cui , Meng Wang
‹ Prev 1 8 9 10 Next ›