English
Related papers

Related papers: TRAP: Hijacking VLA CoT-Reasoning via Adversarial …

200 papers

Vision-Language-Action (VLA) models are a promising path toward embodied intelligence, yet they often overlook the predictive and temporal-causal structure underlying visual dynamics. World-model VLAs address this by predicting future…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Fuxiang Yang , Donglin Di , Lulu Tang , Xuancheng Zhang , Lei Fan , Hao Li , Chen Wei , Tonghua Su , Baorui Ma

Vision-Language-Action (VLA) models have recently shown strong generalization, with some approaches seeking to explicitly generate linguistic reasoning traces or predict future observations prior to execution. However, explicit reasoning…

Chain-of-thought (CoT) reasoning is fundamental to modern LLM architectures and represents a critical intervention point for AI safety. However, CoT reasoning may exhibit failure modes that we note as pathologies, which prevent it from…

Artificial Intelligence · Computer Science 2026-02-17 Manqing Liu , David Williams-King , Ida Caspary , Linh Le , Hannes Whittingham , Puria Radmard , Cameron Tice , Edward James Young

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

Computation and Language · Computer Science 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

We present Chain-of-Action (CoA), a novel visuo-motor policy paradigm built upon Trajectory Autoregressive Modeling. Unlike conventional approaches that predict next step action(s) forward, CoA generates an entire trajectory by explicit…

Robotics · Computer Science 2026-01-07 Wenbo Zhang , Tianrun Hu , Hanbo Zhang , Yanyuan Qiao , Yuchu Qin , Yang Li , Jiajun Liu , Tao Kong , Lingqiao Liu , Xiao Ma

In this work, we examine how targeted perturbations in the activation space of Language Models (LMs) can encode complex reasoning patterns. We inject steering vectors, derived from LM activations, into LMs during inference time and study…

Computation and Language · Computer Science 2025-03-24 Jason Zhang , Scott Viteri

Chain of Thought (CoT) prompting can encourage language models to engage in multi-step logical reasoning. The quality of the provided demonstrations significantly influences the success of downstream inference tasks. Current unsupervised…

Computation and Language · Computer Science 2025-05-27 Yufeng Zhang , Xuepeng Wang , Lingxiang Wu , Jinqiao Wang

Vision-Language Models (VLMs), such as CLIP, have achieved impressive zero-shot recognition performance but remain highly susceptible to adversarial perturbations, posing significant risks in safety-critical scenarios. Previous…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhiwei Li , Yitian Pang , Weining Wang , Zhenan Sun , Qi Li

Recent advances in Chain-of-Thought (CoT) prompting have substantially improved the reasoning capabilities of large language models (LLMs), but have also introduced their computational efficiency as a new attack surface. In this paper, we…

Cryptography and Security · Computer Science 2025-11-17 Shuaitong Liu , Renjue Li , Lijia Yu , Lijun Zhang , Zhiming Liu , Gaojie Jin

In this work, we propose BAIT (Boundary-Aware Iterative Trap), a three-step jailbreak framework that approaches malicious goals through internal disclosure. BAIT first asks the model to identify the protection boundary, then requires it to…

Cryptography and Security · Computer Science 2026-05-27 Xuan Luo , Yue Wang , Geng Tu , Jing Li , Ruifeng Xu

Mitigating reward hacking--where AI systems misbehave due to flaws or misspecifications in their learning objectives--remains a key challenge in constructing capable and aligned models. We show that we can monitor a frontier reasoning…

Artificial Intelligence · Computer Science 2025-03-18 Bowen Baker , Joost Huizinga , Leo Gao , Zehao Dou , Melody Y. Guan , Aleksander Madry , Wojciech Zaremba , Jakub Pachocki , David Farhi

Vision-Language-Action (VLA) models demonstrate significant potential for developing generalized policies in real-world robotic control. This progress inspires researchers to explore fine-tuning these models with Reinforcement Learning…

Robotics · Computer Science 2025-08-05 Dongchi Huang , Zhirui Fang , Tianle Zhang , Yihang Li , Lin Zhao , Chunhe Xia

Large Language Models (LLMs) are increasingly vulnerable to adversarial attacks that can subtly manipulate their outputs. While various defense mechanisms have been proposed, many operate as black boxes, lacking transparency in their…

Cryptography and Security · Computer Science 2025-11-19 Shaowei Guan , Yu Zhai , Zhengyu Zhang , Yanze Wang , Hin Chi Kwok

While Vision-Language-Action (VLA) models offer broad general capabilities, deploying them on specific hardware requires real-world adaptation to bridge the embodiment gap. Since robot demonstrations are costly, this adaptation must often…

Robotics · Computer Science 2026-05-11 Yanzhe Chen , Kevin Yuchen Ma , Qi Lv , Yiqi Lin , Zechen Bai , Chen Gao , Mike Zheng Shou

Recent years have witnessed impressive advances in challenging multi-hop QA tasks. However, these QA models may fail when faced with some disturbance in the input text and their interpretability for conducting multi-hop reasoning remains…

Computation and Language · Computer Science 2021-12-20 Jiayu Ding , Siyuan Wang , Qin Chen , Zhongyu Wei

The misuse of large language models (LLMs), such as academic plagiarism, has driven the development of detectors to identify LLM-generated texts. To bypass these detectors, paraphrase attacks have emerged to purposely rewrite these texts to…

Computation and Language · Computer Science 2025-09-11 Hao Fang , Jiawei Kong , Tianqu Zhuang , Yixiang Qiu , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Yaowei Wang , Min Zhang

Chain-of-Thought (CoT) prompting significantly enhances model reasoning, yet its internal mechanisms remain poorly understood. We analyze CoT's operational principles by reversely tracing information flow across decoding, projection, and…

Artificial Intelligence · Computer Science 2026-05-27 Hao Yang , Qinghua Zhao , Lei Li , Lingyi Meng , Mengda Yu

Generating high-quality textual adversarial examples is critical for investigating the pitfalls of natural language processing (NLP) models and further promoting their robustness. Existing attacks are usually realized through word-level or…

Computation and Language · Computer Science 2022-05-25 Yibin Lei , Yu Cao , Dianqi Li , Tianyi Zhou , Meng Fang , Mykola Pechenizkiy

Vision-Language-Action (VLA) models have rapidly advanced embodied intelligence, enabling robots to execute complex, instruction-driven tasks. However, as model capacity and visual context length grow, the inference cost of VLA systems…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jintao Cheng , Haozhe Wang , Weibin Li , Gang Wang , Yipu Zhang , Xiaoyu Tang , Jin Wu , Xieyuanli Chen , Yunhui Liu , Wei Zhang

Explanations are often promoted as tools for transparency, but they can also foster confirmation bias; users may assume reasoning is correct whenever outputs appear acceptable. We study this double-edged role of Chain-of-Thought (CoT)…

Computation and Language · Computer Science 2025-11-20 Eunkyu Park , Wesley Hanwen Deng , Vasudha Varadarajan , Mingxi Yan , Gunhee Kim , Maarten Sap , Motahhare Eslami