English
Related papers

Related papers: BEAT: Visual Backdoor Attacks on VLM-based Embodie…

200 papers

Autonomous vehicles rely on deep neural networks (DNNs) for traffic sign recognition, lane centering, and vehicle detection, yet these models are vulnerable to attacks that induce misclassification and threaten safety. Existing defenses…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Pedram MohajerAnsari , Amir Salarpour , Michael Kühr , Siyu Huang , Mohammad Hamad , Sebastian Steinhorst , Habeeb Olufowobi , Bing Li , Mert D. Pesé

Vision-Language Models (VLMs) have gained considerable prominence in recent years due to their remarkable capability to effectively integrate and process both textual and visual information. This integration has significantly enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Aobotao Dai , Xinyu Ma , Lei Chen , Songze Li , Lin Wang

Despite careful safety alignment, current large language models (LLMs) remain vulnerable to various attacks. To further unveil the safety risks of LLMs, we introduce a Safety Concept Activation Vector (SCAV) framework, which effectively…

Computation and Language · Computer Science 2024-12-03 Zhihao Xu , Ruixuan Huang , Changyu Chen , Xiting Wang

Self-supervised learning (SSL) vision encoders learn high-quality image representations and thus have become a vital part of developing vision modality of large vision language models (LVLMs). Due to the high cost of training such encoders,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Zhaoyi Liu , Huan Zhang

Multimodal contrastive learning models like CLIP have demonstrated remarkable vision-language alignment capabilities, yet their vulnerability to backdoor attacks poses critical security risks. Attackers can implant latent triggers that…

Cryptography and Security · Computer Science 2025-06-17 Mengyuan Sun , Yu Li , Yuchen Liu , Bo Du , Yunjie Ge

Open-vocabulary object detectors (OVODs) unify vision and language to detect arbitrary object categories based on text prompts, enabling strong zero-shot generalization to novel concepts. As these models gain traction in high-stakes…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Ankita Raj , Chetan Arora

Deep learning models have been deployed in numerous real-world applications such as autonomous driving and surveillance. However, these models are vulnerable in adversarial environments. Backdoor attack is emerging as a severe security…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Shih-Han Chan , Yinpeng Dong , Jun Zhu , Xiaolu Zhang , Jun Zhou

Recent deep-learning-based compression methods have achieved superior performance compared with traditional approaches. However, deep learning models have proven to be vulnerable to backdoor attacks, where some specific trigger patterns…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Yi Yu , Yufei Wang , Wenhan Yang , Shijian Lu , Yap-peng Tan , Alex C. Kot

Vision Transformers (ViTs) have achieved remarkable success across vision tasks, yet recent studies show they remain vulnerable to backdoor attacks. Existing patch-wise attacks typically assume a single fixed trigger location during…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Dazhuang Liu , Yanqi Qiao , Rui Wang , Kaitai Liang , Georgios Smaragdakis

Recent advances in vision-language-action (VLA) models have greatly improved embodied AI, enabling robots to follow natural language instructions and perform diverse tasks. However, their reliance on uncurated training datasets raises…

Cryptography and Security · Computer Science 2025-10-13 Zirun Zhou , Zhengyang Xiao , Haochuan Xu , Jing Sun , Di Wang , Jingfeng Zhang

A backdoor attack in deep learning inserts a hidden backdoor in the model to trigger malicious behavior upon specific input patterns. Existing detection approaches assume a metric space (for either the original inputs or their latent…

Cryptography and Security · Computer Science 2023-12-06 Xiaoxing Mo , Yechao Zhang , Leo Yu Zhang , Wei Luo , Nan Sun , Shengshan Hu , Shang Gao , Yang Xiang

Backdoor attacks on reinforcement learning implant a backdoor in a victim agent's policy. Once the victim observes the trigger signal, it will switch to the abnormal mode and fail its task. Most of the attacks assume the adversary can…

Multiagent Systems · Computer Science 2022-11-22 Shuo Chen , Yue Qiu , Jie Zhang

The Internet of Things (IoT) systems increasingly depend on continual learning to adapt to non-stationary environments. These environments can include factors such as sensor drift, changing user behavior, device aging, and adversarial…

Machine Learning · Computer Science 2026-02-16 Alfous Tim , Kuniyilh Simi D

Recent advances in vision-language models (VLMs) have shown promise for human-level embodied intelligence. However, existing benchmarks for VLM-driven embodied agents often rely on high-level commands or discretized action spaces, which are…

Artificial Intelligence · Computer Science 2026-02-25 Bo Peng , Pi Bu , Keyu Pan , Xinrun Xu , Yinxiu Zhao , Miao Chen , Yang Du , Lin Li , Jun Song , Tong Xu

Downstream fine-tuning of vision-language-action (VLA) models enhances robotics, yet exposes the pipeline to backdoor risks. Attackers can pretrain VLAs on poisoned data to implant backdoors that remain stealthy but can trigger harmful…

Vision-language model (VLM) fine-tuning for application-specific visual grounding based on natural language instructions has become one of the most popular approaches for learning-enabled autonomous systems. However, such fine-tuning relies…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Joshua R. Waite , Md. Zahid Hasan , Qisai Liu , Zhanhong Jiang , Chinmay Hegde , Soumik Sarkar

Robotic manipulation policies are increasingly empowered by \textit{large language models} (LLMs) and \textit{vision-language models} (VLMs), leveraging their understanding and perception capabilities. Recently, inference-time attacks…

With the prosperity of large language models (LLMs), powerful LLM-based intelligent agents have been developed to provide customized services with a set of user-defined tools. State-of-the-art methods for constructing LLM agents adopt…

Computation and Language · Computer Science 2024-06-06 Yifei Wang , Dizhan Xue , Shengjie Zhang , Shengsheng Qian

As LLM-based agents become increasingly prevalent, backdoors can be implanted into agents through user queries or environment feedback, raising critical concerns regarding safety vulnerabilities. However, backdoor attacks are typically…

Cryptography and Security · Computer Science 2025-10-14 Pengyu Zhu , Zhenhong Zhou , Yuanhe Zhang , Shilinlu Yan , Kun Wang , Sen Su

Vision-Language-Action (VLA) models enable robots to interpret natural-language instructions and perform diverse tasks, yet their integration of perception, language, and control introduces new safety vulnerabilities. Despite growing…

Cryptography and Security · Computer Science 2025-11-18 Jiayu Li , Yunhan Zhao , Xiang Zheng , Zonghuan Xu , Yige Li , Xingjun Ma , Yu-Gang Jiang
‹ Prev 1 8 9 10 Next ›