English
Related papers

Related papers: Follow My Eyes: Backdoor Attacks on VLM-based Scan…

200 papers

We propose the zero-shot Vision-and-Language Navigation with Collision Mitigation (VLN-CM), which takes these considerations. VLN-CM is composed of four modules and predicts the direction and distance of the next movement at each step. We…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Seongjun Jeong , Gi-Cheon Kang , Joochan Kim , Byoung-Tak Zhang

Data-driven saliency has recently gained a lot of attention thanks to the use of Convolutional Neural Networks for predicting gaze fixations. In this paper we go beyond standard approaches to saliency prediction, in which gaze maps are…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

While eye tracking provides valuable capabilities for virtual reality, such as gaze interaction and dynamic foveated rendering (DFR), eye-tracking data can inadvertently reveal sensitive user information if not properly protected. Current…

Human-Computer Interaction · Computer Science 2026-05-28 Paul Maynard , Harris Amjad , Camila Molinares , Bo Ji , Brendan David-John

Backdoor attacks embed hidden associations between triggers and targets in deep neural networks (DNNs), causing them to predict the target when a trigger is present while maintaining normal behavior otherwise. Physical backdoor attacks,…

Cryptography and Security · Computer Science 2024-12-06 Yongjie Xu , Guangke Chen , Fu Song , Yuqi Chen

Vision-Language-Action (VLA) models enable robots to interpret natural-language instructions and perform diverse tasks, yet their integration of perception, language, and control introduces new safety vulnerabilities. Despite growing…

Cryptography and Security · Computer Science 2025-11-18 Jiayu Li , Yunhan Zhao , Xiang Zheng , Zonghuan Xu , Yige Li , Xingjun Ma , Yu-Gang Jiang

Global Navigation Satellite System (GNSS) provides Positioning, Navigation, and Timing (PNT) services for autonomous vehicles (AVs) using satellites and radio communications. Due to the lack of encryption, open-access of the coarse…

Robotics · Computer Science 2022-03-10 Sagar Dasgupta , Mizanur Rahman , Mhafuzul Islam , Mashrur Chowdhury

Despite remarkable successes in unimodal learning tasks, backdoor attacks against cross-modal learning are still underexplored due to the limited generalization and inferior stealthiness when involving multiple modalities. Notably, since…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Zheng Zhang , Xu Yuan , Lei Zhu , Jingkuan Song , Liqiang Nie

Backdoors can be injected into NLP models to induce misbehavior when the input text contains a specific feature, known as a trigger, which the attacker secretly selects. Unlike fixed words, phrases, or sentences used in the static text…

Cryptography and Security · Computer Science 2024-09-12 Rui Zeng , Xi Chen , Yuwen Pu , Xuhong Zhang , Tianyu Du , Shouling Ji

Visual object tracking (VOT) has been widely adopted in mission-critical applications, such as autonomous driving and intelligent surveillance systems. In current practice, third-party resources such as datasets, backbone networks, and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Yiming Li , Haoxiang Zhong , Xingjun Ma , Yong Jiang , Shu-Tao Xia

Interpretable driver attention prediction is crucial for human-like autonomous driving. However, existing datasets provide only scene-level global gaze rather than fine-grained object-level annotations, inherently failing to support…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Zehong Ke , Yanbo Jiang , Jinhao Li , Zhiyuan Liu , Yiqian Tu , Qingwen Meng , Heye Huang , Jianqiang Wang

Self-supervised learning (SSL) vision encoders learn high-quality image representations and thus have become a vital part of developing vision modality of large vision language models (LVLMs). Due to the high cost of training such encoders,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Zhaoyi Liu , Huan Zhang

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the…

Cryptography and Security · Computer Science 2025-01-07 Shuai Zhao , Meihuizi Jia , Zhongliang Guo , Leilei Gan , Xiaoyu Xu , Xiaobao Wu , Jie Fu , Yichao Feng , Fengjun Pan , Luu Anh Tuan

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

Machine Learning · Computer Science 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani

Eye movements during reading offer insights into both the reader's cognitive processes and the characteristics of the text that is being read. Hence, the analysis of scanpaths in reading have attracted increasing attention across fields,…

Computation and Language · Computer Science 2023-05-19 Shuwen Deng , David R. Reich , Paul Prasse , Patrick Haller , Tobias Scheffer , Lena A. Jäger

Deep neural networks (DNNs) have shown unprecedented success in object detection tasks. However, it was also discovered that DNNs are vulnerable to multiple kinds of attacks, including Backdoor Attacks. Through the attack, the attacker…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yize Cheng , Wenbin Hu , Minhao Cheng

Large Vision-Language Models (LVLMs) can be vulnerable to adversarial images that subtly bias their outputs toward plausible yet incorrect responses. We introduce a general, efficient, and training-free defense that combines image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Nadav Kadvil , Malak Fares , Ayellet Tal

Vision-Language Models (VLMs) are increasingly used in clinical diagnostics, yet their robustness to adversarial attacks remains largely unexplored, posing serious risks. Existing medical attacks focus on secondary objectives such as model…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Akash Ghosh , Subhadip Baidya , Sriparna Saha , Xiuying Chen

Vision-language models (VLMs) have significantly advanced autonomous driving (AD) by enhancing reasoning capabilities. However, these models remain highly vulnerable to adversarial attacks. While existing research has primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Tianyuan Zhang , Lu Wang , Xinwei Zhang , Yitong Zhang , Boyi Jia , Siyuan Liang , Shengshan Hu , Qiang Fu , Aishan Liu , Xianglong Liu

Backdoor attacks pose a serious threat to deep learning models by allowing adversaries to implant hidden behaviors that remain dormant on clean inputs but are maliciously triggered at inference. Existing backdoor attack methods typically…

Cryptography and Security · Computer Science 2025-11-18 Lijie Hu , Junchi Liao , Weimin Lyu , Shaopeng Fu , Tianhao Huang , Shu Yang , Guimin Hu , Di Wang

Backdoor attacks represent a serious threat to neural network models. A backdoored model will misclassify the trigger-embedded inputs into an attacker-chosen target label while performing normally on other benign inputs. There are already…

Machine Learning · Computer Science 2021-07-14 Jing Xu , Minhui , Xue , Stjepan Picek