English
Related papers

Related papers: Semantic Shield: Defending Vision-Language Models …

200 papers

In the era of increasing concerns over cybersecurity threats, defending against backdoor attacks is paramount in ensuring the integrity and reliability of machine learning models. However, many existing approaches require substantial…

Machine Learning · Computer Science 2024-05-08 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

Deep learning models have consistently outperformed traditional machine learning models in various classification tasks, including image classification. As such, they have become increasingly prevalent in many real world applications…

Cryptography and Security · Computer Science 2018-08-31 Cong Liao , Haoti Zhong , Anna Squicciarini , Sencun Zhu , David Miller

Large visual language models (LVLMs) have demonstrated excellent instruction-following capabilities, yet remain vulnerable to stealthy backdoor attacks when finetuned using contaminated data. Existing backdoor defense techniques are usually…

Cryptography and Security · Computer Science 2025-06-09 Yuan Xun , Siyuan Liang , Xiaojun Jia , Xinwei Liu , Xiaochun Cao

Recent studies have shown that deep neural networks (DNNs) are vulnerable to backdoor attacks, where a designed trigger is injected into the dataset, causing erroneous predictions when activated. In this paper, we propose a novel defense…

Machine Learning · Computer Science 2025-08-08 Wenjie Huo , Katinka Wolter

Federated learning enables thousands of participants to construct a deep learning model without sharing their private training data with each other. For example, multiple smartphones can jointly train a next-word predictor for keyboards…

Cryptography and Security · Computer Science 2019-08-07 Eugene Bagdasaryan , Andreas Veit , Yiqing Hua , Deborah Estrin , Vitaly Shmatikov

Multimodal contrastive learning has emerged as a powerful paradigm for building high-quality features using the complementary strengths of various data modalities. However, the open nature of such systems inadvertently increases the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Siyuan Liang , Kuanrong Liu , Jiajun Gong , Jiawei Liang , Yuan Xun , Ee-Chien Chang , Xiaochun Cao

Neural networks are widely known to be vulnerable to backdoor attacks, a method that poisons a portion of the training data to make the target model perform well on normal data sets, while outputting attacker-specified or random categories…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yong Li , Han Gao

The emergence of Vision-Language Models (VLMs) represents a significant advancement in integrating computer vision with Large Language Models (LLMs) to generate detailed text descriptions from visual inputs. Despite their growing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Weimin Lyu , Jiachen Yao , Saumya Gupta , Lu Pang , Tao Sun , Lingjie Yi , Lijie Hu , Haibin Ling , Chao Chen

Split Learning (SL) offers a framework for collaborative model training that respects data privacy by allowing participants to share the same dataset while maintaining distinct feature sets. However, SL is susceptible to backdoor attacks,…

Cryptography and Security · Computer Science 2026-01-27 Zhihao Dou , Dongfei Cui , Weida Wang , Anjun Gao , Yueyang Quan , Mengyao Ma , Viet Vo , Guangdong Bai , Zhuqing Liu , Minghong Fang

Modern language models remain vulnerable to backdoor attacks via poisoned data, where training inputs containing a trigger are paired with a target output, causing the model to reproduce that behavior whenever the trigger appears at…

Cryptography and Security · Computer Science 2026-01-06 Eric Xue , Ruiyi Zhang , Pengtao Xie

Large language models (LLMs) have seen significant advancements, achieving superior performance in various Natural Language Processing (NLP) tasks, from understanding to reasoning. However, they remain vulnerable to backdoor attacks, where…

Computation and Language · Computer Science 2024-11-28 Chen Chen , Yuchen Sun , Xueluan Gong , Jiaxin Gao , Kwok-Yan Lam

Federated learning is a versatile framework for training models in decentralized environments. However, the trust placed in clients makes federated learning vulnerable to backdoor attacks launched by malicious participants. While many…

Cryptography and Security · Computer Science 2024-12-23 Borja Molina-Coronado

Backdoor attacks create significant security threats to language models by embedding hidden triggers that manipulate model behavior during inference, presenting critical risks for AI systems deployed in healthcare and other sensitive…

Cryptography and Security · Computer Science 2026-04-30 Mohamed Afane , Abhishek Satyam , Ke Chen , Tao Li , Junaid Farooq , Juntao Chen

Textual backdoor attacks present a substantial security risk to Large Language Models (LLM). It embeds carefully chosen triggers into a victim model at the training stage, and makes the model erroneously predict inputs containing the same…

Computation and Language · Computer Science 2024-07-08 Xinglin Li , Xianwen He , Yao Li , Minhao Cheng

Text-to-image diffusion models have revolutionized generative AI, but their vulnerability to backdoor attacks poses significant security risks. Adversaries can inject imperceptible textual triggers into training data, causing models to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ashwath Vaithinathan Aravindan , Abha Jha , Matthew Salaway , Atharva Sandeep Bhide , Duygu Nur Yaldiz

Backdoor attack is a severe threat to the trustworthiness of DNN-based language models. In this paper, we first extend the definition of memorization of language models from sample-wise to more fine-grained sentence element-wise (e.g.,…

Computation and Language · Computer Science 2024-09-24 Zhenting Wang , Zhizhi Wang , Mingyu Jin , Mengnan Du , Juan Zhai , Shiqing Ma

Data-poisoning backdoor attacks are serious security threats to machine learning models, where an adversary can manipulate the training dataset to inject backdoors into models. In this paper, we focus on in-training backdoor defense, aiming…

Cryptography and Security · Computer Science 2024-10-16 Shaokui Wei , Hongyuan Zha , Baoyuan Wu

Deep Neural Networks (DNNs) are known to be vulnerable to backdoor attacks. In Natural Language Processing (NLP), DNNs are often backdoored during the fine-tuning process of a large-scale Pre-trained Language Model (PLM) with poisoned…

Computation and Language · Computer Science 2022-10-19 Zhiyuan Zhang , Lingjuan Lyu , Xingjun Ma , Chenguang Wang , Xu Sun

Deep learning models are susceptible to {\em backdoor attacks} involving malicious attackers perturbing a small subset of training data with a {\em trigger} to causes misclassifications. Various triggers have been used, including semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Venkat Adithya Amula , Sunayana Samavedam , Saurabh Saini , Avani Gupta , Narayanan P J

Vision-Language Models (VLMs) have achieved impressive progress in multimodal text generation, yet their rapid adoption raises increasing concerns about security vulnerabilities. Existing backdoor attacks against VLMs primarily rely on…

Cryptography and Security · Computer Science 2025-12-08 Haoyu Shen , Weimin Lyu , Haotian Xu , Tengfei Ma