English
Related papers

Related papers: BadCM: Invisible Backdoor Attack Against Cross-Mod…

200 papers

Research on backdoor attacks against multimodal contrastive learning models faces two key challenges: stealthiness and persistence. Existing methods often fail under strong detection or continuous fine-tuning, largely due to (1) cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Siyuan Liang , Yongcheng Jing , Yingjie Wang , Jiaxing Huang , Ee-chien Chang , Dacheng Tao

Vision Language Models (VLMs) have shown remarkable performance, but are also vulnerable to backdoor attacks whereby the adversary can manipulate the model's outputs through hidden triggers. Prior attacks primarily rely on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zhiyuan Zhong , Zhen Sun , Yepang Liu , Xinlei He , Guanhong Tao

Contrastive Vision-Language Pre-training, known as CLIP, has shown promising effectiveness in addressing downstream image recognition tasks. However, recent works revealed that the CLIP model can be implanted with a downstream-oriented…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Jiawang Bai , Kuofeng Gao , Shaobo Min , Shu-Tao Xia , Zhifeng Li , Wei Liu

Developers increasingly construct multimodal large language models (MLLMs) by assembling pretrained components,introducing supply-chain attack surfaces.Existing security research primarily focuses on poisoning backbones such as encoders or…

Cryptography and Security · Computer Science 2026-05-11 Runhe Wang , Li Bai , Haibo Hu , Songze Li

Backdoor attacks undermine the reliability and trustworthiness of machine learning systems by injecting hidden behaviors that can be maliciously activated at inference time. While such threats have been extensively studied in unimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Juncheng Li , Yige Li , Hanxun Huang , Yunhao Chen , Xin Wang , Yixu Wang , Xingjun Ma , Yu-Gang Jiang

Studying backdoor attacks is valuable for model copyright protection and enhancing defenses. While existing backdoor attacks have successfully infected multimodal contrastive learning models such as CLIP, they can be easily countered by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Siyuan Liang , Mingli Zhu , Aishan Liu , Baoyuan Wu , Xiaochun Cao , Ee-Chien Chang

Over the past few years, the emergence of backdoor attacks has presented significant challenges to deep learning systems, allowing attackers to insert backdoors into neural networks. When data with a trigger is processed by a backdoor…

Cryptography and Security · Computer Science 2025-03-07 Haiyang Yu , Tian Xie , Jiaping Gui , Pengyang Wang , Ping Yi , Yue Wu

Diffusion language models (DLMs) have recently emerged as an alternative modeling paradigm to autoregressive (AR) language models, enabling parallel generation and bidirectional context modeling. Yet their security implications,…

Cryptography and Security · Computer Science 2026-05-12 Shengfang Zhai , Xiaoyang Ji , Yuling Shi , Haoran Gao , Fanyu Meng , Yan Zeng , Yuejian Fang , Yinpeng Dong , Jiaheng Zhang

With the development of deep learning (DL), DL-based code search models have achieved state-of-the-art performance and have been widely used by developers during software development. However, the security issue, e.g., recommending…

Software Engineering · Computer Science 2023-05-10 Shiyi Qi , Yuanhang Yang , Shuzhzeng Gao , Cuiyun Gao , Zenglin Xu

Multi-modal large language models (MLLMs) extend large language models (LLMs) to process multi-modal information, enabling them to generate responses to image-text inputs. MLLMs have been incorporated into diverse multi-modal applications,…

Cryptography and Security · Computer Science 2025-03-21 Zenghui Yuan , Jiawen Shi , Pan Zhou , Neil Zhenqiang Gong , Lichao Sun

Multimodal contrastive learning has emerged as a powerful paradigm for building high-quality features using the complementary strengths of various data modalities. However, the open nature of such systems inadvertently increases the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Siyuan Liang , Kuanrong Liu , Jiajun Gong , Jiawei Liang , Yuan Xun , Ee-Chien Chang , Xiaochun Cao

Fine-tuning pre-trained models for downstream tasks has led to a proliferation of open-sourced task-specific models. Recently, Model Merging (MM) has emerged as an effective approach to facilitate knowledge transfer among these…

Cryptography and Security · Computer Science 2024-09-04 Jinghuai Zhang , Jianfeng Chi , Zheng Li , Kunlin Cai , Yang Zhang , Yuan Tian

Neural code models (NCMs) have been widely used to address various code understanding tasks, such as defect detection. However, numerous recent studies reveal that such models are vulnerable to backdoor attacks. Backdoored NCMs function…

Cryptography and Security · Computer Science 2025-02-21 Weisong Sun , Yuchen Chen , Chunrong Fang , Yebo Feng , Yuan Xiao , An Guo , Quanjun Zhang , Yang Liu , Baowen Xu , Zhenyu Chen

In recent years, deep learning-based Monocular Depth Estimation (MDE) models have been widely applied in fields such as autonomous driving and robotics. However, their vulnerability to backdoor attacks remains unexplored. To fill the gap in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Ji Guo , Long Zhou , Zhijin Wang , Jiaming He , Qiyang Song , Aiguo Chen , Wenbo Jiang

Contrastive learning has become a leading self- supervised approach to representation learning across domains, including vision, multimodal settings, graphs, and federated learning. However, recent studies have shown that contrastive…

Machine Learning · Computer Science 2026-01-19 Simi D Kuniyilh , Rita Machacy

Self-supervised learning in computer vision aims to pre-train an image encoder using a large amount of unlabeled images or (image, text) pairs. The pre-trained image encoder can then be used as a feature extractor to build downstream…

Cryptography and Security · Computer Science 2021-08-03 Jinyuan Jia , Yupei Liu , Neil Zhenqiang Gong

Deep learning models have consistently outperformed traditional machine learning models in various classification tasks, including image classification. As such, they have become increasingly prevalent in many real world applications…

Cryptography and Security · Computer Science 2018-08-31 Cong Liao , Haoti Zhong , Anna Squicciarini , Sencun Zhu , David Miller

Machine learning systems are vulnerable to backdoor attacks, where attackers manipulate model behavior through data tampering or architectural modifications. Traditional backdoor attacks involve injecting malicious samples with specific…

Cryptography and Security · Computer Science 2025-09-24 Yuan Ma , Jiankang Wei , Yilun Lyu , Kehao Chen , Jingtong Huang

Prompt-based tuning has emerged as a lightweight alternative to full fine-tuning in large vision-language models, enabling efficient adaptation via learned contextual prompts. This paradigm has recently been extended to federated learning…

Machine Learning · Computer Science 2025-09-09 Maozhen Zhang , Mengnan Zhao , Wei Wang , Bo Wang

The growing application of large language models (LLMs) in safety-critical domains has raised urgent concerns about their security. Many recent studies have demonstrated the feasibility of backdoor attacks against LLMs. However, existing…

Cryptography and Security · Computer Science 2026-04-24 Jiali Wei , Ming Fan , Guoheng Sun , Xicheng Zhang , Haijun Wang , Ting Liu
‹ Prev 1 2 3 10 Next ›