English
Related papers

Related papers: BadCM: Invisible Backdoor Attack Against Cross-Mod…

200 papers

Pre-trained language models have achieved remarkable success across a wide range of natural language processing (NLP) tasks, particularly when fine-tuned on large, domain-relevant datasets. However, they remain vulnerable to backdoor…

Computation and Language · Computer Science 2026-02-02 Anindya Sundar Das , Kangjie Chen , Monowar Bhuyan

The backdoor attack poses a new security threat to deep neural networks. Existing backdoor often relies on visible universal trigger to make the backdoored model malfunction, which are not only usually visually suspicious to human but also…

Cryptography and Security · Computer Science 2024-12-24 Xiangqi Wang , Mingfu Xue , Kewei Chen , Jing Xu , Wenmao Liu , Leo Yu Zhang , Yushu Zhang

Under a commonly-studied backdoor poisoning attack against classification models, an attacker adds a small trigger to a subset of the training data, such that the presence of this trigger at test time causes the classifier to always predict…

Machine Learning · Computer Science 2021-10-06 Mingjie Sun , Siddhant Agarwal , J. Zico Kolter

With the availability of diverse sensor modalities (i.e., RGB, Depth, Infrared) and the success of multi-modal learning, multi-modal face anti-spoofing (FAS) has emerged as a prominent research focus. The intuition behind it is that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Jingyi Yang , Xun Lin , Zitong Yu , Liepiao Zhang , Xin Liu , Hui Li , Xiaochen Yuan , Xiaochun Cao

Image anomaly detection (IAD) is essential in applications such as industrial inspection, medical imaging, and security. Despite the progress achieved with deep learning models like Deep Semi-Supervised Anomaly Detection (DeepSAD), these…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 He Cheng , Depeng Xu , Shuhan Yuan

Backdoor attacks in reinforcement learning (RL) have previously employed intense attack strategies to ensure attack success. However, these methods suffer from high attack costs and increased detectability. In this work, we propose a novel…

Machine Learning · Computer Science 2023-12-21 Jing Cui , Yufei Han , Yuzhe Ma , Jianbin Jiao , Junge Zhang

Multimodal learning often outperforms its unimodal counterparts by exploiting unimodal contributions and cross-modal interactions. However, focusing only on integrating multimodal features into a unified comprehensive representation…

Machine Learning · Computer Science 2025-05-15 Sehwan Moon , Hyunju Lee

Graph Foundation Models (GFMs) are pre-trained on diverse source domains and adapted to unseen targets, enabling broad generalization for graph machine learning. Despite that GFMs have attracted considerable attention recently, their…

Cryptography and Security · Computer Science 2025-11-25 Jiayi Luo , Qingyun Sun , Lingjuan Lyu , Ziwei Zhang , Haonan Yuan , Xingcheng Fu , Jianxin Li

Deep learning models achieve excellent performance in numerous machine learning tasks. Yet, they suffer from security-related issues such as adversarial examples and poisoning (backdoor) attacks. A deep learning model may be poisoned by…

Machine Learning · Computer Science 2023-08-25 Xiaoyun Xu , Oguzhan Ersoy , Stjepan Picek

Understanding dark scenes based on multi-modal image data is challenging, as both the visible and auxiliary modalities provide limited semantic information for the task. Previous methods focus on fusing the two modalities but neglect the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Xiaoyu Dong , Naoto Yokoya

This paper investigates the challenging task of detecting backdoored text-to-image models under black-box settings and introduces a novel detection framework BlackMirror. Existing approaches typically rely on analyzing image-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Feiran Li , Qianqian Xu , Shilong Bao , Zhiyong Yang , Xilin Zhao , Xiaochun Cao , Qingming Huang

In this brief, we show that sequentially learning new information presented to a continual (incremental) learning model introduces new security risks: an intelligent adversary can introduce small amount of misinformation to the model during…

Machine Learning · Computer Science 2022-02-10 Muhammad Umer , Robi Polikar

With the exponential surge in diverse multi-modal data, traditional uni-modal retrieval methods struggle to meet the needs of users seeking access to data across various modalities. To address this, cross-modal retrieval has emerged,…

Information Retrieval · Computer Science 2024-10-01 Tianshi Wang , Fengling Li , Lei Zhu , Jingjing Li , Zheng Zhang , Heng Tao Shen

Backdoor attack introduces artificial vulnerabilities into the model by poisoning a subset of the training data via injecting triggers and modifying labels. Various trigger design strategies have been explored to attack text classifiers,…

Computation and Language · Computer Science 2021-09-23 Zichao Li , Dheeraj Mekala , Chengyu Dong , Jingbo Shang

Medical Visual Question Answering (MedVQA) aims to generate clinically reliable answers conditioned on complex medical images and questions. However, existing methods often overfit to superficial cross-modal correlations, neglecting the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Zibo Xu , Qiang Li , Ke Lu , Jin Wang , Weizhi Nie , Yuting Su

Machine learning is vulnerable to adversarial manipulation. Previous literature has demonstrated that at the training stage attackers can manipulate data and data sampling procedures to control model behaviour. A common attack goal is to…

Machine Learning · Computer Science 2022-06-17 Mikel Bober-Irizar , Ilia Shumailov , Yiren Zhao , Robert Mullins , Nicolas Papernot

All current backdoor attacks on deep learning (DL) models fall under the category of a vertical class backdoor (VCB) -- class-dependent. In VCB attacks, any sample from a class activates the implanted backdoor when the secret trigger is…

Cryptography and Security · Computer Science 2024-06-19 Hua Ma , Shang Wang , Yansong Gao , Zhi Zhang , Huming Qiu , Minhui Xue , Alsharif Abuadbba , Anmin Fu , Surya Nepal , Derek Abbott

Large language models (LLMs) are shown to benefit from chain-of-thought (COT) prompting, particularly when tackling tasks that require systematic reasoning processes. On the other hand, COT prompting also poses new vulnerabilities in the…

Cryptography and Security · Computer Science 2024-01-24 Zhen Xiang , Fengqing Jiang , Zidi Xiong , Bhaskar Ramasubramanian , Radha Poovendran , Bo Li

With the widespread application of deep learning across various domains, concerns about its security have grown significantly. Among these, backdoor attacks pose a serious security threat to deep neural networks (DNNs). In recent years,…

Cryptography and Security · Computer Science 2024-03-21 Wenmin Chen , Xiaowei Xu

The newly introduced Visual State Space Model (VMamba), which employs \textit{State Space Mechanisms} (SSM) to interpret images as sequences of patches, has shown exceptional performance compared to Vision Transformers (ViT) across various…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Om Suhas Deshmukh , Sankalp Nagaonkar , Achyut Mani Tripathi , Ashish Mishra