中文
相关论文

相关论文: Dual-Key Multimodal Backdoors for Visual Question …

200 篇论文

While machine learning (ML) models are being increasingly trusted to make decisions in different and varying areas, the safety of systems using such models has become an increasing concern. In particular, ML models are often trained on data…

Large language models (LLMs) have acquired the ability to handle longer context lengths and understand nuances in text, expanding their dialogue capabilities beyond a single utterance. A popular user-facing application of LLMs is the…

计算与语言 · 计算机科学 2024-10-29 Terry Tong , Jiashu Xu , Qin Liu , Muhao Chen

Non-Intrusive speech quality assessment (NISQA) has gained significant attention for predicting speech's mean opinion score (MOS) without requiring the reference speech. Researchers have gradually started to apply NISQA to various practical…

声音 · 计算机科学 2024-09-12 Ying Ren , Kailai Shen , Zhe Ye , Diqun Yan

Because state-of-the-art language models are expensive to train, most practitioners must make use of one of the few publicly available language models or language model APIs. This consolidation of trust increases the potency of backdoor…

密码学与安全 · 计算机科学 2023-07-28 Nikhil Kandpal , Matthew Jagielski , Florian Tramèr , Nicholas Carlini

In this work, we show how to jointly exploit adversarial perturbation and model poisoning vulnerabilities to practically launch a new stealthy attack, dubbed AdvTrojan. AdvTrojan is stealthy because it can be activated only when: 1) a…

密码学与安全 · 计算机科学 2021-09-06 Guanxiong Liu , Issa Khalil , Abdallah Khreishah , NhatHai Phan

We present a Trojan (backdoor or trapdoor) attack that targets deep learning applications in wireless communications. A deep learning classifier is considered to classify wireless signals using raw (I/Q) samples as features and modulation…

网络与互联网体系结构 · 计算机科学 2019-10-25 Kemal Davaslioglu , Yalin E. Sagduyu

Backdoor attacks have severely threatened deep neural network (DNN) models in the past several years. These attacks can occur in almost every stage of the deep learning pipeline. Although the attacked model behaves normally on benign…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Yangming Chen

Backdoor attacks pose a serious threat to deep learning models by allowing adversaries to implant hidden behaviors that remain dormant on clean inputs but are maliciously triggered at inference. Existing backdoor attack methods typically…

密码学与安全 · 计算机科学 2025-11-18 Lijie Hu , Junchi Liao , Weimin Lyu , Shaopeng Fu , Tianhao Huang , Shu Yang , Guimin Hu , Di Wang

Recent studies revealed that deep neural networks (DNNs) are exposed to backdoor threats when training with third-party resources (such as training samples or backbones). The backdoored model has promising performance in predicting benign…

计算机视觉与模式识别 · 计算机科学 2023-03-07 Chengxiao Luo , Yiming Li , Yong Jiang , Shu-Tao Xia

The success of deep neural networks (DNNs) in real-world applications has benefited from abundant pre-trained models. However, the backdoored pre-trained models can pose a significant trojan threat to the deployment of downstream DNNs.…

密码学与安全 · 计算机科学 2024-07-18 Haibo Jin , Ruoxi Chen , Jinyin Chen , Haibin Zheng , Yang Zhang , Haohan Wang

Large vision-language models (LVLMs) have achieved impressive performance across a wide range of vision-language tasks, while they remain vulnerable to backdoor attacks. Existing backdoor attacks on LVLMs aim to force the victim model to…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Zhifang Zhang , Qiqi Tao , Jiaqi Lv , Na Zhao , Lei Feng , Joey Tianyi Zhou

Backdoor (Trojan) attacks are an important type of adversarial exploit against deep neural networks (DNNs), wherein a test instance is (mis)classified to the attacker's target class whenever the attacker's backdoor trigger is present. In…

机器学习 · 计算机科学 2023-08-22 Xi Li , Zhen Xiang , David J. Miller , George Kesidis

Self-supervised and multimodal vision encoders learn strong visual representations that are widely adopted in downstream vision tasks and large vision-language models (LVLMs). However, downstream users often rely on third-party pretrained…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Siquan Huang , Yijiang Li , Ningzhi Gao , Xingfu Yan , Leyu Shi , Ying Gao

Backdoor attacks pose a critical threat by embedding hidden triggers into inputs, causing models to misclassify them into target labels. While extensive research has focused on mitigating these attacks in object recognition models through…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Kyle Stein , Andrew Arash Mahyari , Guillermo Francia , Eman El-Sheikh

Mobile agents powered by vision-language models (VLMs) are increasingly adopted for tasks such as UI automation and camera-based assistance. These agents are typically fine-tuned using small-scale, user-collected data, making them…

密码学与安全 · 计算机科学 2025-09-08 Xuan Wang , Siyuan Liang , Zhe Liu , Yi Yu , Aishan Liu , Yuliang Lu , Xitong Gao , Ee-Chien Chang

Unified autoregressive models (UAMs) are transformer models that generate text as well as image tokens within a single autoregressive pass. Shared parameters and a multimodal vocabulary simplify the training pipeline and facilitate flexible…

密码学与安全 · 计算机科学 2026-05-20 Tobias Braun , Jonas Henry Grebe , Hossein Shakibania , Anna Rohrbach , Marcus Rohrbach

In recent years there has been enormous interest in vision-language models trained using self-supervised objectives. However, the use of large-scale datasets scraped from the web for training also makes these models vulnerable to potential…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Alvi Md Ishmam , Christopher Thomas

With the widespread application of deep learning across various domains, concerns about its security have grown significantly. Among these, backdoor attacks pose a serious security threat to deep neural networks (DNNs). In recent years,…

密码学与安全 · 计算机科学 2024-03-21 Wenmin Chen , Xiaowei Xu

Recent work has demonstrated robust mechanisms by which attacks can be orchestrated on machine learning models. In contrast to adversarial examples, backdoor or trojan attacks embed surgically modified samples with targeted labels in the…

密码学与安全 · 计算机科学 2019-03-19 Zhaoyuan Yang , Naresh Iyer , Johan Reimann , Nurali Virani

Backdoor attack intends to inject hidden backdoor into the deep neural networks (DNNs), such that the prediction of infected models will be maliciously changed if the hidden backdoor is activated by the attacker-defined trigger. Currently,…

密码学与安全 · 计算机科学 2021-04-27 Yiming Li , Tongqing Zhai , Yong Jiang , Zhifeng Li , Shu-Tao Xia