中文
相关论文

相关论文: Spinning Sequence-to-Sequence Models with Meta-Bac…

200 篇论文

Large language models (LLMs) have acquired the ability to handle longer context lengths and understand nuances in text, expanding their dialogue capabilities beyond a single utterance. A popular user-facing application of LLMs is the…

计算与语言 · 计算机科学 2024-10-29 Terry Tong , Jiashu Xu , Qin Liu , Muhao Chen

Recent studies have shown that deep neural networks (DNNs) are vulnerable to backdoor attacks, where a designed trigger is injected into the dataset, causing erroneous predictions when activated. In this paper, we propose a novel defense…

机器学习 · 计算机科学 2025-08-08 Wenjie Huo , Katinka Wolter

Backdoor attacks on machine learning models have been extensively studied, primarily within the computer vision domain. Originally, these attacks manipulated classifiers to generate incorrect outputs in the presence of specific, often…

机器学习 · 计算机科学 2025-03-25 Sharon Lin , Krishnamurthy , Dvijotham , Jamie Hayes , Chongyang Shi , Ilia Shumailov , Shuang Song

Training robust deep learning models for down-stream tasks is a critical challenge. Research has shown that down-stream models can be easily fooled with adversarial inputs that look like the training data, but slightly perturbed, in a way…

机器学习 · 计算机科学 2021-01-19 Mahmoud Hossam , Trung Le , He Zhao , Dinh Phung

In recent years, attention-based models have excelled across various domains but remain vulnerable to backdoor attacks, often from downloading or fine-tuning on poisoned datasets. Many current methods to mitigate backdoors in NLP models…

密码学与安全 · 计算机科学 2025-01-07 Yidong Ding , Jiafei Niu , Ping Yi

Deep learning has come a long way and has enjoyed an unprecedented success. Despite high accuracy, however, deep models are brittle and are easily fooled by imperceptible adversarial perturbations. In contrast to common inference-time…

计算机视觉与模式识别 · 计算机科学 2020-05-14 Ali Borji

The use of third-party datasets and pre-trained machine learning models poses a threat to NLP systems due to possibility of hidden backdoor attacks. Existing attacks involve poisoning the data samples such as insertion of tokens or sentence…

计算与语言 · 计算机科学 2024-04-09 Irina Alekseevskaia , Konstantin Arkhipenko

Deep neural networks (DNNs) have progressed rapidly during the past decade and have been deployed in various real-world applications. Meanwhile, DNN models have been shown to be vulnerable to security and privacy attacks. One such attack…

密码学与安全 · 计算机科学 2021-10-06 Xiaoyi Chen , Ahmed Salem , Dingfan Chen , Michael Backes , Shiqing Ma , Qingni Shen , Zhonghai Wu , Yang Zhang

Fine-tuning pre-trained models for downstream tasks has led to a proliferation of open-sourced task-specific models. Recently, Model Merging (MM) has emerged as an effective approach to facilitate knowledge transfer among these…

密码学与安全 · 计算机科学 2024-09-04 Jinghuai Zhang , Jianfeng Chi , Zheng Li , Kunlin Cai , Yang Zhang , Yuan Tian

Large language models are aligned to be safe, preventing users from generating harmful content like misinformation or instructions for illegal activities. However, previous work has shown that the alignment process is vulnerable to…

Multimodal pretrained models are vulnerable to backdoor attacks, yet most existing methods rely on visual or multimodal triggers, which are impractical since visually embedded triggers rarely occur in real-world data. To overcome this…

密码学与安全 · 计算机科学 2026-04-08 Yiyang Zhang , Chaojian Yu , Ziming Hong , Yuanjie Shao , Qinmu Peng , Tongliang Liu , Xinge You

In recent years, neural backdoor attack has been considered to be a potential security threat to deep learning systems. Such systems, while achieving the state-of-the-art performance on clean data, perform abnormally on inputs with…

密码学与安全 · 计算机科学 2020-10-19 Anh Nguyen , Anh Tran

Large language models are typically trained on vast amounts of data during the pre-training phase, which may include some potentially harmful information. Fine-tuning attacks can exploit this by prompting the model to reveal such…

密码学与安全 · 计算机科学 2025-02-04 Zhiyuan Xu , Joseph Gardiner , Sana Belguith

Deep anomaly detection on sequential data has garnered significant attention due to the wide application scenarios. However, deep learning-based models face a critical security threat - their vulnerability to backdoor attacks. In this…

机器学习 · 计算机科学 2024-02-19 He Cheng , Shuhan Yuan

Machine learning models are frequently used to solve complex security problems, as well as to make decisions in sensitive situations like guiding autonomous vehicles or predicting financial market behaviors. Previous efforts have shown that…

密码学与安全 · 计算机科学 2016-04-29 Nicolas Papernot , Patrick McDaniel , Ananthram Swami , Richard Harang

While sequence-to-sequence (seq2seq) models achieve state-of-the-art performance in many natural language processing tasks, they can be too slow for real-time applications. One performance bottleneck is predicting the most likely next token…

计算与语言 · 计算机科学 2019-07-26 Chunyang Xiao , Christoph Teichmann , Konstantine Arkoudas

Multimodal contrastive learning has emerged as a powerful paradigm for building high-quality features using the complementary strengths of various data modalities. However, the open nature of such systems inadvertently increases the…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Siyuan Liang , Kuanrong Liu , Jiajun Gong , Jiawei Liang , Yuan Xun , Ee-Chien Chang , Xiaochun Cao

Backdoor vulnerabilities widely exist in the fine-tuning of large language models(LLMs). Most backdoor poisoning methods operate mainly at the token level and lack deeper semantic manipulation, which limits stealthiness. In addition, Prior…

计算与语言 · 计算机科学 2026-05-13 Ziyu Liu , Tao Li , Tianjie Ni , Xiaolong Lan , Wengang Ma , Tao Yang , Guohua Wang , Junjiang He

Backdoor attack intends to embed hidden backdoor into deep neural networks (DNNs), such that the attacked model performs well on benign samples, whereas its prediction will be maliciously changed if the hidden backdoor is activated by the…

密码学与安全 · 计算机科学 2022-04-13 Shaik Mohammed Maqsood , Viveros Manuela Ceron , Addluri GowthamKrishna

Deep learning models suffer from a phenomenon called adversarial attacks: we can apply minor changes to the model input to fool a classifier for a particular example. The literature mostly considers adversarial attacks on models with images…

机器学习 · 计算机科学 2020-10-13 Ivan Fursov , Alexey Zaytsev , Nikita Kluchnikov , Andrey Kravchenko , Evgeny Burnaev