English
Related papers

Related papers: Exploring Dynamic Properties of Backdoor Training …

200 papers

Backdoor attacks are a kind of insidious security threat against machine learning models. After being injected with a backdoor in training, the victim model will produce adversary-specified outputs on the inputs embedded with predesigned…

Computation and Language · Computer Science 2021-06-04 Fanchao Qi , Mukai Li , Yangyi Chen , Zhengyan Zhang , Zhiyuan Liu , Yasheng Wang , Maosong Sun

With the thriving of deep learning and the widespread practice of using pre-trained networks, backdoor attacks have become an increasing security threat drawing many research interests in recent years. A third-party model can be poisoned in…

Cryptography and Security · Computer Science 2021-03-05 Anh Nguyen , Anh Tran

The proliferation of large AI models trained on uncurated, often sensitive web-scraped data has raised significant privacy concerns. One of the concerns is that adversaries can extract information about the training data using privacy…

Machine Learning · Computer Science 2024-07-24 Dominik Hintersdorf , Lukas Struppek , Daniel Neider , Kristian Kersting

Deep learning models have achieved high performance on many tasks, and thus have been applied to many security-critical scenarios. For example, deep learning-based face recognition systems have been used to authenticate users to access many…

Cryptography and Security · Computer Science 2017-12-18 Xinyun Chen , Chang Liu , Bo Li , Kimberly Lu , Dawn Song

Despite their great success in practical applications, there is still a lack of theoretical and systematic methods to analyze deep neural networks. In this paper, we illustrate an advanced information theoretic methodology to understand the…

Machine Learning · Computer Science 2019-05-09 Shujian Yu , Jose C. Principe

Textual backdoor attacks are a kind of practical threat to NLP systems. By injecting a backdoor in the training phase, the adversary could control model predictions via predefined triggers. As various attack and defense models have been…

Machine Learning · Computer Science 2022-11-02 Ganqu Cui , Lifan Yuan , Bingxiang He , Yangyi Chen , Zhiyuan Liu , Maosong Sun

This paper proposes a data-efficient detection method for deep neural networks against backdoor attacks under a black-box scenario. The proposed approach is motivated by the intuition that features corresponding to triggers have a higher…

Cryptography and Security · Computer Science 2023-07-20 Hao Fu , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Federated learning is particularly susceptible to model poisoning and backdoor attacks because individual users have direct control over the training data and model updates. At the same time, the attack power of an individual user is…

Machine Learning · Computer Science 2022-10-18 Yuxin Wen , Jonas Geiping , Liam Fowl , Hossein Souri , Rama Chellappa , Micah Goldblum , Tom Goldstein

Deep neural networks (DNNs) are vulnerable to backdoor attacks which can hide backdoor triggers in DNNs by poisoning training data. A backdoored model behaves normally on clean test images, yet consistently predicts a particular target…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Shihao Zhao , Xingjun Ma , Xiang Zheng , James Bailey , Jingjing Chen , Yu-Gang Jiang

It is commonplace to produce application-specific models by fine-tuning large pre-trained models using a small bespoke dataset. The widespread availability of foundation model checkpoints on the web poses considerable risks, including the…

Cryptography and Security · Computer Science 2024-04-02 Yuxin Wen , Leo Marchyok , Sanghyun Hong , Jonas Geiping , Tom Goldstein , Nicholas Carlini

Recent researches show that deep learning model is susceptible to backdoor attacks. Many defenses against backdoor attacks have been proposed. However, existing defense works require high computational overhead or backdoor attack…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Mingfu Xue , Yinghao Wu , Zhiyu Wu , Yushu Zhang , Jian Wang , Weiqiang Liu

Adversarial learning methods have been proposed for a wide range of applications, but the training of adversarial models can be notoriously unstable. Effectively balancing the performance of the generator and discriminator is critical,…

Machine Learning · Computer Science 2020-08-26 Xue Bin Peng , Angjoo Kanazawa , Sam Toyer , Pieter Abbeel , Sergey Levine

Deep neural networks face persistent challenges in defending against backdoor attacks, leading to an ongoing battle between attacks and defenses. While existing backdoor defense strategies have shown promising performance on reducing attack…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Mingli Zhu , Siyuan Liang , Baoyuan Wu

The learning dynamics of deep neural networks are subject to controversy. Using the information bottleneck (IB) theory separate fitting and compression phases have been put forward but have since been heavily debated. We approach learning…

Machine Learning · Computer Science 2022-02-18 Johannes Schneider

Deep reinforcement learning has recently shown many impressive successes. However, one major obstacle towards applying such methods to real-world problems is their lack of data-efficiency. To this end, we propose the Bottleneck Simulator: a…

Machine Learning · Computer Science 2018-07-13 Iulian Vlad Serban , Chinnadhurai Sankar , Michael Pieper , Joelle Pineau , Yoshua Bengio

Adversarial examples, generated by carefully crafted perturbation, have attracted considerable attention in research fields. Recent works have argued that the existence of the robust and non-robust features is a primary cause of the…

Machine Learning · Computer Science 2022-04-07 Junho Kim , Byung-Kwan Lee , Yong Man Ro

As machine learning (ML) systems are being increasingly employed in the real world to handle sensitive tasks and make decisions in various fields, the security and privacy of those models have also become increasingly critical. In…

Cryptography and Security · Computer Science 2023-02-21 Marwan Omar

In this paper, we propose a novel method, IB-RAR, which uses Information Bottleneck (IB) to strengthen adversarial robustness for both adversarial training and non-adversarial-trained methods. We first use the IB theory to build…

Machine Learning · Computer Science 2023-06-01 Xiaoyun Xu , Guilherme Perin , Stjepan Picek

Deep neural networks (DNNs) have demonstrated remarkable performance across various tasks, including image and speech recognition. However, maximizing the effectiveness of DNNs requires meticulous optimization of numerous hyperparameters…

Cryptography and Security · Computer Science 2024-06-14 Gorka Abad , Oguzhan Ersoy , Stjepan Picek , Aitor Urbieta

Large amounts of incremental learning algorithms have been proposed to alleviate the catastrophic forgetting issue arises while dealing with sequential data on a time series. However, the adversarial robustness of incremental learners has…

Cryptography and Security · Computer Science 2023-05-31 Yiqi Zhong , Xianming Liu , Deming Zhai , Junjun Jiang , Xiangyang Ji