English
Related papers

Related papers: BackdoorBox: A Python Toolbox for Backdoor Learnin…

200 papers

Deep Neural Networks (DNNs) have become a powerful toolfor a wide range of problems. Yet recent work has found an increasing variety of adversarial samplesthat can fool them. Most existing detection mechanisms against adversarial…

Machine Learning · Computer Science 2019-11-22 Ilia Shumailov , Yiren Zhao , Robert Mullins , Ross Anderson

Deep Neural Networks (DNNs) are vulnerable to the black-box adversarial attack that is highly transferable. This threat comes from the distribution gap between adversarial and clean samples in feature space of the target DNNs. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Xiaogang Xu , Hengshuang Zhao , Philip Torr , Jiaya Jia

Deep neural networks (DNN) are known to be vulnerable to adversarial attacks. Numerous efforts either try to patch weaknesses in trained models, or try to make it difficult or costly to compute adversarial examples that exploit them. In our…

Machine Learning · Computer Science 2020-12-01 Shawn Shan , Emily Wenger , Bolun Wang , Bo Li , Haitao Zheng , Ben Y. Zhao

Deep neural networks (DNNs) are increasingly deployed in different applications to achieve state-of-the-art performance. However, they are often applied as a black box with limited understanding of what knowledge the model has learned from…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Shihao Zhao , Xingjun Ma , Yisen Wang , James Bailey , Bo Li , Yu-Gang Jiang

Backdoor defenses have been studied to alleviate the threat of deep neural networks (DNNs) being backdoor attacked and thus maliciously altered. Since DNNs usually adopt some external training data from an untrusted third party, a robust…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Kuofeng Gao , Yang Bai , Jindong Gu , Yong Yang , Shu-Tao Xia

Deep learning-based techniques have achieved state-of-the-art performance on a wide variety of recognition and classification tasks. However, these networks are typically computationally expensive to train, requiring weeks of computation on…

Cryptography and Security · Computer Science 2019-03-13 Tianyu Gu , Brendan Dolan-Gavitt , Siddharth Garg

This work provides the community with a timely comprehensive review of backdoor attacks and countermeasures on deep learning. According to the attacker's capability and affected stage of the machine learning pipeline, the attack surfaces…

Cryptography and Security · Computer Science 2020-08-04 Yansong Gao , Bao Gia Doan , Zhi Zhang , Siqi Ma , Jiliang Zhang , Anmin Fu , Surya Nepal , Hyoungshick Kim

Deep learning models are increasingly used in mobile applications as critical components. Unlike the program bytecode whose vulnerabilities and threats have been widely-discussed, whether and how the deep learning models deployed in the…

Cryptography and Security · Computer Science 2021-01-19 Yuanchun Li , Jiayi Hua , Haoyu Wang , Chunyang Chen , Yunxin Liu

Because state-of-the-art language models are expensive to train, most practitioners must make use of one of the few publicly available language models or language model APIs. This consolidation of trust increases the potency of backdoor…

Cryptography and Security · Computer Science 2023-07-28 Nikhil Kandpal , Matthew Jagielski , Florian Tramèr , Nicholas Carlini

Recently, backdoor attacks have posed a serious security threat to the training process of deep neural networks (DNNs). The attacked model behaves normally on benign samples but outputs a specific result when the trigger is present.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Zixuan Zhu , Rui Wang , Cong Zou , Lihua Jing

Transforming off-the-shelf deep neural network (DNN) models into dynamic multi-exit architectures can achieve inference and transmission efficiency by fragmenting and distributing a large DNN model in edge computing scenarios (e.g., edge…

Cryptography and Security · Computer Science 2022-12-23 Tian Dong , Ziyuan Zhang , Han Qiu , Tianwei Zhang , Hewu Li , Terry Wang

Trojan (backdoor) attack is a form of adversarial attack on deep neural networks where the attacker provides victims with a model trained/retrained on malicious data. The backdoor can be activated when a normal input is stamped with a…

Machine Learning · Computer Science 2021-01-05 Siyuan Cheng , Yingqi Liu , Shiqing Ma , Xiangyu Zhang

Powerful adversarial attack methods are vital for understanding how to construct robust deep neural networks (DNNs) and for thoroughly testing defense techniques. In this paper, we propose a black-box adversarial attack algorithm that can…

Machine Learning · Computer Science 2019-12-11 Yandong Li , Lijun Li , Liqiang Wang , Tong Zhang , Boqing Gong

Deep neural networks (DNNs) have gain its popularity in various scenarios in recent years. However, its excellent ability of fitting complex functions also makes it vulnerable to backdoor attacks. Specifically, a backdoor can remain hidden…

Cryptography and Security · Computer Science 2023-05-18 Xinrui Liu , Yu-an Tan , Yajie Wang , Kefan Qiu , Yuanzhang Li

Many deployed learned models are black boxes: given input, returns output. Internal information about the model, such as the architecture, optimisation procedure, or training data, is not disclosed explicitly as it might contain proprietary…

Machine Learning · Statistics 2018-02-15 Seong Joon Oh , Max Augustin , Bernt Schiele , Mario Fritz

Machine learning (ML) has made tremendous progress during the past decade and is being adopted in various critical real-world applications. However, recent research has shown that ML models are vulnerable to multiple security and privacy…

Cryptography and Security · Computer Science 2022-03-07 Ahmed Salem , Rui Wen , Michael Backes , Shiqing Ma , Yang Zhang

As machine learning systems grow in scale, so do their training data requirements, forcing practitioners to automate and outsource the curation of training data in order to achieve state-of-the-art performance. The absence of trustworthy…

Machine Learning · Computer Science 2021-04-02 Micah Goldblum , Dimitris Tsipras , Chulin Xie , Xinyun Chen , Avi Schwarzschild , Dawn Song , Aleksander Madry , Bo Li , Tom Goldstein

Machine learning models have been successfully applied to a wide range of applications including computer vision, natural language processing, and speech recognition. A successful implementation of these models however, usually relies on…

Machine Learning · Computer Science 2020-09-29 Arash Rahnama , Andrew Tseng

With the widespread use of deep learning system in many applications, the adversary has strong incentive to explore vulnerabilities of deep neural networks and manipulate them. Backdoor attacks against deep neural networks have been…

Cryptography and Security · Computer Science 2019-06-05 Jiazhu Dai , Chuanshuai Chen

Deep neural networks for image classification are well-known to be vulnerable to adversarial attacks. One such attack that has garnered recent attention is the adversarial backdoor attack, which has demonstrated the capability to perform…

Cryptography and Security · Computer Science 2022-06-09 Glenn Dawson , Muhammad Umer , Robi Polikar