English
Related papers

Related papers: Defensive Distillation is Not Robust to Adversaria…

200 papers

Modern image classification systems are often built on deep neural networks, which suffer from adversarial examples--images with deliberately crafted, imperceptible noise to mislead the network's classification. To defend against…

Machine Learning · Computer Science 2019-12-02 Chang Xiao , Changxi Zheng

Deep neural networks are facing a potential security threat from adversarial examples, inputs that look normal but cause an incorrect classification by the deep neural network. For example, the proposed threat could result in hand-written…

Computer Vision and Pattern Recognition · Computer Science 2016-10-17 Abigail Graese , Andras Rozsa , Terrance E. Boult

Deep neural networks with millions of parameters may suffer from poor generalization due to overfitting. To mitigate the issue, we propose a new regularization method that penalizes the predictive distribution between similar samples. In…

Machine Learning · Computer Science 2020-04-08 Sukmin Yun , Jongjin Park , Kimin Lee , Jinwoo Shin

Achieving resiliency against adversarial attacks is necessary prior to deploying neural network classifiers in domains where misclassification incurs substantial costs, e.g., self-driving cars or medical imaging. Recent work has…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Jieren Deng , Aaron Palmer , Rigel Mahmood , Ethan Rathbun , Jinbo Bi , Kaleel Mahmood , Derek Aguiar

Ongoing research has proposed several methods to defend neural networks against adversarial examples, many of which researchers have shown to be ineffective. We ask whether a strong defense can be created by combining multiple (possibly…

Machine Learning · Computer Science 2017-06-16 Warren He , James Wei , Xinyun Chen , Nicholas Carlini , Dawn Song

Adversarial examples are maliciously modified inputs created to fool deep neural networks (DNN). The discovery of such inputs presents a major issue to the expansion of DNN-based solutions. Many researchers have already contributed to the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Alessandro Cennamo , Ido Freeman , Anton Kummert

Recent advancements in self-supervised learning have reduced the gap between supervised and unsupervised representation learning. However, most self-supervised and deep clustering techniques rely heavily on data augmentation, rendering them…

Machine Learning · Computer Science 2021-12-21 Mohammed Adnan , Yani A. Ioannou , Chuan-Yung Tsai , Graham W. Taylor

Adversarial attacks against neural networks in a regression setting are a critical yet understudied problem. In this work, we advance the state of the art by investigating adversarial attacks against regression networks and by formulating a…

Machine Learning · Computer Science 2018-12-10 Andre T. Nguyen , Edward Raff

Hundreds of defenses have been proposed to make deep neural networks robust against minimal (adversarial) input perturbations. However, only a handful of these defenses held up their claims because correctly evaluating robustness is…

Machine Learning · Computer Science 2022-06-29 Roland S. Zimmermann , Wieland Brendel , Florian Tramer , Nicholas Carlini

Dataset distillation has emerged as a prominent technique to improve data efficiency when training machine learning models. It encapsulates the knowledge from a large dataset into a smaller synthetic dataset. A model trained on this smaller…

Cryptography and Security · Computer Science 2023-01-04 Yugeng Liu , Zheng Li , Michael Backes , Yun Shen , Yang Zhang

Artificial neural networks in general and deep learning networks in particular established themselves as popular and powerful machine learning algorithms. While the often tremendous sizes of these networks are beneficial when solving…

Machine Learning · Computer Science 2020-05-28 Moritz Seiler , Heike Trautmann , Pascal Kerschke

Many recent works on knowledge distillation have provided ways to transfer the knowledge of a trained network for improving the learning process of a new one, but finding a good technique for knowledge distillation is still an open problem.…

Machine Learning · Computer Science 2018-12-17 Byeongho Heo , Minsik Lee , Sangdoo Yun , Jin Young Choi

Machine learning models are vulnerable to simple model stealing attacks if the adversary can obtain output labels for chosen inputs. To protect against these attacks, it has been proposed to limit the information provided to the adversary…

Machine Learning · Computer Science 2018-12-14 Taesung Lee , Benjamin Edwards , Ian Molloy , Dong Su

There is a rising interest in studying the robustness of deep neural network classifiers against adversaries, with both advanced attack and defence techniques being actively developed. However, most recent work focuses on discriminative…

Machine Learning · Computer Science 2019-05-28 Yingzhen Li , John Bradshaw , Yash Sharma

Knowledge distillation has become a cornerstone in modern machine learning systems, celebrated for its ability to transfer knowledge from a large, complex teacher model to a more efficient student model. Traditionally, this process is…

Cryptography and Security · Computer Science 2026-01-13 Chen Wu , Qian Ma , Prasenjit Mitra , Sencun Zhu

Deep learning models are vulnerable to adversarial examples and make incomprehensible mistakes, which puts a threat on their real-world deployment. Combined with the idea of adversarial training, preprocessing-based defenses are popular and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Tao Bai , Jun Zhao , Lanqing Guo , Bihan Wen

Data poisoning causes misclassification of test time target examples by injecting maliciously crafted samples in the training data. Existing defenses are often effective only against a specific type of targeted attack, significantly degrade…

Machine Learning · Computer Science 2022-10-19 Yu Yang , Tian Yu Liu , Baharan Mirzasoleiman

Classification models for the multivariate time series have gained significant importance in the research community, but not much research has been done on generating adversarial samples for these models. Such samples of adversaries could…

Machine Learning · Computer Science 2020-04-02 Samuel Harford , Fazle Karim , Houshang Darabi

We consider the theoretical problem of designing an optimal adversarial attack on a decision system that maximally degrades the achievable performance of the system as measured by the mutual information between the degraded signal and the…

Machine Learning · Computer Science 2020-07-29 Jirong Yi , Raghu Mudumbai , Weiyu Xu

Adversarial Distillation aims to enhance student robustness by guiding the student with a robust teacher's soft labels within the min-max adversarial training framework, yet its success is notoriously inconsistent: a more robust teacher…

Machine Learning · Computer Science 2026-05-22 Hongsin Lee , Hye Won Chung