English
Related papers

Related papers: Dropout Attacks

200 papers

Deep neural network (DNN) classifiers are vulnerable to backdoor attacks. An adversary poisons some of the training data in such attacks by installing a trigger. The goal is to make the trained DNN output the attacker's desired class…

Machine Learning · Computer Science 2022-10-14 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

With the growing attention on learning-to-learn new tasks using only a few examples, meta-learning has been widely used in numerous problems such as few-shot classification, reinforcement learning, and domain generalization. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Hung-Yu Tseng , Yi-Wen Chen , Yi-Hsuan Tsai , Sifei Liu , Yen-Yu Lin , Ming-Hsuan Yang

In classification applications, we often want probabilistic predictions to reflect confidence or uncertainty. Dropout, a commonly used training technique, has recently been linked to Bayesian inference, yielding an efficient way to quantify…

Machine Learning · Computer Science 2019-06-25 Zhilu Zhang , Adrian V. Dalca , Mert R. Sabuncu

The big breakthrough on the ImageNet challenge in 2012 was partially due to the `dropout' technique used to avoid overfitting. Here, we introduce a new approach called `Spectral Dropout' to improve the generalization ability of deep neural…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Salman Khan , Munawar Hayat , Fatih Porikli

From face recognition systems installed in phones to self-driving cars, the field of AI is witnessing rapid transformations and is being integrated into our everyday lives at an incredible pace. Any major failure in these system's…

Cryptography and Security · Computer Science 2020-12-14 Ayush Goel

Backdoor (Trojan) attacks are emerging threats against deep neural networks (DNN). A DNN being attacked will predict to an attacker-desired target class whenever a test sample from any source class is embedded with a backdoor pattern; while…

Cryptography and Security · Computer Science 2021-12-08 Xi Li , Zhen Xiang , David J. Miller , George Kesidis

Recurrent neural networks (RNNs) stand at the forefront of many recent developments in deep learning. Yet a major difficulty with these models is their tendency to overfit, with dropout shown to fail when applied to recurrent layers. Recent…

Machine Learning · Statistics 2016-10-06 Yarin Gal , Zoubin Ghahramani

Deep learning is the state-of-the-art in fields such as visual object recognition and speech recognition. This learning uses a large number of layers, huge number of units, and connections. Therefore, overfitting is a serious problem. To…

Machine Learning · Computer Science 2017-06-22 Kazuyuki Hara , Daisuke Saitoh , Hayaru Shouno

Dropout Regularization, serving to reduce variance, is nearly ubiquitous in Deep Learning models. We explore the relationship between the dropout rate and model complexity by training 2,000 neural networks configured with random…

Machine Learning · Computer Science 2021-08-30 Christopher Sun , Jai Sharma , Milind Maiti

Data poisoning attacks, in which a malicious adversary aims to influence a model by injecting "poisoned" data into the training process, have attracted significant recent attention. In this work, we take a closer look at existing poisoning…

Machine Learning · Computer Science 2024-02-16 Yiwei Lu , Gautam Kamath , Yaoliang Yu

We propose a novel approach towards adversarial attacks on neural networks (NN), focusing on tampering the data used for training instead of generating attacks on trained models. Our network-agnostic method creates a backdoor during…

With the success of deep learning algorithms in various domains, studying adversarial attacks to secure deep models in real world applications has become an important research topic. Backdoor attacks are a form of adversarial attacks on…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Aniruddha Saha , Akshayvarun Subramanya , Hamed Pirsiavash

Deep neural networks (DNNs) are vulnerable to the \emph{backdoor attack}, which intends to embed hidden backdoors in DNNs by poisoning training data. The attacked model behaves normally on benign samples, whereas its prediction will be…

Cryptography and Security · Computer Science 2021-04-06 Yiming Li , Yanjie Li , Yalei Lv , Yong Jiang , Shu-Tao Xia

With the broad application of deep neural networks (DNNs), backdoor attacks have gradually attracted attention. Backdoor attacks are insidious, and poisoned models perform well on benign samples and are only triggered when given specific…

Machine Learning · Computer Science 2022-07-12 Chang Yue , Peizhuo Lv , Ruigang Liang , Kai Chen

As the number of parameters in Deep Neural Networks (DNNs) scales, the thirst for training data also increases. To save costs, it has become common for users and enterprises to delegate time-consuming data collection to third parties.…

Cryptography and Security · Computer Science 2023-10-17 Ziqiang Li , Pengfei Xia , Hong Sun , Yueqi Zeng , Wei Zhang , Bin Li

In order to obtain reliable accuracy estimates for automatic MOOC dropout predictors, it is important to train and test them in a manner consistent with how they will be used in practice. Yet most prior research on MOOC dropout prediction…

Artificial Intelligence · Computer Science 2017-02-22 Jacob Whitehill , Kiran Mohan , Daniel Seaton , Yigal Rosen , Dustin Tingley

In the last decade, exponential data growth supplied the machine learning-based algorithms' capacity and enabled their usage in daily life activities. Additionally, such an improvement is partially explained due to the advent of deep…

Machine Learning · Computer Science 2022-03-08 Claudio Filipi Goncalves do Santos , Mateus Roder , Leandro A. Passos , João P. Papa

Deep learning methods have shown great promise in many practical applications, ranging from speech recognition, visual object recognition, to text processing. However, most of the current deep learning methods suffer from scalability…

Machine Learning · Statistics 2015-08-31 Yanping Huang , Sai Zhang

Machine learning systems are deployed in critical settings, but they might fail in unexpected ways, impacting the accuracy of their predictions. Poisoning attacks against machine learning induce adversarial modification of data used by a…

Machine Learning · Computer Science 2021-05-13 Matthew Jagielski , Giorgio Severi , Niklas Pousette Harger , Alina Oprea

Most deep architectures for image classification--even those that are trained to classify a large number of diverse categories--learn shared image representations with a single model. Intuitively, however, categories that are more similar…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Calvin Murdock , Zhen Li , Howard Zhou , Tom Duerig