English
Related papers

Related papers: Parametric Noise Injection: Trainable Randomness t…

200 papers

We study the regularisation induced in neural networks by Gaussian noise injections (GNIs). Though such injections have been extensively studied when applied to data, there have been few studies on understanding the regularising effect they…

Machine Learning · Statistics 2021-01-20 Alexander Camuto , Matthew Willetts , Umut Şimşekli , Stephen Roberts , Chris Holmes

Deep Neural Networks (DNNs) are notoriously vulnerable to adversarial input designs with limited noise budgets. While numerous successful attacks with subtle modifications to original input have been proposed, defense techniques against…

Machine Learning · Computer Science 2025-06-27 Furkan Mumcu , Yasin Yilmaz

Adversarial attacks pose significant challenges to Machine Learning (ML) systems and especially Deep Neural Networks (DNNs) by subtly manipulating inputs to induce incorrect predictions. This paper investigates whether increasing the layer…

Cryptography and Security · Computer Science 2025-10-23 Mohamed ElShehaby , Ashraf Matrawy

It is well-known that stochastic gradient noise (SGN) acts as implicit regularization for deep learning and is essentially important for both optimization and generalization of deep networks. Some works attempted to artificially simulate…

Machine Learning · Computer Science 2022-08-31 Zeke Xie , Li Yuan , Zhanxing Zhu , Masashi Sugiyama

The idea of robustness is central and critical to modern statistical analysis. However, despite the recent advances of deep neural networks (DNNs), many studies have shown that DNNs are vulnerable to adversarial attacks. Making…

Cryptography and Security · Computer Science 2023-06-02 Jungeum Kim , Xiao Wang

Deep neural network (DNN) architecture based models have high expressive power and learning capacity. However, they are essentially a black box method since it is not easy to mathematically formulate the functions that are learned within…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Gaurav Goswami , Nalini Ratha , Akshay Agarwal , Richa Singh , Mayank Vatsa

In this paper, we investigate the following question: Can we obtain adversarially-trained models without training on adversarial examples? Our intuition is that training a model with inherent stochasticity, i.e., optimizing the parameters…

Machine Learning · Computer Science 2023-12-15 Ayoub Arous , Andres F Lopez-Lopera , Nael Abu-Ghazaleh , Ihsen Alouani

Deep Neural Networks (DNNs) are known to be vulnerable to both backdoor and adversarial attacks. In the literature, these two types of attacks are commonly treated as distinct robustness problems and solved separately, since they belong to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Zhenxing Niu , Yuyao Sun , Qiguang Miao , Rong Jin , Gang Hua

Deep neural networks (DNN) have achieved remarkable success in various fields, including computer vision and natural language processing. However, training an effective DNN model still poses challenges. This paper aims to propose a method…

Machine Learning · Computer Science 2024-07-03 Hejie Ying , Mengmeng Song , Yaohong Tang , Shungen Xiao , Zimin Xiao

Over the past decade, deep learning has revolutionized conventional tasks that rely on hand-craft feature extraction with its strong feature learning capability, leading to substantial enhancements in traditional tasks. However, deep neural…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Donghua Wang , Wen Yao , Tingsong Jiang , Guijian Tang , Xiaoqian Chen

Deep Neural Networks (DNNs) have become key components of many safety-critical applications such as autonomous driving and medical diagnosis. However, DNNs have been shown suffering from poor robustness because of their susceptibility to…

Machine Learning · Computer Science 2020-07-28 Wenjie Wan , Zhaodi Zhang , Yiwei Zhu , Min Zhang , Fu Song

Network Intrusion Detection System (NIDS) is an essential tool in securing cyberspace from a variety of security risks and unknown cyberattacks. A number of solutions have been implemented for Machine Learning (ML), and Deep Learning (DL)…

Cryptography and Security · Computer Science 2023-08-02 Khushnaseeb Roshan , Aasim Zafar , Shiekh Burhan Ul Haque

The introduction of robust optimisation has pushed the state-of-the-art in defending against adversarial attacks. Notably, the state-of-the-art projected gradient descent (PGD)-based training method has been shown to be universally and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Ezekiel Soremekun , Sakshi Udeshi , Sudipta Chattopadhyay

The vanilla LSTM has become one of the most potential architectures in word-level language modeling, like other recurrent neural networks, overfitting is always a key barrier for its effectiveness. The existing noise-injected…

Computation and Language · Computer Science 2021-03-18 Rui Li , Kai Shuang , Mengyu Gu , Sen Su

As deep neural networks (DNNs) are widely applied in the physical world, many researches are focusing on physical-world adversarial examples (PAEs), which introduce perturbations to inputs and cause the model's incorrect outputs. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yichen Wang , Yuxuan Chou , Ziqi Zhou , Hangtao Zhang , Wei Wan , Shengshan Hu , Minghui Li

Deep Neural Networks (DNNs) are highly sensitive to imperceptible malicious perturbations, known as adversarial attacks. Following the discovery of this vulnerability in real-world imaging and vision applications, the associated safety…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tsachi Blau , Roy Ganz , Bahjat Kawar , Alex Bronstein , Michael Elad

Deep neural networks (DNNs) can be easily fooled by adding human imperceptible perturbations to the images. These perturbed images are known as `adversarial examples' and pose a serious threat to security and safety critical systems. A…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Muzammal Naseer , Salman H. Khan , Shafin Rahman , Fatih Porikli

Adversarial attacks in machine learning traditionally focus on global perturbations to input data, yet the potential of localized adversarial noise remains underexplored. This study systematically evaluates localized adversarial attacks…

Machine Learning · Computer Science 2025-09-30 Pavan Reddy , Aditya Sanjay Gujral

Adversarial attacks on deep neural network models have seen rapid development and are extensively used to study the stability of these networks. Among various adversarial strategies, Projected Gradient Descent (PGD) is a widely adopted…

Machine Learning · Computer Science 2024-10-17 Dayana Savostianova , Emanuele Zangrando , Francesco Tudisco

The stochastic gradient descent (SGD) method is most widely used for deep neural network (DNN) training. However, the method does not always converge to a flat minimum of the loss surface that can demonstrate high generalization capability.…

Machine Learning · Computer Science 2020-09-08 Wonyong Sung , Iksoo Choi , Jinhwan Park , Seokhyun Choi , Sungho Shin