English
Related papers

Related papers: Implementation and Evaluation of a Gradient Descen…

200 papers

Decision-based methods have shown to be effective in black-box adversarial attacks, as they can obtain satisfactory performance and only require to access the final model prediction. Gradient estimation is a critical step in black-box…

Machine Learning · Computer Science 2023-10-31 Han Liu , Xingshuo Huang , Xiaotong Zhang , Qimai Li , Fenglong Ma , Wei Wang , Hongyang Chen , Hong Yu , Xianchao Zhang

One of the most important parts of Artificial Neural Networks is minimizing the loss functions which tells us how good or bad our model is. To minimize these losses we need to tune the weights and biases. Also to calculate the minimum value…

Machine Learning · Computer Science 2021-01-08 Kaustubh Yadav

Backdoor attacks have posed a significant threat to the security of deep neural networks (DNNs). Despite considerable strides in developing defenses against backdoor attacks in the visual domain, the specialized defenses for the audio…

Sound · Computer Science 2025-02-04 Nanjun Zhou , Weilin Lin , Li Liu

Deep neural networks work well at approximating complicated functions when provided with data and trained by gradient descent methods. At the same time, there is a vast amount of existing functions that programmatically solve different…

Machine Learning · Computer Science 2019-01-15 Alon Jacovi , Guy Hadash , Einat Kermany , Boaz Carmeli , Ofer Lavi , George Kour , Jonathan Berant

Defending computer networks from cyber attack requires timely responses to alerts and threat intelligence. Decisions about how to respond involve coordinating actions across multiple nodes based on imperfect indicators of compromise while…

Cryptography and Security · Computer Science 2021-11-05 John Mern , Kyle Hatch , Ryan Silva , Cameron Hickert , Tamim Sookoor , Mykel J. Kochenderfer

We describe an alternative learning method for neural networks, which we call Blind Descent. By design, Blind Descent does not face problems like exploding or vanishing gradients. In Blind Descent, gradients are not used to guide the…

Machine Learning · Computer Science 2020-08-27 Akshat Gupta , Prasad N R

We present a generalization of conventional artificial neural networks that allows for a functional equivalence to multi-expert systems. The new model provides an architectural freedom going beyond existing multi-expert models and an…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Marc Toussaint

Adversarial training has gained great popularity as one of the most effective defenses for deep neural network and more generally for gradient-based machine learning models against adversarial perturbations on data points. This paper…

Machine Learning · Computer Science 2023-05-25 Haotian Gu , Xin Guo , Xinyu Li

Deep reinforcement learning has proven remarkably useful in training agents from unstructured data. However, the opacity of the produced agents makes it difficult to ensure that they adhere to various requirements posed by human engineers.…

Machine Learning · Computer Science 2022-02-10 Raz Yerushalmi , Guy Amir , Achiya Elyasaf , David Harel , Guy Katz , Assaf Marron

Adversarial training, the process of training a deep learning model with adversarial data, is one of the most successful adversarial defense methods for deep learning models. We have found that the robustness to white-box attack of an…

Machine Learning · Computer Science 2021-12-24 Zhiwen Yan , Teck Khim Ng

We propose gradient adversarial training, an auxiliary deep learning framework applicable to different machine learning problems. In gradient adversarial training, we leverage a prior belief that in many contexts, simultaneous gradient…

Machine Learning · Computer Science 2018-06-22 Ayan Sinha , Zhao Chen , Vijay Badrinarayanan , Andrew Rabinovich

Deep neural networks (DNNs) are known to be vulnerable to adversarial examples which contain human-imperceptible perturbations. A series of defending methods, either proactive defence or reactive defence, have been proposed in the recent…

Machine Learning · Computer Science 2020-07-27 Derek Wang , Chaoran Li , Sheng Wen , Surya Nepal , Yang Xiang

In recent years, deep learning has shown itself to be an incredibly valuable tool in cybersecurity as it helps network intrusion detection systems to classify attacks and detect new ones. Adversarial learning is the process of utilizing…

Cryptography and Security · Computer Science 2022-06-30 Jared Mathews , Prosenjit Chatterjee , Shankar Banik , Cory Nance

Adversarial attacks, particularly the Fast Gradient Sign Method (FGSM) and Projected Gradient Descent (PGD) pose significant threats to the robustness of deep learning models in image classification. This paper explores and refines defense…

Cryptography and Security · Computer Science 2025-05-15 Hetvi Waghela , Jaydip Sen , Sneha Rakshit

Neural network optimization remains one of the most consequential yet poorly understood challenges in modern AI research, where improvements in training algorithms can lead to enhanced feature learning in foundation models,…

Machine Learning · Computer Science 2025-12-23 Ansh Nagwekar

Gradient-based optimization is the foundation of deep learning and reinforcement learning. Even when the mechanism being optimized is unknown or not differentiable, optimization using high-variance or biased gradient estimates is still…

Machine Learning · Computer Science 2018-02-27 Will Grathwohl , Dami Choi , Yuhuai Wu , Geoffrey Roeder , David Duvenaud

Machine Learning systems are vulnerable to adversarial attacks and will highly likely produce incorrect outputs under these attacks. There are white-box and black-box attacks regarding to adversary's access level to the victim learning…

Machine Learning · Computer Science 2019-10-23 Saeid Samizade , Zheng-Hua Tan , Chao Shen , Xiaohong Guan

Machine Learning models are vulnerable to adversarial attacks that rely on perturbing the input data. This work proposes a novel strategy using Autoencoder Deep Neural Networks to defend a machine learning model against two gradient-based…

Machine Learning · Computer Science 2018-12-10 Rajeev Sahay , Rehana Mahfuz , Aly El Gamal

Deep learning models have been shown to be vulnerable to adversarial attacks. In particular, gradient-based attacks have demonstrated high success rates recently. The gradient measures how each image pixel affects the model output, which…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Hanbin Hong , Yuan Hong , Yu Kong

Improving the resistance of deep neural networks against adversarial attacks is important for deploying models to realistic applications. However, most defense methods are designed to defend against intensity perturbations and ignore…

Machine Learning · Computer Science 2020-10-07 Pengfei Xia , Bin Li