English
Related papers

Related papers: How Robust Are Energy-Based Models Trained With Eq…

200 papers

Ensuring robustness of Deep Neural Networks (DNNs) is crucial to their adoption in safety-critical applications such as self-driving cars, drones, and healthcare. Notably, DNNs are vulnerable to adversarial attacks in which small input…

Machine Learning · Computer Science 2020-04-22 Sanchari Sen , Balaraman Ravindran , Anand Raghunathan

Deep neural networks (DNNs) are vulnerable to adversarial examples, in which DNNs are misled to false outputs due to inputs containing imperceptible perturbations. Adversarial training, a reliable and effective method of defense, may…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zongyuan Zhang , Qingwen Bu , Tianyang Duan , Zheng Lin , Yuhao Qing , Zihan Fang , Heming Cui , Dong Huang

Recent work has shown deep neural networks (DNNs) to be highly susceptible to well-designed, small perturbations at the input layer, or so-called adversarial examples. Taking images as an example, such distortions are often imperceptible,…

Machine Learning · Computer Science 2015-04-13 Shixiang Gu , Luca Rigazio

Adversarial examples reveal critical vulnerabilities in deep neural networks by exploiting their sensitivity to imperceptible input perturbations. While adversarial training remains the predominant defense strategy, it often incurs…

Machine Learning · Computer Science 2025-11-04 Longwei Wang , Ifrat Ikhtear Uddin , KC Santosh , Chaowei Zhang , Xiao Qin , Yang Zhou

Deep energy-based models (EBMs) are very flexible in distribution parametrization but computationally challenging because of the intractable partition function. They are typically trained via maximum likelihood, using contrastive divergence…

Machine Learning · Computer Science 2020-07-22 Lantao Yu , Yang Song , Jiaming Song , Stefano Ermon

Deep neural networks have proven to be quite effective in a wide variety of machine learning tasks, ranging from improved speech recognition systems to advancing the development of autonomous vehicles. However, despite their superior…

Machine Learning · Computer Science 2016-12-14 Qinglong Wang , Wenbo Guo , Alexander G. Ororbia , Xinyu Xing , Lin Lin , C. Lee Giles , Xue Liu , Peng Liu , Gang Xiong

Machine learning systems based on deep neural networks (DNNs) have gained mainstream adoption in many applications. Recently, however, DNNs are shown to be vulnerable to adversarial example attacks with slight perturbations on the inputs.…

Machine Learning · Computer Science 2018-12-10 Bo Luo , Min Li , Yu Li , Qiang Xu

By reinterpreting a robust discriminative classifier as Energy-based Model (EBM), we offer a new take on the dynamics of adversarial training (AT). Our analysis of the energy landscape during AT reveals that untargeted attacks generate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Mujtaba Hussain Mirza , Maria Rosaria Briglia , Senad Beadini , Iacopo Masi

The vulnerability of deep networks to adversarial attacks is a central problem for deep learning from the perspective of both cognition and security. The current most successful defense method is to train a classifier using adversarial…

Machine Learning · Statistics 2021-03-22 Mitch Hill , Jonathan Mitchell , Song-Chun Zhu

In recent years, it has been found that neural networks can be easily fooled by adversarial examples, which is a potential safety hazard in some safety-critical applications. Many researchers have proposed various method to make neural…

Machine Learning · Computer Science 2018-04-24 Shuangtao Li , Yuanke Chen , Yanlin Peng , Lin Bai

Deep neural networks (DNNs) have proven to be quite effective in a vast array of machine learning tasks, with recent examples in cyber security and autonomous vehicles. Despite the superior performance of DNNs in these applications, it has…

Machine Learning · Computer Science 2017-08-22 Qinglong Wang , Wenbo Guo , Kaixuan Zhang , Alexander G. Ororbia , Xinyu Xing , Xue Liu , C. Lee Giles

Adversarial attacks have been shown to be highly effective at degrading the performance of deep neural networks (DNNs). The most prominent defense is adversarial training, a method for learning a robust model. Nevertheless, adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Uriya Pesso , Koby Bibas , Meir Feder

Deep equilibrium models (DEQs) refrain from the traditional layer-stacking paradigm and turn to find the fixed point of a single layer. DEQs have achieved promising performance on different applications with featured memory efficiency. At…

Machine Learning · Computer Science 2023-06-05 Zonghan Yang , Tianyu Pang , Yang Liu

Applications based on Deep Neural Networks (DNNs) have grown exponentially in the past decade. To match their increasing computational needs, several Non-Volatile Memory (NVM) crossbar based accelerators have been proposed. Recently,…

Machine Learning · Computer Science 2025-04-29 Chun Tao , Deboleena Roy , Indranil Chakraborty , Kaushik Roy

Deep neural networks (DNNs) are known to have a fundamental sensitivity to adversarial attacks, perturbations of the input that are imperceptible to humans yet powerful enough to change the visual decision of a model. Adversarial attacks…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Drew Linsley , Pinyuan Feng , Thibaut Boissin , Alekh Karkada Ashok , Thomas Fel , Stephanie Olaiya , Thomas Serre

Deep neural networks (DNNs) have been shown to be vulnerable to adversarial attacks -- subtle, perceptually indistinguishable perturbations of inputs that change the response of the model. In the context of vision, we hypothesize that an…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Muhammad A. Shah , Bhiksha Raj

We motivate Energy-Based Models (EBMs) as a promising model class for continual learning problems. Instead of tackling continual learning via the use of external memory, growing models, or regularization, EBMs change the underlying training…

Machine Learning · Computer Science 2025-03-05 Shuang Li , Yilun Du , Gido M. van de Ven , Igor Mordatch

We consider adversarial training of deep neural networks through the lens of Bayesian learning, and present a principled framework for adversarial training of Bayesian Neural Networks (BNNs) with certifiable guarantees. We rely on…

Machine Learning · Computer Science 2021-02-24 Matthew Wicker , Luca Laurenti , Andrea Patane , Zhoutong Chen , Zheng Zhang , Marta Kwiatkowska

We consider adversarial machine learning based attacks on power allocation where the base station (BS) allocates its transmit power to multiple orthogonal subcarriers by using a deep neural network (DNN) to serve multiple user equipments…

Signal Processing · Electrical Eng. & Systems 2021-10-13 Brian Kim , Yi Shi , Yalin E. Sagduyu , Tugba Erpek , Sennur Ulukus

In practice, deep neural networks have been found to be vulnerable to various types of noise, such as adversarial examples and corruption. Various adversarial defense methods have accordingly been developed to improve adversarial robustness…

Machine Learning · Computer Science 2020-12-24 Aishan Liu , Xianglong Liu , Chongzhi Zhang , Hang Yu , Qiang Liu , Dacheng Tao