中文
相关论文

相关论文: Hessian-aware Training for Enhancing DNNs Resilien…

200 篇论文

Humans rely heavily on shape information to recognize objects. Conversely, convolutional neural networks (CNNs) are biased more towards texture. This is perhaps the main reason why CNNs are vulnerable to adversarial examples. Here, we…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Ali Borji

Deep neural networks (DNNs) are vulnerable to adversarial examples crafted by well-designed perturbations. This could lead to disastrous results on critical applications such as self-driving cars, surveillance security, and medical…

计算机视觉与模式识别 · 计算机科学 2023-10-24 Yaguan Qian , Chenyu Zhao , Zhaoquan Gu , Bin Wang , Shouling Ji , Wei Wang , Boyang Zhou , Pan Zhou

DNNs trained on natural clean samples have been shown to perform poorly on corrupted samples, such as noisy or blurry images. Various data augmentation methods have been recently proposed to improve DNN's robustness against common…

计算机视觉与模式识别 · 计算机科学 2023-11-01 Shahbaz Rezaei , Mohammad Sadegh Norouzzadeh

To achieve the low latency, high throughput, and energy efficiency benefits of Spiking Neural Networks (SNNs), reducing the memory and compute requirements when running on a neuromorphic hardware is an important step. Neuromorphic…

神经与进化计算 · 计算机科学 2021-08-25 Hin Wai Lui , Emre Neftci

Modern machine learning pipelines leverage large amounts of public data, making it infeasible to guarantee data quality and leaving models open to poisoning and backdoor attacks. Provably bounding model behavior under such attacks remains…

机器学习 · 计算机科学 2024-10-31 Philip Sosnin , Mark N. Müller , Maximilian Baader , Calvin Tsay , Matthew Wicker

Machine learning-based embedded systems employed in safety-critical applications such as aerospace and autonomous driving need to be robust against perturbations produced by soft errors. Soft errors are an increasing concern in modern…

机器学习 · 计算机科学 2024-12-06 Jon Gutiérrez-Zaballa , Koldo Basterretxea , Javier Echanobe

Deep neural networks (DNNs) have achieved remarkable performance across a wide range of applications, while they are vulnerable to adversarial examples, which motivates the evaluation and benchmark of model robustness. However, current…

计算机视觉与模式识别 · 计算机科学 2022-11-02 Jun Guo , Wei Bao , Jiakai Wang , Yuqing Ma , Xinghai Gao , Gang Xiao , Aishan Liu , Jian Dong , Xianglong Liu , Wenjun Wu

Deep Neural Network (DNN) models have vulnerabilities related to security concerns, with attackers usually employing complex hacking techniques to expose their structures. Data poisoning-enabled perturbation attacks are complex adversarial…

计算机视觉与模式识别 · 计算机科学 2020-12-10 Mohammed Hassanin , Ibrahim Radwan , Nour Moustafa , Murat Tahtali , Neeraj Kumar

We consider adversarial training of deep neural networks through the lens of Bayesian learning, and present a principled framework for adversarial training of Bayesian Neural Networks (BNNs) with certifiable guarantees. We rely on…

机器学习 · 计算机科学 2021-02-24 Matthew Wicker , Luca Laurenti , Andrea Patane , Zhoutong Chen , Zheng Zhang , Marta Kwiatkowska

Modern neural networks are undeniably successful. Numerous studies have investigated how the curvature of loss landscapes can affect the quality of solutions. In this work we consider the Hessian matrix during network training. We reiterate…

机器学习 · 计算机科学 2023-05-31 Lawrence Wang , Stephen J. Roberts

Deep convolutional neural network (DCNN for short) models are vulnerable to examples with small perturbations. Adversarial training (AT for short) is a widely used approach to enhance the robustness of DCNN models by data augmentation. In…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Jin Ding , Jie-Chao Zhao , Yong-Zhi Sun , Ping Tan , Ji-En Ma , You-Tong Fang

While neural networks have made significant strides in many AI tasks, they remain vulnerable to a range of noise types, including natural corruptions, adversarial noise, and low-resolution artifacts. Many existing approaches focus on…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Zhiling Zhou , Zirui Liu , Chengming Xu , Yanwei Fu , Xinwei Sun

Recent work has shown deep neural networks (DNNs) to be highly susceptible to well-designed, small perturbations at the input layer, or so-called adversarial examples. Taking images as an example, such distortions are often imperceptible,…

机器学习 · 计算机科学 2015-04-13 Shixiang Gu , Luca Rigazio

Recently, vision transformers and MLP-based models have been developed in order to address some of the prevalent weaknesses in convolutional neural networks. Due to the novelty of transformers being used in this domain along with the…

计算机视觉与模式识别 · 计算机科学 2021-07-06 Katelyn Morrison , Benjamin Gilby , Colton Lipchak , Adam Mattioli , Adriana Kovashka

With the increasing amount of available data and advances in computing capabilities, deep neural networks (DNNs) have been successfully employed to solve challenging tasks in various areas, including healthcare, climate, and finance.…

机器学习 · 计算机科学 2023-01-12 Marcele O. K. Mendonça , Javier Maroto , Pascal Frossard , Paulo S. R. Diniz

Deep neural network (DNN) architecture based models have high expressive power and learning capacity. However, they are essentially a black box method since it is not easy to mathematically formulate the functions that are learned within…

计算机视觉与模式识别 · 计算机科学 2018-03-02 Gaurav Goswami , Nalini Ratha , Akshay Agarwal , Richa Singh , Mayank Vatsa

Deep learning models are trained and deployed in multiple domains. Increasing usage of deep learning models alarms the usage of memory consumed while computation by deep learning models. Existing approaches for reducing memory consumption…

机器学习 · 计算机科学 2021-10-25 Mahendran N

Deep neural networks (DNNs) depend on the storage of a large number of parameters, which consumes an important portion of the energy used during inference. This paper considers the case where the energy usage of memory elements can be…

机器学习 · 计算机科学 2019-12-24 Sébastien Henwood , François Leduc-Primeau , Yvon Savaria

Vulnerability to adversarial attacks is one of the principal hurdles to the adoption of deep learning in safety-critical applications. Despite significant efforts, both practical and theoretical, training deep learning models robust to…

机器学习 · 计算机科学 2024-02-29 Luca Bortolussi , Ginevra Carbone , Luca Laurenti , Andrea Patane , Guido Sanguinetti , Matthew Wicker

For safety-critical applications such as autonomous driving, CNNs have to be robust with respect to unavoidable image corruptions, such as image noise. While previous works addressed the task of robust prediction in the context of…

计算机视觉与模式识别 · 计算机科学 2020-11-11 Christoph Kamann , Burkhard Güssefeld , Robin Hutmacher , Jan Hendrik Metzen , Carsten Rother