中文
相关论文

相关论文: Hessian-aware Training for Enhancing DNNs Resilien…

200 篇论文

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

机器学习 · 计算机科学 2019-04-03 Konstantin Posch , Jürgen Pilz

With an ever-growing number of parameters defining increasingly complex networks, Deep Learning has led to several breakthroughs surpassing human performance. As a result, data movement for these millions of model parameters causes a…

神经与进化计算 · 计算机科学 2023-04-12 Christopher Wolters , Brady Taylor , Edward Hanson , Xiaoxuan Yang , Ulf Schlichtmann , Yiran Chen

Trajectory prediction using deep neural networks (DNNs) is an essential component of autonomous driving (AD) systems. However, these methods are vulnerable to adversarial attacks, leading to serious consequences such as collisions. In this…

机器学习 · 计算机科学 2022-08-02 Yulong Cao , Danfei Xu , Xinshuo Weng , Zhuoqing Mao , Anima Anandkumar , Chaowei Xiao , Marco Pavone

Robust learning methods aim to learn a clean target distribution from noisy and corrupted training data where a specific corruption pattern is often assumed a priori. Our proposed method can not only successfully learn the clean target…

机器学习 · 计算机科学 2023-02-08 Jeongeun Park , Seungyoun Shin , Sangheum Hwang , Sungjoon Choi

In Hezaveh et al. 2017 we showed that deep learning can be used for model parameter estimation and trained convolutional neural networks to determine the parameters of strong gravitational lensing systems. Here we demonstrate a method for…

宇宙学与河外天体物理 · 物理学 2017-11-29 Laurence Perreault Levasseur , Yashar D. Hezaveh , Risa H. Wechsler

Deep neural networks (DNNs) have revolutionized the field of artificial intelligence and have achieved unprecedented success in cognitive tasks such as image and speech recognition. Training of large DNNs, however, is computationally…

Convolutional Neural Networks (CNNs) have become integral in safety-critical applications, thus raising concerns about their fault tolerance. Conventional hardware-dependent fault tolerance methods, such as Triple Modular Redundancy (TMR),…

We investigate the problem of learning Bayesian networks in a robust model where an $\epsilon$-fraction of the samples are adversarially corrupted. In this work, we study the fully observable discrete case where the structure of the network…

数据结构与算法 · 计算机科学 2018-10-30 Yu Cheng , Ilias Diakonikolas , Daniel Kane , Alistair Stewart

The human visual system is remarkably robust against a wide range of naturally occurring variations and corruptions like rain or snow. In contrast, the performance of modern image recognition models strongly degrades when evaluated on…

计算机视觉与模式识别 · 计算机科学 2020-07-23 Evgenia Rusak , Lukas Schott , Roland S. Zimmermann , Julian Bitterwolf , Oliver Bringmann , Matthias Bethge , Wieland Brendel

A human does not have to see all elephants to recognize an animal as an elephant. On contrast, current state-of-the-art deep learning approaches heavily depend on the variety of training samples and the capacity of the network. In practice,…

机器学习 · 计算机科学 2019-05-30 Shaokai Ye , Sia Huat Tan , Kaidi Xu , Yanzhi Wang , Chenglong Bao , Kaisheng Ma

Improving the resistance of deep neural networks against adversarial attacks is important for deploying models to realistic applications. However, most defense methods are designed to defend against intensity perturbations and ignore…

机器学习 · 计算机科学 2020-10-07 Pengfei Xia , Bin Li

Neural networks are known to be vulnerable to adversarial attacks -- slight but carefully constructed perturbations of the inputs which can drastically impair the network's performance. Many defense methods have been proposed for improving…

Distributed deep neural networks (DNNs) have emerged as a key technique to reduce communication overhead without sacrificing performance in edge computing systems. Recently, entropy coding has been introduced to further reduce the…

机器学习 · 计算机科学 2024-07-12 Milin Zhang , Mohammad Abdi , Shahriar Rifat , Francesco Restuccia

As deep neural networks (DNNs) are increasingly deployed in sensitive applications, ensuring their security and robustness has become critical. A major threat to DNNs arises from adversarial attacks, where small input perturbations can lead…

机器学习 · 计算机科学 2025-11-27 Erh-Chung Chen , Pin-Yu Chen , I-Hsin Chung , Che-Rung Lee

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

机器学习 · 统计学 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Deep Neural Networks (DNNs) have become the de-facto standard in computer vision, as well as in many other pattern recognition tasks. A key drawback of DNNs is that the training phase can be very computationally expensive. Organizations or…

计算机视觉与模式识别 · 计算机科学 2021-01-08 Debesh Jha , Anis Yazidi , Michael A. Riegler , Dag Johansen , Håvard D. Johansen , Pål Halvorsen

Deep neural networks (DNNs) are vulnerable to adversarial attack which is maliciously implemented by adding human-imperceptible perturbation to images and thus leads to incorrect prediction. Existing studies have proposed various methods to…

计算机视觉与模式识别 · 计算机科学 2019-08-07 Chen Ma , Chenxu Zhao , Hailin Shi , Li Chen , Junhai Yong , Dan Zeng

Beyond its highly publicized victories in Go, there have been numerous successful applications of deep learning in information retrieval, computer vision and speech recognition. In cybersecurity, an increasing number of companies have…

机器学习 · 计算机科学 2017-04-28 Qinglong Wang , Wenbo Guo , Kaixuan Zhang , Alexander G. Ororbia , Xinyu Xing , C. Lee Giles , Xue Liu

Deep Neural Networks (DNNs) are inherently computation-intensive and also power-hungry. Hardware accelerators such as Field Programmable Gate Arrays (FPGAs) are a promising solution that can satisfy these requirements for both embedded and…

Neuromorphic neural network processors, in the form of compute-in-memory crossbar arrays of memristors, or in the form of subthreshold analog and mixed-signal ASICs, promise enormous advantages in compute density and energy efficiency for…

机器学习 · 计算机科学 2022-06-14 Julian Büchel , Fynn Faber , Dylan R. Muir