中文
相关论文

相关论文: RA-BNN: Constructing Robust & Accurate Binary Neur…

200 篇论文

While hardware implementations of inference routines for Binarized Neural Networks (BNNs) are plentiful, current realizations of efficient BNN hardware training accelerators, suitable for Internet of Things (IoT) edge devices, leave much to…

计算机视觉与模式识别 · 计算机科学 2021-02-18 Corey Lammie , Wei Xiang , Mostafa Rahimi Azghadi

Deep neural networks (DNNs) have achieved remarkable performance across a wide range of applications, while they are vulnerable to adversarial examples, which motivates the evaluation and benchmark of model robustness. However, current…

计算机视觉与模式识别 · 计算机科学 2022-11-02 Jun Guo , Wei Bao , Jiakai Wang , Yuqing Ma , Xinghai Gao , Gang Xiao , Aishan Liu , Jian Dong , Xianglong Liu , Wenjun Wu

Robustness to adversarial attacks was shown to require a larger model capacity, and thus a larger memory footprint. In this paper, we introduce an approach to obtain robust yet compact models by pruning randomly-initialized binary networks.…

机器学习 · 计算机科学 2022-10-18 Chen Liu , Ziqi Zhao , Sabine Süsstrunk , Mathieu Salzmann

The idea of robustness is central and critical to modern statistical analysis. However, despite the recent advances of deep neural networks (DNNs), many studies have shown that DNNs are vulnerable to adversarial attacks. Making…

密码学与安全 · 计算机科学 2023-06-02 Jungeum Kim , Xiao Wang

Bayesian neural networks (BNNs) demonstrate promising success in improving the robustness and uncertainty quantification of modern deep learning. However, they generally struggle with underfitting at scale and parameter efficiency. On the…

The advent of deep learning has considerably accelerated machine learning development. The deployment of deep neural networks at the edge is however limited by their high memory and energy consumption requirements. With new memory…

Adversarial images are designed to mislead deep neural networks (DNNs), attracting great attention in recent years. Although several defense strategies achieved encouraging robustness against adversarial samples, most of them fail to…

机器学习 · 计算机科学 2020-02-25 Hang Yu , Aishan Liu , Xianglong Liu , Gengchao Li , Ping Luo , Ran Cheng , Jichen Yang , Chongzhi Zhang

1 bit deep neural networks (DNNs), of which both the activations and weights are binarized , are attracting more and more attention due to their high computational efficiency and low memory requirement . However, the drawback of large…

计算机视觉与模式识别 · 计算机科学 2019-07-12 Biao Qian , Yang Wang

This project explores adversarial training techniques to develop fairer Deep Neural Networks (DNNs) to mitigate the inherent bias they are known to exhibit. DNNs are susceptible to inheriting bias with respect to sensitive attributes such…

机器学习 · 计算机科学 2024-01-05 Allen Minch , Hung Anh Vu , Anne Marie Warren

We propose a new algorithm for training deep neural networks (DNNs) with binary weights. In particular, we first cast the problem of training binary neural networks (BiNNs) as a bilevel optimization instance and subsequently construct…

机器学习 · 计算机科学 2021-12-07 Huu Le , Rasmus Kjær Høier , Che-Tsung Lin , Christopher Zach

Binary Neural Networks (BNNs) enable efficient deep learning by saving on storage and computational costs. However, as the size of neural networks continues to grow, meeting computational requirements remains a challenge. In this work, we…

机器学习 · 计算机科学 2024-07-18 Matt Gorbett , Hossein Shirazi , Indrakshi Ray

Beyond its highly publicized victories in Go, there have been numerous successful applications of deep learning in information retrieval, computer vision and speech recognition. In cybersecurity, an increasing number of companies have…

机器学习 · 计算机科学 2017-04-28 Qinglong Wang , Wenbo Guo , Kaixuan Zhang , Alexander G. Ororbia , Xinyu Xing , C. Lee Giles , Xue Liu

Deep neural networks (DNNs) are state-of-the-art algorithms for multiple applications, spanning from image classification to speech recognition. While providing excellent accuracy, they often have enormous compute and memory requirements.…

机器学习 · 计算机科学 2020-11-12 Ussama Zahid , Giulio Gambardella , Nicholas J. Fraser , Michaela Blott , Kees Vissers

Adversarial attacks have received increasing attention and it has been widely recognized that classical DNNs have weak adversarial robustness. The most commonly used adversarial defense method, adversarial training, improves the adversarial…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Nuolin Sun , Linyuan Wang , Dongyang Li , Bin Yan , Lei Li

We propose Radial Bayesian Neural Networks (BNNs): a variational approximate posterior for BNNs which scales well to large models while maintaining a distribution over weight-space with full support. Other scalable Bayesian deep learning…

机器学习 · 统计学 2021-06-01 Sebastian Farquhar , Michael Osborne , Yarin Gal

Deep Neural Networks (DNNs) have gained immense success in cognitive applications and greatly pushed today's artificial intelligence forward. The biggest challenge in executing DNNs is their extremely data-extensive computations. The…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Fuqiang Liu , C. Liu

The remarkable performance of deep learning has sparked the rise of Deep Learning as a Service (DLaaS), allowing clients to send their personal data to service providers for model predictions. A persistent challenge in this context is…

密码学与安全 · 计算机科学 2025-08-12 Xin Chen , Zhili Chen , Shiwen Wei , Junqing Gong , Lin Chen

In this paper, we introduce BNN-DP, an efficient algorithmic framework for analysis of adversarial robustness of Bayesian Neural Networks (BNNs). Given a compact set of input points $T\subset \mathbb{R}^n$, BNN-DP computes lower and upper…

机器学习 · 计算机科学 2023-06-21 Steven Adams , Andrea Patane , Morteza Lahijanian , Luca Laurenti

Deep neural networks (DNNs), which support services such as driving assistants and medical diagnoses, undergo lengthy and expensive training procedures. Therefore, the training's outcome - the DNN weights - represents a significant…

密码学与安全 · 计算机科学 2026-01-14 Lorenzo Casalino , Maria Méndez Real , Jean-Christophe Prévotet , Rubén Salvador

Deep Neural Networks (DNNs) have been shown to be vulnerable to adversarial examples. While numerous successful adversarial attacks have been proposed, defenses against these attacks remain relatively understudied. Existing defense…

机器学习 · 计算机科学 2025-06-17 Furkan Mumcu , Yasin Yilmaz