中文
相关论文

相关论文: Improving the Robustness of Quantized Deep Neural …

200 篇论文

Adversarial perturbations dramatically decrease the accuracy of state-of-the-art image classifiers. In this paper, we propose and analyze a simple and computationally efficient defense strategy: inject random Gaussian noise, discretize each…

机器学习 · 计算机科学 2019-03-27 Yuchen Zhang , Percy Liang

Despite the functional success of deep neural networks (DNNs), their trustworthiness remains a crucial open challenge. To address this challenge, both testing and verification techniques have been proposed. But these existing techniques…

机器学习 · 计算机科学 2021-03-24 Teodora Baluta , Zheng Leong Chua , Kuldeep S. Meel , Prateek Saxena

As deep neural networks (DNNs) see increased deployment on mobile and edge devices, optimizing model efficiency has become crucial. Mixed-precision quantization is widely favored, as it offers a superior balance between efficiency and…

机器学习 · 计算机科学 2025-07-31 Seokho Han , Seoyeon Yoon , Jinhee Kim , Dongwei Wang , Kang Eun Jeon , Huanrui Yang , Jong Hwan Ko

In the past few years, an increasing number of machine-learning and deep learning structures, such as Convolutional Neural Networks (CNNs), have been applied to solving a wide range of real-life problems. However, these architectures are…

密码学与安全 · 计算机科学 2021-07-30 Amira Guesmi , Ihsen Alouani , Khaled Khasawneh , Mouna Baklouti , Tarek Frikha , Mohamed Abid , Nael Abu-Ghazaleh

Deep neural networks (DNNs) are increasingly being applied in malware detection and their robustness has been widely debated. Traditionally an adversarial example generation scheme relies on either detailed model information (gradient-based…

密码学与安全 · 计算机科学 2022-09-07 Sun RuiJin , Guo ShiZe , Guo JinHong , Xing ChangYou , Yang LuMing , Guo Xi , Pan ZhiSong

In this era of machine learning models, their functionality is being threatened by adversarial attacks. In the face of this struggle for making artificial neural networks robust, finding a model, resilient to these attacks, is very…

神经与进化计算 · 计算机科学 2019-05-08 Saima Sharmin , Priyadarshini Panda , Syed Shakib Sarwar , Chankyu Lee , Wachirawit Ponghiran , Kaushik Roy

Deep neural network (DNN) accelerators received considerable attention in recent years due to the potential to save energy compared to mainstream hardware. Low-voltage operation of DNN accelerators allows to further reduce energy…

机器学习 · 计算机科学 2022-06-09 David Stutz , Nandhini Chandramoorthy , Matthias Hein , Bernt Schiele

The biggest challenge for the deployment of Deep Neural Networks (DNNs) close to the generated data on edge devices is their size, i.e., memory footprint and computational complexity. Both are significantly reduced with quantization. With…

机器学习 · 计算机科学 2022-10-17 Cecilia Latotzke , Batuhan Balim , Tobias Gemmeke

The complexity of deep neural network algorithms for hardware implementation can be much lowered by optimizing the word-length of weights and signals. Direct quantization of floating-point weights, however, does not show good performance…

机器学习 · 计算机科学 2016-01-08 Wonyong Sung , Sungho Shin , Kyuyeon Hwang

Neural network quantization methods often involve simulating the quantization process during training, making the trained model highly dependent on the target bit-width and precise way quantization is performed. Robust quantization offers…

机器学习 · 计算机科学 2020-10-23 Moran Shkolnik , Brian Chmiel , Ron Banner , Gil Shomron , Yury Nahshan , Alex Bronstein , Uri Weiser

Deep neural networks (DNNs) have proven to be powerful predictors and are widely used for various tasks. Credible uncertainty estimation of their predictions, however, is crucial for their deployment in many risk-sensitive applications. In…

机器学习 · 计算机科学 2021-12-03 Ido Galil , Ran El-Yaniv

Enabling low precision implementations of deep learning models, without considerable performance degradation, is necessary in resource and latency constrained settings. Moreover, exploiting the differences in sensitivity to quantization…

机器学习 · 计算机科学 2022-10-28 Ignacio Hounie , Juan Elenter , Alejandro Ribeiro

Deep Neural Networks (DNNs) are vulnerable to the black-box adversarial attack that is highly transferable. This threat comes from the distribution gap between adversarial and clean samples in feature space of the target DNNs. In this…

计算机视觉与模式识别 · 计算机科学 2022-12-13 Xiaogang Xu , Hengshuang Zhao , Philip Torr , Jiaya Jia

We consider adversarial training of deep neural networks through the lens of Bayesian learning, and present a principled framework for adversarial training of Bayesian Neural Networks (BNNs) with certifiable guarantees. We rely on…

机器学习 · 计算机科学 2021-02-24 Matthew Wicker , Luca Laurenti , Andrea Patane , Zhoutong Chen , Zheng Zhang , Marta Kwiatkowska

Deep neural networks (DNNs) have achieved remarkable success in diverse fields. However, it has been demonstrated that DNNs are very vulnerable to adversarial examples even in black-box settings. A large number of black-box attack methods…

机器学习 · 计算机科学 2022-03-29 Junjie Fu , Jian Sun , Gang Wang

Deep neural networks (DNNs) are known to be vulnerable to adversarial attacks. A range of defense methods have been proposed to train adversarially robust DNNs, among which adversarial training has demonstrated promising results. However,…

机器学习 · 计算机科学 2022-01-25 Hanxun Huang , Yisen Wang , Sarah Monazam Erfani , Quanquan Gu , James Bailey , Xingjun Ma

Deep Learning models hold state-of-the-art performance in many fields, but their vulnerability to adversarial examples poses threat to their ubiquitous deployment in practical settings. Additionally, adversarial inputs generated on one…

机器学习 · 计算机科学 2021-03-31 Deepak Ravikumar , Sangamesh Kodge , Isha Garg , Kaushik Roy

As deep neural networks (DNNs) have become increasingly important and popular, the robustness of DNNs is the key to the safety of both the Internet and the physical world. Unfortunately, some recent studies show that adversarial examples,…

计算机视觉与模式识别 · 计算机科学 2019-06-18 Yifan Ding , Liqiang Wang , Huan Zhang , Jinfeng Yi , Deliang Fan , Boqing Gong

Deep neural networks learn fragile "shortcut" features, rendering them difficult to interpret (black box) and vulnerable to adversarial attacks. This paper proposes semantic features as a general architectural solution to this problem. The…

机器学习 · 计算机科学 2024-04-18 Maciej Satkiewicz

Despite the achievements of recent binarization methods on reducing the performance degradation of Binary Neural Networks (BNNs), gradient mismatching caused by the Straight-Through-Estimator (STE) still dominates quantized networks. This…

计算机视觉与模式识别 · 计算机科学 2020-09-11 Junjie Liu , Dongchao Wen , Deyu Wang , Wei Tao , Tse-Wei Chen , Kinya Osa , Masami Kato