English
Related papers

Related papers: Impact of Low-bitwidth Quantization on the Adversa…

200 papers

Thanks to their extensive capacity, over-parameterized neural networks exhibit superior predictive capabilities and generalization. However, having a large parameter space is considered one of the main suspects of the neural networks'…

The role of quantization within implicit/coordinate neural networks is still not fully understood. We note that using a canonical fixed quantization scheme during training produces poor performance at low-rates due to the network weight…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Cameron Gordon , Shin-Fang Chng , Lachlan MacDonald , Simon Lucey

Quantized neural networks (NN) are the common standard to efficiently deploy deep learning models on tiny hardware platforms. However, we notice that quantized NNs are as vulnerable to adversarial attacks as the full-precision models. With…

Machine Learning · Computer Science 2021-05-17 Lorena Qendro , Sangwon Ha , René de Jong , Partha Maji

Despite their tremendous success in modelling high-dimensional data manifolds, deep neural networks suffer from the threat of adversarial attacks - Existence of perceptually valid input-like samples obtained through careful perturbation…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Vinay Kyatham , Mayank Mishra , Tarun Kumar Yadav , Deepak Mishra , Prathosh AP

Neural network quantization methods often involve simulating the quantization process during training, making the trained model highly dependent on the target bit-width and precise way quantization is performed. Robust quantization offers…

Machine Learning · Computer Science 2020-10-23 Moran Shkolnik , Brian Chmiel , Ron Banner , Gil Shomron , Yury Nahshan , Alex Bronstein , Uri Weiser

Recently, adversarial deception becomes one of the most considerable threats to deep neural networks. However, compared to extensive research in new designs of various adversarial attacks and defenses, the neural networks' intrinsic…

Machine Learning · Computer Science 2019-05-13 Fuxun Yu , Zhuwei Qin , Chenchen Liu , Liang Zhao , Yanzhi Wang , Xiang Chen

Quantized neural network (NN) with a reduced bit precision is an effective solution to reduces the computational and memory resource requirements and plays a vital role in machine learning. However, it is still challenging to avoid the…

Machine Learning · Computer Science 2020-10-23 Xiaobin Li , Hongxu Jiang , Shuangxi Huang , Fangzheng Tian

Quantum classifiers are vulnerable to adversarial attacks that manipulate their input classical or quantum data. A promising countermeasure is adversarial training, where quantum classifiers are trained by using an attack-aware, adversarial…

Quantum Physics · Physics 2025-04-25 Petros Georgiou , Aaron Mark Thomas , Sharu Theresa Jose , Osvaldo Simeone

Recent advancements in quantum computing have led to the emergence of hybrid quantum neural networks, such as Quanvolutional Neural Networks (QuNNs), which integrate quantum and classical layers. While the susceptibility of classical neural…

Quantum Physics · Physics 2024-07-08 Walid El Maouaki , Alberto Marchisio , Taoufik Said , Muhammad Shafique , Mohamed Bennai

Adversarial examples have emerged as a significant threat to machine learning algorithms, especially to the convolutional neural networks (CNNs). In this paper, we propose two quantization-based defense mechanisms, Constant Quantization…

Machine Learning · Computer Science 2020-05-15 Faiq Khalid , Hassan Ali , Hammad Tariq , Muhammad Abdullah Hanif , Semeen Rehman , Rehan Ahmed , Muhammad Shafique

Adversarial attacks pose significant challenges to the robustness of modern deep neural networks in computer vision, and defending these networks against adversarial attacks has attracted intense research efforts. Among various defense…

Machine Learning · Computer Science 2025-07-11 Zhiyi Dong , Yongyi Mao

Quantization is a popular technique that $transforms$ the parameter representation of a neural network from floating-point numbers into lower-precision ones ($e.g.$, 8-bit integers). It reduces the memory footprint and the computational…

Machine Learning · Computer Science 2021-11-12 Sanghyun Hong , Michael-Andrei Panaitescu-Liess , Yiğitcan Kaya , Tudor Dumitraş

The vulnerability of deep neural networks against adversarial examples - inputs with small imperceptible perturbations - has gained a lot of attention in the research community recently. Simultaneously, the number of parameters of…

Machine Learning · Computer Science 2021-08-20 Florian Merkle , Maximilian Samsinger , Pascal Schöttle

Leveraging the unique properties of quantum mechanics, Quantum Machine Learning (QML) promises computational breakthroughs and enriched perspectives where traditional systems reach their boundaries. However, similarly to classical machine…

Quantum Physics · Physics 2023-12-22 David Winderl , Nicola Franco , Jeanette Miriam Lorenz

The intensive computation and memory requirements of generative adversarial neural networks (GANs) hinder its real-world deployment on edge devices such as smartphones. Despite the success in model reduction of CNNs, neural network…

Neural and Evolutionary Computing · Computer Science 2019-01-25 Peiqi Wang , Dongsheng Wang , Yu Ji , Xinfeng Xie , Haoxuan Song , XuXin Liu , Yongqiang Lyu , Yuan Xie

Vulnerability to adversarial attacks is a well-known weakness of Deep Neural networks. While most of the studies focus on single-task neural networks with computer vision datasets, very little research has considered complex multi-task…

Machine Learning · Computer Science 2021-10-29 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

Neural networks trained on visual data are well-known to be vulnerable to often imperceptible adversarial perturbations. The reasons for this vulnerability are still being debated in the literature. Recently Ilyas et al. (2019) showed that…

Machine Learning · Computer Science 2021-02-11 Jacob M. Springer , Melanie Mitchell , Garrett T. Kenyon

Deep neural networks are vulnerable to adversarial examples, which becomes one of the most important research problems in the development of deep learning. While a lot of efforts have been made in recent years, it is of great significance…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Yinpeng Dong , Qi-An Fu , Xiao Yang , Tianyu Pang , Hang Su , Zihao Xiao , Jun Zhu

Quantization is emerging as an efficient approach to promote hardware-friendly deep learning and run deep neural networks on resource-limited hardware. However, it still causes a significant decrease to the network in accuracy. We summarize…

Machine Learning · Computer Science 2021-12-03 Haotong Qin

Adversarial machine learning is an emerging field that focuses on studying vulnerabilities of machine learning approaches in adversarial settings and developing techniques accordingly to make learning robust to adversarial manipulations. It…

Quantum Physics · Physics 2020-08-11 Sirui Lu , Lu-Ming Duan , Dong-Ling Deng