English
Related papers

Related papers: QuantAttack: Exploiting Dynamic Quantization to At…

200 papers

Deep neural network (DNN) as a popular machine learning model is found to be vulnerable to adversarial attack. This attack constructs adversarial examples by adding small perturbations to the raw input, while appearing unmodified to human…

Machine Learning · Computer Science 2018-09-14 Pengcheng Li , Jinfeng Yi , Lijun Zhang

The increasing amount of data processed on edge and the demand for reducing the energy consumption for large neural network architectures have initiated the transition from traditional von Neumann architectures towards in-memory computing…

Emerging Technologies · Computer Science 2022-09-27 O. Krestinskaya , L. Zhang , K. N. Salama

Quantization is a promising technique for reducing the bit-width of deep models to improve their runtime performance and storage efficiency, and thus becomes a fundamental step for deployment. In real-world scenarios, quantized models are…

Machine Learning · Computer Science 2024-04-09 Qun Li , Yuan Meng , Chen Tang , Jiacheng Jiang , Zhi Wang

The diffusion model has gained popularity in vision applications due to its remarkable generative performance and versatility. However, high storage and computation demands, resulting from the model size and iterative generation, hinder its…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Junhyuk So , Jungwon Lee , Daehyun Ahn , Hyungjun Kim , Eunhyeok Park

Adversarial examples have emerged as a significant threat to machine learning algorithms, especially to the convolutional neural networks (CNNs). In this paper, we propose two quantization-based defense mechanisms, Constant Quantization…

Machine Learning · Computer Science 2020-05-15 Faiq Khalid , Hassan Ali , Hammad Tariq , Muhammad Abdullah Hanif , Semeen Rehman , Rehan Ahmed , Muhammad Shafique

Quantized deep neural networks (QDNNs) are necessary for low-power, high throughput, and embedded applications. Previous studies mostly focused on developing optimization methods for the quantization of given models. However, quantization…

Machine Learning · Computer Science 2020-06-02 Yoonho Boo , Sungho Shin , Wonyong Sung

Deep Neural Networks (DNNs) are known to be vulnerable to adversarial examples. Further, these adversarial examples are found to be transferable from the source network in which they are crafted to a black-box target network. As the trend…

Machine Learning · Computer Science 2024-05-17 Abhishek Shrestha , Jürgen Großmann

As soon as abstract mathematical computations were adapted to computation on digital computers, the problem of efficient representation, manipulation, and communication of the numerical values in those computations arose. Strongly related…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Amir Gholami , Sehoon Kim , Zhen Dong , Zhewei Yao , Michael W. Mahoney , Kurt Keutzer

Deep neural networks are vulnerable to adversarial examples that mislead the models with imperceptible perturbations. Though adversarial attacks have achieved incredible success rates in the white-box setting, most existing adversaries…

Artificial Intelligence · Computer Science 2021-08-16 Xiaosen Wang , Kun He

Quantization has emerged as an essential technique for deploying deep neural networks (DNNs) on devices with limited resources. However, quantized models exhibit vulnerabilities when exposed to various noises in real-world applications.…

Machine Learning · Computer Science 2023-08-07 Yisong Xiao , Aishan Liu , Tianyuan Zhang , Haotong Qin , Jinyang Guo , Xianglong Liu

Deep neural networks are the state-of-the-art methods for many real-world tasks, such as computer vision, natural language processing and speech recognition. For all its popularity, deep neural networks are also criticized for consuming a…

Machine Learning · Computer Science 2018-12-18 Yunhui Guo

With unprecedented rapid development, deep neural networks (DNNs) have deeply influenced almost all fields. However, their heavy computation costs and model sizes are usually unacceptable in real-world deployment. Model quantization, an…

Machine Learning · Computer Science 2025-05-12 Kai Liu , Qian Zheng , Kaiwen Tao , Zhiteng Li , Haotong Qin , Wenbo Li , Yong Guo , Xianglong Liu , Linghe Kong , Guihai Chen , Yulun Zhang , Xiaokang Yang

Adversarial transferability enables black-box attacks on unknown victim deep neural networks (DNNs), rendering attacks viable in real-world scenarios. Current transferable attacks create adversarial perturbation over the entire image,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Shangbo Wu , Yu-an Tan , Yajie Wang , Ruinan Ma , Wencong Ma , Yuanzhang Li

The growing computational demand for deep neural networks ( DNNs) has raised concerns about their energy consumption and carbon footprint, particularly as the size and complexity of the models continue to increase. To address these…

Cryptography and Security · Computer Science 2025-03-10 Hanene F. Z. Brachemi Meftah , Wassim Hamidouche , Sid Ahmed Fezza , Olivier Deforges

Despite their tremendous success in modelling high-dimensional data manifolds, deep neural networks suffer from the threat of adversarial attacks - Existence of perceptually valid input-like samples obtained through careful perturbation…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Vinay Kyatham , Mayank Mishra , Tarun Kumar Yadav , Deepak Mishra , Prathosh AP

Quantization is emerging as an efficient approach to promote hardware-friendly deep learning and run deep neural networks on resource-limited hardware. However, it still causes a significant decrease to the network in accuracy. We summarize…

Machine Learning · Computer Science 2021-12-03 Haotong Qin

Model stealing attacks have become a serious concern for deep learning models, where an attacker can steal a trained model by querying its black-box API. This can lead to intellectual property theft and other security and privacy risks. The…

Machine Learning · Computer Science 2023-09-12 Kacem Khaled , Mouna Dhaouadi , Felipe Gohring de Magalhães , Gabriela Nicolescu

Reducing the size of neural network models is a critical step in moving AI from a cloud-centric to an edge-centric (i.e. on-device) compute paradigm. This shift from cloud to edge is motivated by a number of factors including reduced…

Machine Learning · Computer Science 2022-01-24 Micah Gorsline , James Smith , Cory Merkel

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In previous studies, the use of models encrypted with a secret key was demonstrated to be robust against white-box attacks, but not against black-box…

Artificial Intelligence · Computer Science 2024-02-13 Ryota Iijima , Sayaka Shiota , Hitoshi Kiya

Deep Neural Networks (DNNs) have gained considerable attention in the past decades due to their astounding performance in different applications, such as natural language modeling, self-driving assistance, and source code understanding.…

Machine Learning · Computer Science 2022-04-12 Qiang Hu , Yuejun Guo , Maxime Cordy , Xiaofei Xie , Wei Ma , Mike Papadakis , Yves Le Traon