English
Related papers

Related papers: Data-free Backdoor Removal based on Channel Lipsch…

200 papers

Poisoning-based backdoor attacks expose vulnerabilities in the data preparation stage of deep neural network (DNN) training. The DNNs trained on the poisoned dataset will be embedded with a backdoor, making them behave well on clean data…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Binxiao Huang , Jason Chun Lok , Chang Liu , Ngai Wong

In order to protect the intellectual property (IP) of deep neural networks (DNNs), many existing DNN watermarking techniques either embed watermarks directly into the DNN parameters or insert backdoor watermarks by fine-tuning the DNN…

Cryptography and Security · Computer Science 2021-10-19 Xiangyu Zhao , Yinzhe Yao , Hanzhou Wu , Xinpeng Zhang

Low-precision deep neural network (DNN) training has gained tremendous attention as reducing precision is one of the most effective knobs for boosting DNNs' training time/energy efficiency. In this paper, we attempt to explore low-precision…

Machine Learning · Computer Science 2025-01-07 Yonggan Fu , Han Guo , Meng Li , Xin Yang , Yining Ding , Vikas Chandra , Yingyan Celine Lin

The most common method for DNN pruning is hard thresholding of network weights, followed by retraining to recover any lost accuracy. Recently developed smart pruning algorithms use the DNN response over the training set for a variety of…

Machine Learning · Computer Science 2019-05-23 Konstantinos Pitas , Mike Davies , Pierre Vandergheynst

While machine learning (ML) models are being increasingly trusted to make decisions in different and varying areas, the safety of systems using such models has become an increasing concern. In particular, ML models are often trained on data…

The mainstream approach for filter pruning is usually either to force a hard-coded importance estimation upon a computation-heavy pretrained model to select "important" filters, or to impose a hyperparameter-sensitive sparse constraint on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Mingbao Lin , Bohong Chen , Fei Chao , Rongrong Ji

Recent studies have revealed the vulnerability of deep neural networks (DNNs) to various backdoor attacks, where the behavior of DNNs can be compromised by utilizing certain types of triggers or poisoning mechanisms. State-of-the-art (SOTA)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Nazmul Karim , Abdullah Al Arafat , Umar Khalid , Zhishan Guo , Nazanin Rahnavard

Securing deep neural networks (DNNs) from side-channel attacks is an important problem as of today, given the substantial investment of time and resources in acquiring the raw data and training complex models. All published countermeasures…

Cryptography and Security · Computer Science 2024-07-19 Nivedita Shrivastava , Smruti R. Sarangi

The Convolutional Neural Networks (CNNs) have emerged as a very powerful data dependent hierarchical feature extraction method. It is widely used in several computer vision problems. The CNNs learn the important visual features from…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Jayendra Kantipudi , Shiv Ram Dubey , Soumendu Chakraborty

Existing methods for reducing the computational burden of neural networks at run-time, such as parameter pruning or dynamic computational path selection, focus solely on improving computational efficiency during inference. On the other…

Machine Learning · Computer Science 2019-05-17 Simeon E. Spasov , Pietro Lio

Channel pruning has demonstrated its effectiveness in compressing ConvNets. In many related arts, the importance of an output feature map is only determined by its associated filter. However, these methods ignore a small part of weights in…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Yangchun Yan , Rongzuo Guo , Chao Li , Kang Yang , Yongjun Xu

Vision-Language models like CLIP have been shown to be highly effective at linking visual perception and natural language understanding, enabling sophisticated image-text capabilities, including strong retrieval and zero-shot classification…

Machine Learning · Computer Science 2026-04-08 Naman Deep Singh , Francesco Croce , Matthias Hein

While Deep Neural Networks (DNNs) excel in many tasks, the huge training resources they require become an obstacle for practitioners to develop their own models. It has become common to collect data from the Internet or hire a third party…

Machine Learning · Computer Science 2022-03-15 Pengfei Xia , Hongjing Niu , Ziqiang Li , Bin Li

Backdoor attacks threaten Deep Neural Networks (DNNs). Towards stealthiness, researchers propose clean-label backdoor attacks, which require the adversaries not to alter the labels of the poisoned training datasets. Clean-label settings…

Cryptography and Security · Computer Science 2022-06-13 Nan Luo , Yuanzhang Li , Yajie Wang , Shangbo Wu , Yu-an Tan , Quanxin Zhang

Channel pruning is among the predominant approaches to compress deep neural networks. To this end, most existing pruning methods focus on selecting channels (filters) by importance/optimization or regularization based on rule-of-thumb…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Mingbao Lin , Rongrong Ji , Yuxin Zhang , Baochang Zhang , Yongjian Wu , Yonghong Tian

Structured pruning methods are developed to bridge the gap between the massive scale of neural networks and the limited hardware resources. Most current structured pruning methods rely on training datasets to fine-tune the compressed model,…

Machine Learning · Computer Science 2024-03-14 Siqi Li , Jun Chen , Jingyang Xiang , Chengrui Zhu , Yong Liu

Deep neural networks (DNN) have shown great success in many computer vision applications. However, they are also known to be susceptible to backdoor attacks. When conducting backdoor attacks, most of the existing approaches assume that the…

Cryptography and Security · Computer Science 2020-09-16 Haoliang Li , Yufei Wang , Xiaofei Xie , Yang Liu , Shiqi Wang , Renjie Wan , Lap-Pui Chau , Alex C. Kot

Deep Neural Networks (DNNs) are vulnerable to backdoor attacks. Due to the nature of Machine Learning as a Service (MLaaS) applications, black-box defenses are more practical than white-box methods, yet existing purification techniques…

Cryptography and Security · Computer Science 2026-03-31 Abdullah Arafat Miah , Yu Bi

We investigate robustness of deep feed-forward neural networks when input data are subject to random uncertainties. More specifically, we consider regularization of the network by its Lipschitz constant and emphasize its role. We highlight…

Machine Learning · Computer Science 2019-04-15 Nicolas Couellan

Despite recent success, state-of-the-art learning-based models remain highly vulnerable to input changes such as adversarial examples. In order to obtain certifiable robustness against such perturbations, recent work considers…

Machine Learning · Computer Science 2023-09-13 Max Losch , David Stutz , Bernt Schiele , Mario Fritz