English
Related papers

Related papers: Linearizing Models for Efficient yet Robust Privat…

200 papers

Text-to-image diffusion models have demonstrated remarkable effectiveness in rapid and high-fidelity personalization, even when provided with only a few user images. However, the effectiveness of personalization techniques has lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Naresh Kumar Devulapally , Shruti Agarwal , Tejas Gokhale , Vishnu Suresh Lokhande

Deep networks were recently suggested to face the odds between accuracy (on clean natural images) and robustness (on adversarially perturbed images) (Tsipras et al., 2019). Such a dilemma is shown to be rooted in the inherently higher…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Ting-Kuei Hu , Tianlong Chen , Haotao Wang , Zhangyang Wang

It has been shown that the majority of existing adversarial defense methods achieve robustness at the cost of sacrificing prediction accuracy. The undesirable severe drop in accuracy adversely affects the reliability of machine learning…

Cryptography and Security · Computer Science 2020-11-05 Jiawei Du , Hanshu Yan , Vincent Y. F. Tan , Joey Tianyi Zhou , Rick Siow Mong Goh , Jiashi Feng

Test-time defenses are used to improve the robustness of deep neural networks to adversarial examples during inference. However, existing methods either require an additional trained classifier to detect and correct the adversarial samples,…

Machine Learning · Computer Science 2024-08-26 Anurag Singh , Mahalakshmi Sabanayagam , Krikamol Muandet , Debarghya Ghoshdastidar

Recently, heatmap regression models have become popular due to their superior performance in locating facial landmarks. However, three major problems still exist among these models: (1) they are computationally expensive; (2) they usually…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Haibo Jin , Shengcai Liao , Ling Shao

We propose ReDense as a simple and low complexity way to improve the performance of trained neural networks. We use a combination of random weights and rectified linear unit (ReLU) activation function to add a ReLU dense (ReDense) layer to…

Machine Learning · Computer Science 2020-10-27 Alireza M. Javid , Sandipan Das , Mikael Skoglund , Saikat Chatterjee

Recent works have brought attention to the vulnerability of Federated Learning (FL) systems to gradient leakage attacks. Such attacks exploit clients' uploaded gradients to reconstruct their sensitive data, thereby compromising the privacy…

Machine Learning · Computer Science 2025-06-11 Mingyuan Fan , Cen Chen , Chengyu Wang , Xiaodan Li , Wenmeng Zhou

A family of super deep networks, referred to as residual networks or ResNet, achieved record-beating performance in various visual tasks such as image recognition, object detection, and semantic segmentation. The ability to train very deep…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Xin Yu , Zhiding Yu , Srikumar Ramalingam

Neural network models have been very successful at achieving high accuracy on natural language inference (NLI) tasks. However, as demonstrated in recent literature, when tested on some simple adversarial examples, most of the models suffer…

Computation and Language · Computer Science 2019-09-04 Alexander Hanbo Li , Abhinav Sethy

Recent work using Fully Homomorphic Encryption (FHE) has made non-interactive privacy-preserving inference of deep Convolutional Neural Networks (CNN) possible. However, the performance of these methods remain limited by their heavy…

Cryptography and Security · Computer Science 2026-02-10 Eduardo Chielle , Manaar Alam , Jinting Liu , Jovan Kascelan , Michail Maniatakos

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

Machine Learning · Statistics 2019-12-13 Wieland Brendel , Jonas Rauber , Matthias Kümmerer , Ivan Ustyuzhaninov , Matthias Bethge

ReLU activations are the main bottleneck in Private Inference that is based on ResNet networks. This is because they incur significant inference latency. Reducing ReLU count is a discrete optimization problem, and there are two common ways…

Machine Learning · Computer Science 2025-11-18 Vlad Rakhlin , Amir Jevnisek , Shai Avidan

Gradient leakage has been identified as a potential source of privacy breaches in modern image processing systems, where the adversary can completely reconstruct the training images from leaked gradients. However, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jiayang Meng , Tao Huang , Hong Chen , Cuiping Li

Many current Internet services rely on inferences from models trained on user data. Commonly, both the training and inference tasks are carried out using cloud resources fed by personal data collected at scale from users. Holding and using…

Machine Learning · Computer Science 2018-04-04 Sandra Servia-Rodriguez , Liang Wang , Jianxin R. Zhao , Richard Mortier , Hamed Haddadi

Learning diverse features is key to the success of person re-identification. Various part-based methods have been extensively proposed for learning local representations, which, however, are still inferior to the best-performing methods for…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Ben Xie , Xiaofu Wu , Suofei Zhang , Shiliang Zhao , Ming Li

Recently, private inference (PI) has addressed the rising concern over data and model privacy in machine learning inference as a service. However, existing PI frameworks suffer from high computational and communication costs due to the…

Cryptography and Security · Computer Science 2023-04-27 Yuke Zhang , Dake Chen , Souvik Kundu , Haomei Liu , Ruiheng Peng , Peter A. Beerel

Linear $L_1$-regularized models have remained one of the simplest and most effective tools in data analysis, especially in information retrieval problems where n-grams over text with TF-IDF or Okapi feature values are a strong and easy…

Machine Learning · Computer Science 2023-03-21 Amol Khanna , Fred Lu , Edward Raff

Integer-arithmetic-only networks have been demonstrated effective to reduce computational cost and to ensure cross-platform consistency. However, previous works usually report a decline in the inference accuracy when converting well-trained…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Hengrui Zhao , Dong Liu , Houqiang Li

Adversarially robust models are locally smooth around each data sample so that small perturbations cannot drastically change model outputs. In modern systems, such smoothness is usually obtained via Adversarial Training, which explicitly…

Machine Learning · Computer Science 2024-10-01 Adrián Rodríguez-Muñoz , Tongzhou Wang , Antonio Torralba

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton