English
Related papers

Related papers: Provable Privacy Attacks on Trained Shallow Neural…

200 papers

Backdoor attacks embed hidden functionalities in deep neural networks (DNN), triggering malicious behavior with specific inputs. Advanced defenses monitor anomalous DNN inferences to detect such attacks. However, concealed backdoors evade…

Cryptography and Security · Computer Science 2025-02-18 Manaar Alam , Hithem Lamri , Michail Maniatakos

Federated learning is a decentralized learning paradigm introduced to preserve privacy of client data. Despite this, prior work has shown that an attacker at the server can still reconstruct the private training data using only the client…

Cryptography and Security · Computer Science 2024-03-28 Joshua C. Zhao , Ahaan Dabholkar , Atul Sharma , Saurabh Bagchi

Gradient inversion attack enables recovery of training samples from model gradients in federated learning (FL), and constitutes a serious threat to data privacy. To mitigate this vulnerability, prior work proposed both principled defenses…

Machine Learning · Computer Science 2023-06-13 Ruihan Wu , Xiangyu Chen , Chuan Guo , Kilian Q. Weinberger

Reinforcement Learning (RL) enables agents to learn how to perform various tasks from scratch. In domains like autonomous driving, recommendation systems, and more, optimal RL policies learned could cause a privacy breach if the policies…

Machine Learning · Computer Science 2021-12-13 Kritika Prakash , Fiza Husain , Praveen Paruchuri , Sujit P. Gujar

Machine learning models' goal is to make correct predictions for specific tasks by learning important properties and patterns from data. By doing so, there is a chance that the model learns properties that are unrelated to its primary task.…

Cryptography and Security · Computer Science 2021-04-28 Mathias P. M. Parisot , Balazs Pejo , Dayana Spagnuelo

An important problem in deep learning is the privacy and security of neural networks (NNs). Both aspects have long been considered separately. To date, it is still poorly understood how privacy enhancing training affects the robustness of…

Cryptography and Security · Computer Science 2021-05-18 Franziska Boenisch , Philip Sperl , Konstantin Böttinger

Face recognition (FR) has been applied to nearly every aspect of daily life, but it is always accompanied by the underlying risk of leaking private information. At present, almost all attack models against FR rely heavily on the presence of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Yuanqing Huang , Huilong Chen , Yinggui Wang , Lei Wang

Data augmentation is widely used to mitigate data bias in the training dataset. However, data augmentation exposes machine learning models to privacy attacks, such as membership inference attacks. In this paper, we propose an effective…

Machine Learning · Computer Science 2024-04-23 Zhixin Pan , Emma Andrews , Laura Chang , Prabhat Mishra

Federated learning is emerging as a machine learning technique that trains a model across multiple decentralized parties. It is renowned for preserving privacy as the data never leaves the computational devices, and recent approaches…

Machine Learning · Computer Science 2021-06-25 Yuchen Li , Yifan Bao , Liyao Xiang , Junhan Liu , Cen Chen , Li Wang , Xinbing Wang

In this work, we study the implications of the implicit bias of gradient flow on generalization and adversarial robustness in ReLU networks. We focus on a setting where the data consists of clusters and the correlations between cluster…

Machine Learning · Computer Science 2023-11-01 Spencer Frei , Gal Vardi , Peter L. Bartlett , Nathan Srebro

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

Machine Learning · Computer Science 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

Deep learning has been widely used in many fields, but the model training process usually consumes massive computational resources and time. Therefore, designing an efficient neural network training method with a provable convergence…

Machine Learning · Computer Science 2023-07-14 Lianke Qin , Zhao Song , Yuanyuan Yang

Deep learning-based face recognition (FR) systems pose significant privacy risks by tracking users without their consent. While adversarial attacks can protect privacy, they often produce visible artifacts compromising user experience. To…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar

Federated Learning (FL) has emerged as a promising privacy-preserving collaborative model training paradigm without sharing raw data. However, recent studies have revealed that private information can still be leaked through shared gradient…

Cryptography and Security · Computer Science 2026-01-12 Pengxin Guo , Runxi Wang , Shuang Zeng , Jinjing Zhu , Haoning Jiang , Yanran Wang , Yuyin Zhou , Feifei Wang , Hui Xiong , Liangqiong Qu

Graph Neural Networks (GNNs) have made rapid developments in the recent years. Due to their great ability in modeling graph-structured data, GNNs are vastly used in various applications, including high-stakes scenarios such as financial…

Machine Learning · Computer Science 2024-11-26 Enyan Dai , Tianxiang Zhao , Huaisheng Zhu , Junjie Xu , Zhimeng Guo , Hui Liu , Jiliang Tang , Suhang Wang

Private computation of nonlinear functions, such as Rectified Linear Units (ReLUs) and max-pooling operations, in deep neural networks (DNNs) poses significant challenges in terms of storage, bandwidth, and time consumption. To address…

Machine Learning · Computer Science 2023-12-27 Toluwani Aremu

Recent studies revealed that deep neural networks (DNNs) are exposed to backdoor threats when training with third-party resources (such as training samples or backbones). The backdoored model has promising performance in predicting benign…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Chengxiao Luo , Yiming Li , Yong Jiang , Shu-Tao Xia

Graph neural networks (GNNs) have shown promising results on real-life datasets and applications, including healthcare, finance, and education. However, recent studies have shown that GNNs are highly vulnerable to attacks such as membership…

Machine Learning · Computer Science 2023-06-02 Iyiola E. Olatunji , Anmar Hizber , Oliver Sihlovec , Megha Khosla

Privacy attacks on machine learning models aim to identify the data that is used to train such models. Such attacks, traditionally, are studied on static models that are trained once and are accessible by the adversary. Motivated to meet…

Machine Learning · Computer Science 2022-02-09 Ji Gao , Sanjam Garg , Mohammad Mahmoody , Prashant Nalini Vasudevan

This paper attempts to answer the question whether neural network pruning can be used as a tool to achieve differential privacy without losing much data utility. As a first step towards understanding the relationship between neural network…

Machine Learning · Computer Science 2020-03-05 Yangsibo Huang , Yushan Su , Sachin Ravi , Zhao Song , Sanjeev Arora , Kai Li