English
Related papers

Related papers: Seeing the Forest through the Trees: Data Leakage …

200 papers

Machine learning models are increasingly used for software security tasks. These models are commonly trained and evaluated on large Internet-derived datasets, which often contain duplicated or highly similar samples. When such samples are…

Cryptography and Security · Computer Science 2026-02-02 Farnaz Soltaniani , Mohammad Ghafari

Deep neural networks are normally executed in the forward direction. However, in this work, we identify a vulnerability that enables models to be trained in both directions and on different tasks. Adversaries can exploit this capability to…

Machine Learning · Computer Science 2024-05-20 Guy Amit , Mosh Levy , Yisroel Mirsky

Understanding to what extent neural networks memorize training data is an intriguing question with practical and theoretical implications. In this paper we show that in some cases a significant fraction of the training data can in fact be…

Machine Learning · Computer Science 2022-12-06 Niv Haim , Gal Vardi , Gilad Yehudai , Ohad Shamir , Michal Irani

Recent works have brought attention to the vulnerability of Federated Learning (FL) systems to gradient leakage attacks. Such attacks exploit clients' uploaded gradients to reconstruct their sensitive data, thereby compromising the privacy…

Machine Learning · Computer Science 2025-06-11 Mingyuan Fan , Cen Chen , Chengyu Wang , Xiaodan Li , Wenmeng Zhou

Deep Neural Networks (DNNs) have revolutionized various domains with their exceptional performance across numerous applications. However, Model Inversion (MI) attacks, which disclose private information about the training dataset by abusing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Hao Fang , Yixiang Qiu , Hongyao Yu , Wenbo Yu , Jiawei Kong , Baoli Chong , Bin Chen , Xuan Wang , Shu-Tao Xia , Ke Xu

Federated learning (FL) is a popular distributed learning framework that can reduce privacy risks by not explicitly sharing private data. However, recent works demonstrated that sharing model updates makes FL vulnerable to inference…

Machine Learning · Computer Science 2020-12-14 Jingwei Sun , Ang Li , Binghui Wang , Huanrui Yang , Hai Li , Yiran Chen

As a crucial building block in vertical Federated Learning (vFL), Split Learning (SL) has demonstrated its practice in the two-party model training collaboration, where one party holds the features of data samples and another party holds…

Cryptography and Security · Computer Science 2023-04-10 Shangyu Xie , Xin Yang , Yuanshun Yao , Tianyi Liu , Taiqing Wang , Jiankai Sun

The prominence of embodied Artificial Intelligence (AI), which empowers robots to navigate, perceive, and engage within virtual environments, has attracted significant attention, owing to the remarkable advances in computer vision and large…

Robotics · Computer Science 2024-12-10 Miao Li , Wenhao Ding , Ding Zhao

Data poisoning and leakage risks impede the massive deployment of federated learning in the real world. This chapter reveals the truths and pitfalls of understanding two dominating threats: {\em training data privacy intrusion} and {\em…

Machine Learning · Computer Science 2024-09-23 Wenqi Wei , Tiansheng Huang , Zachary Yahn , Anoop Singhal , Margaret Loper , Ling Liu

Gradient leakage attacks are considered one of the wickedest privacy threats in deep learning as attackers covertly spy gradient updates during iterative training without compromising model training quality, and yet secretly reconstruct…

Machine Learning · Computer Science 2021-12-28 Wenqi Wei , Ling Liu

Federated learning is emerging as a machine learning technique that trains a model across multiple decentralized parties. It is renowned for preserving privacy as the data never leaves the computational devices, and recent approaches…

Machine Learning · Computer Science 2021-06-25 Yuchen Li , Yifan Bao , Liyao Xiang , Junhan Liu , Cen Chen , Li Wang , Xinbing Wang

Model inversion (MI) attacks pose significant privacy risks by reconstructing private training data from trained neural networks. While prior studies have primarily examined unimodal deep networks, the vulnerability of vision-language…

Machine Learning · Computer Science 2026-03-03 Ngoc-Bao Nguyen , Sy-Tuyen Ho , Koh Jun Hao , Ngai-Man Cheung

Leakage of data from publicly available Machine Learning (ML) models is an area of growing significance as commercial and government applications of ML can draw on multiple sources of data, potentially including users' and clients'…

Federated learning (FL) is an emerging distributed machine learning framework for collaborative model training with a network of clients (edge devices). FL offers default client privacy by allowing clients to keep their sensitive data on…

Machine Learning · Computer Science 2020-04-24 Wenqi Wei , Ling Liu , Margaret Loper , Ka-Ho Chow , Mehmet Emre Gursoy , Stacey Truex , Yanzhao Wu

The widespread deployment of deep learning models in privacy-sensitive domains has amplified concerns regarding privacy risks, particularly those stemming from gradient leakage during training. Current privacy assessments primarily rely on…

Machine Learning · Computer Science 2025-02-13 Jiayang Meng , Tao Huang , Hong Chen , Xin Shi , Qingyu Huang , Chen Hou

With the development of artificial intelligence technology, Federated Learning (FL) model has been widely used in many industries for its high efficiency and confidentiality. Some researchers have explored its confidentiality and designed…

Cryptography and Security · Computer Science 2023-01-09 Yaqiong Mu

Gradient inversion attacks are often presented as a serious privacy threat in federated learning, with recent work reporting increasingly strong reconstructions under favorable experimental settings. However, it remains unclear whether such…

Cryptography and Security · Computer Science 2026-02-10 Viktor Valadi , Mattias Åkesson , Johan Östman , Fazeleh Hoseini , Salman Toor , Andreas Hellander

The increasing need for sharing healthcare data and collaborating on clinical research has raised privacy concerns. Health information leakage due to malicious attacks can lead to serious problems such as misdiagnoses and patient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Shiyi Jiang , Farshad Firouzi , Krishnendu Chakrabarty

Recently, it has been shown that Machine Learning models can leak sensitive information about their training data. This information leakage is exposed through membership and attribute inference attacks. Although many attack strategies have…

Machine Learning · Computer Science 2023-03-08 Ganesh Del Grosso , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida

As the scale and size of the data increases significantly nowadays, federal learning (Bonawitz et al. [2019]) for high performance computing and machine learning has been much more important than ever before (Abadi et al. [2016]). People…

Machine Learning · Computer Science 2022-11-16 Yanchong Zheng