English
Related papers

Related papers: Measuring Data Leakage in Machine-Learning Models …

200 papers

Machine learning models leak information about their training data every time they reveal a prediction. This is problematic when the training data needs to remain private. Private prediction methods limit how much information about the…

Machine Learning · Computer Science 2020-07-13 Laurens van der Maaten , Awni Hannun

Leakage of data from publicly available Machine Learning (ML) models is an area of growing significance as commercial and government applications of ML can draw on multiple sources of data, potentially including users' and clients'…

The raise of machine learning and deep learning led to significant improvement in several domains. This change is supported by both the dramatic rise in computation power and the collection of large datasets. Such massive datasets often…

Machine Learning · Computer Science 2022-11-24 Hamid Jalalzai , Elie Kadoche , Rémi Leluc , Vincent Plassier

Secure multi-party machine learning allows several parties to build a model on their pooled data to increase utility while not explicitly sharing data with each other. We show that such multi-party computation can cause leakage of global…

Machine Learning · Computer Science 2021-06-21 Wanrong Zhang , Shruti Tople , Olga Ohrimenko

Link prediction is a fundamental problem in network science, aiming to infer potential or missing links based on observed network structures. With the increasing adoption of parameterized models, the rigor of evaluation protocols has become…

Other Statistics · Statistics 2026-04-09 Xinshan Jiao , Yuxin Luo , Yilin Bi , Tao Zhou

Transfer learning is widely used for transferring knowledge from a source domain to the target domain where the labeled data is scarce. Recently, deep transfer learning has achieved remarkable progress in various applications. However, the…

Computation and Language · Computer Science 2020-09-07 Cen Chen , Bingzhe Wu , Minghui Qiu , Li Wang , Jun Zhou

The concept of Fisher information can be useful even in cases where the probability distributions of interest are not absolutely continuous with respect to the natural reference measure on the underlying space. Practical examples where this…

Statistics Theory · Mathematics 2018-03-28 Jeremie Houssineau , Ajay Jasra , Sumeetpal S. Singh

We quantitatively investigate how machine learning models leak information about the individual data records on which they were trained. We focus on the basic membership inference attack: given a data record and black-box access to a model,…

Cryptography and Security · Computer Science 2017-04-04 Reza Shokri , Marco Stronati , Congzheng Song , Vitaly Shmatikov

We introduce a privacy measure called pointwise maximal leakage, generalizing the pre-existing notion of maximal leakage, which quantifies the amount of information leaking about a secret $X$ by disclosing a single outcome of a (randomized)…

Information Theory · Computer Science 2023-08-16 Sara Saeidian , Giulia Cervia , Tobias J. Oechtering , Mikael Skoglund

Privacy and transparency are two key foundations of trustworthy machine learning. Model explanations offer insights into a model's decisions on input data, whereas privacy is primarily concerned with protecting information about the…

Machine Learning · Computer Science 2021-02-08 Reza Shokri , Martin Strobel , Yair Zick

We analyze data leakage in visual datasets. Data leakage refers to images in evaluation benchmarks that have been seen during training, compromising fair model evaluation. Given that large-scale datasets are often sourced from the internet,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Patrick Ramos , Ryan Ramos , Noa Garcia

With the growing emphasis on users' privacy, federated learning has become more and more popular. Many architectures have been raised for a better security. Most architecture work on the assumption that data's gradient could not leak…

Cryptography and Security · Computer Science 2020-03-12 Zhaorui Li , Zhicong Huang , Chaochao Chen , Cheng Hong

In collaborative learning, clients keep their data private and communicate only the computed gradients of the deep neural network being trained on their local data. Several recent attacks show that one can still extract private information…

Machine Learning · Computer Science 2022-07-26 Fan Mo , Anastasia Borovykh , Mohammad Malekzadeh , Soteris Demetriou , Deniz Gündüz , Hamed Haddadi

Choosing a suitable loss function is essential when learning by empirical risk minimisation. In many practical cases, the datasets used for training a classifier may contain incorrect labels, which prompts the interest for using loss…

Machine Learning · Computer Science 2024-05-15 Henrique K. Miyamoto , Fábio C. C. Meneghetti , Sueli I. R. Costa

With the extensive use of machine learning technologies, data providers encounter increasing privacy risks. Recent legislation, such as GDPR, obligates organizations to remove requested data and its influence from a trained model. Machine…

Computers and Society · Computer Science 2024-11-07 Hengzhu Liu , Tianqing Zhu , Lefeng Zhang , Ping Xiong

Privacy preserving in machine learning is a crucial issue in industry informatics since data used for training in industries usually contain sensitive information. Existing differentially private machine learning algorithms have not…

Machine Learning · Computer Science 2020-10-08 Tao Zhang , Tianqing Zhu , Ping Xiong , Huan Huo , Zahir Tari , Wanlei Zhou

In this work, we propose information laundering, a novel framework for enhancing model privacy. Unlike data privacy that concerns the protection of raw data information, model privacy aims to protect an already-learned model that is to be…

Cryptography and Security · Computer Science 2020-09-16 Xinran Wang , Yu Xiang , Jun Gao , Jie Ding

Data leakage is the inadvertent transfer of information between training and evaluation datasets that poses a subtle, yet critical, risk to the reliability of machine learning (ML) models in safety-critical systems such as automotive…

Cryptography and Security · Computer Science 2026-04-09 Md Abu Ahammed Babu , Sushant Kumar Pandey , Darko Durisic , Andras Balint , Miroslaw Staron

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

Machine Learning · Computer Science 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

In machine learning, curation is used to select the most valuable data for improving both model accuracy and computational efficiency. Recently, curation has also been explored as a solution for private machine learning: rather than…

Machine Learning · Computer Science 2026-03-03 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch