English
Related papers

Related papers: Leakage of Dataset Properties in Multi-Party Machi…

200 papers

In a multi-party machine learning system, different parties cooperate on optimizing towards better models by sharing data in a privacy-preserving way. A major challenge in learning is the incentive issue. For example, if there is…

Multiagent Systems · Computer Science 2020-08-11 Mengjing Chen , Yang Liu , Weiran Shen , Yiheng Shen , Pingzhong Tang , Qiang Yang

In the federated learning system, parameter gradients are shared among participants and the central modulator, while the original data never leave their protected source domain. However, the gradient itself might carry enough information…

Cryptography and Security · Computer Science 2021-03-01 Yong Liu , Xinghua Zhu , Jianzong Wang , Jing Xiao

We quantitatively investigate how machine learning models leak information about the individual data records on which they were trained. We focus on the basic membership inference attack: given a data record and black-box access to a model,…

Cryptography and Security · Computer Science 2017-04-04 Reza Shokri , Marco Stronati , Congzheng Song , Vitaly Shmatikov

Access to diverse, high-quality datasets is crucial for machine learning model performance, yet data sharing remains limited by privacy concerns and competitive interests, particularly in regulated domains like healthcare. This dynamic…

Machine Learning · Computer Science 2025-10-20 Keren Fuentes , Mimee Xu , Irene Chen

Secure multiparty computation (MPC) allows data owners to train machine learning models on combined data while keeping the underlying training data private. The MPC threat model either considers an adversary who passively corrupts some…

Cryptography and Security · Computer Science 2025-05-26 Matthew Jagielski , Daniel Escudero , Rahul Rachuri , Peter Scholl

Exchanging gradients is a widely used method in modern multi-node machine learning system (e.g., distributed training, collaborative learning). For a long time, people believed that gradients are safe to share: i.e., the training data will…

Machine Learning · Computer Science 2019-12-20 Ligeng Zhu , Zhijian Liu , Song Han

Machine learning models leak information about their training data every time they reveal a prediction. This is problematic when the training data needs to remain private. Private prediction methods limit how much information about the…

Machine Learning · Computer Science 2020-07-13 Laurens van der Maaten , Awni Hannun

Machine learning models are known to memorize the unique properties of individual data points in a training set. This memorization capability can be exploited by several types of attacks to infer information about the training data, most…

Information Theory · Computer Science 2021-04-19 Sara Saeidian , Giulia Cervia , Tobias J. Oechtering , Mikael Skoglund

Secure multiparty computation (MPC) has been proposed to allow multiple mutually distrustful data owners to jointly train machine learning (ML) models on their combined data. However, by design, MPC protocols faithfully compute the training…

Cryptography and Security · Computer Science 2022-09-09 Harsh Chaudhari , Matthew Jagielski , Alina Oprea

Existing regulations prohibit model developers from accessing protected attributes (gender, race, etc.), often resulting in fairness assessments on populations without knowing their protected groups. In such scenarios, institutions often…

Machine Learning · Computer Science 2023-06-07 Faisal Hamman , Jiahao Chen , Sanghamitra Dutta

We address the problem of learning a machine learning model from training data that originates at multiple data owners while providing formal privacy guarantees regarding the protection of each owner's data. Existing solutions based on…

Cryptography and Security · Computer Science 2025-03-12 Sikha Pentyala , Davis Railsback , Ricardo Maia , Rafael Dowsley , David Melanson , Anderson Nascimento , Martine De Cock

Machine learning has witnessed remarkable breakthroughs in recent years. As machine learning permeates various aspects of daily life, individuals and organizations increasingly interact with these systems, exhibiting a wide range of social…

Machine Learning · Computer Science 2024-08-06 Han Shao

Machine learning benefits from large training datasets, which may not always be possible to collect by any single entity, especially when using privacy-sensitive data. In many contexts, such as healthcare and finance, separate parties may…

In machine learning, curation is used to select the most valuable data for improving both model accuracy and computational efficiency. Recently, curation has also been explored as a solution for private machine learning: rather than…

Machine Learning · Computer Science 2026-03-03 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch

Spatial data sharing plays a significant role in opening data research and promoting government agency transparency. However, valuable spatial data, like high-precision geographic information and personal traffic records, cannot be made…

Cryptography and Security · Computer Science 2022-07-27 Shuo Shen , Xinyan Zhu , Yanlei Ma , XIe Xiang , Sun Lilin , Xie Hongjun , An Rui

In collaborative learning, clients keep their data private and communicate only the computed gradients of the deep neural network being trained on their local data. Several recent attacks show that one can still extract private information…

Machine Learning · Computer Science 2022-07-26 Fan Mo , Anastasia Borovykh , Mohammad Malekzadeh , Soteris Demetriou , Deniz Gündüz , Hamed Haddadi

Machine learning models trained on private datasets have been shown to leak their private data. While recent work has found that the average data point is rarely leaked, the outlier samples are frequently subject to memorization and,…

Machine Learning · Computer Science 2022-06-23 Nicholas Carlini , Matthew Jagielski , Chiyuan Zhang , Nicolas Papernot , Andreas Terzis , Florian Tramer

Generative models are increasingly used to produce privacy-preserving synthetic data as a safe alternative to sharing sensitive training datasets. However, we demonstrate that such synthetic releases can still leak information about the…

Machine Learning · Computer Science 2025-12-09 S. M. Mustaqim , Anantaa Kotal , Paul H. Yi

Privacy preserving in machine learning is a crucial issue in industry informatics since data used for training in industries usually contain sensitive information. Existing differentially private machine learning algorithms have not…

Machine Learning · Computer Science 2020-10-08 Tao Zhang , Tianqing Zhu , Ping Xiong , Huan Huo , Zahir Tari , Wanlei Zhou

Secure multiparty computation enables the joint evaluation of multivariate functions across distributed users while ensuring the privacy of their local inputs. This field has become increasingly urgent due to the exploding demand for…

Quantum Physics · Physics 2026-01-07 Kfir Sulimany , Sri Krishna Vadlamani , Ryan Hamerly , Prahlad Iyengar , Dirk Englund