English
Related papers

Related papers: Privacy for Free: How does Dataset Condensation He…

200 papers

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

Machine Learning · Computer Science 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

Knowledge distillation in neural networks refers to compressing a large model or dataset into a smaller version of itself. We introduce Privacy Distillation, a framework that allows a text-to-image generative model to teach another model…

Federated learning is considered as an effective privacy-preserving learning mechanism that separates the client's data and model training process. However, federated learning is still under the risk of privacy leakage because of the…

Machine Learning · Computer Science 2022-06-03 Yuxuan Wan , Han Xu , Xiaorui Liu , Jie Ren , Wenqi Fan , Jiliang Tang

Training data privacy has been a top concern in AI modeling. While methods like differentiated private learning allow data contributors to quantify acceptable privacy loss, model utility is often significantly damaged. In practice,…

Machine Learning · Computer Science 2024-10-31 Yuechun Gu , Jiajie He , Keke Chen

We introduce Concentrated Differential Privacy, a relaxation of Differential Privacy enjoying better accuracy than both pure differential privacy and its popular "(epsilon,delta)" relaxation without compromising on cumulative privacy loss…

Data Structures and Algorithms · Computer Science 2016-03-17 Cynthia Dwork , Guy N. Rothblum

Differential privacy provides the first theoretical foundation with provable privacy guarantee against adversaries with arbitrary prior knowledge. The main idea to achieve differential privacy is to inject random noise into statistical…

Data Structures and Algorithms · Computer Science 2011-11-01 Yang D. Li , Zhenjie Zhang , Marianne Winslett , Yin Yang

Privacy-preserving distributed machine learning becomes increasingly important due to the recent rapid growth of data. This paper focuses on a class of regularized empirical risk minimization (ERM) machine learning problems, and develops…

Machine Learning · Computer Science 2016-03-11 Tao Zhang , Quanyan Zhu

Private regression has received attention from both database and security communities. Recent work by Fredrikson et al. (USENIX Security 2014) analyzed the functional mechanism (Zhang et al. VLDB 2012) for training linear regression models…

Cryptography and Security · Computer Science 2015-12-22 Xi Wu , Matthew Fredrikson , Wentao Wu , Somesh Jha , Jeffrey F. Naughton

Deep learning with medical data often requires larger samples sizes than are available at single providers. While data sharing among institutions is desirable to train more accurate and sophisticated models, it can lead to severe privacy…

Machine Learning · Computer Science 2018-12-05 Brett K. Beaulieu-Jones , William Yuan , Samuel G. Finlayson , Zhiwei Steven Wu

The ever-growing advances of deep learning in many areas including vision, recommendation systems, natural language processing, etc., have led to the adoption of Deep Neural Networks (DNNs) in production systems. The availability of large…

The problem of private information "leakage" (inadvertently or by malicious design) from the myriad large centralized searchable data repositories drives the need for an analytical framework that quantifies unequivocally how safe private…

Information Theory · Computer Science 2010-02-09 Lalitha Sankar , S. Raj Rajagopalan , H. Vincent Poor

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue

We propose improving the privacy properties of a dataset by publishing only a strategically chosen "core-set" of the data containing a subset of the instances. The core-set allows strong performance on primary tasks, but forces poor…

Machine Learning · Computer Science 2019-10-25 Benjamin Spector , Ravi Kumar , Andrew Tomkins

Distributed model predictive control (DMPC) has attracted extensive attention as it can explicitly handle system constraints and achieve optimal control in a decentralized manner. However, the deployment of DMPC strategies generally…

Systems and Control · Electrical Eng. & Systems 2025-11-21 Kaixiang Zhang , Yongqiang Wang , Ziyou Song , Zhaojian Li

Communication efficiency and privacy protection are two critical issues in distributed machine learning. Existing methods tackle these two issues separately and may have a high implementation complexity that constrains their application in…

Machine Learning · Computer Science 2023-04-27 Guangfeng Yan , Tan Li , Kui Wu , Linqi Song

Open data plays a fundamental role in the 21th century by stimulating economic growth and by enabling more transparent and inclusive societies. However, it is always difficult to create new high-quality datasets with the required privacy…

Cryptography and Security · Computer Science 2019-03-07 Lorenzo Frigerio , Anderson Santana de Oliveira , Laurent Gomez , Patrick Duverger

Dataset Condensation (DC) is a data-efficient learning paradigm that synthesizes small yet informative datasets, enabling models to match the performance of full-data training. However, recent work exposes a critical vulnerability of DC to…

Machine Learning · Computer Science 2026-03-31 He Yang , Dongyi Lv , Song Ma , Wei Xi , Zhi Wang , Hanlin Gu , Yajie Wang

Machine Learning (ML) is crucial in many sectors, including computer vision. However, ML models trained on sensitive data face security challenges, as they can be attacked and leak information. Privacy-Preserving Machine Learning (PPML)…

Machine Learning · Computer Science 2026-02-03 Lucas Lange , Maurice-Maximilian Heykeroth , Erhard Rahm

Federated Learning (FL) emerged as a learning method to enable the server to train models over data distributed among various clients. These clients are protective about their data being leaked to the server, any other client, or an…

Machine Learning · Computer Science 2025-01-27 Uday Bhaskar , Varul Srivastava , Avyukta Manjunatha Vummintala , Naresh Manwani , Sujit Gujar

Real-world data is usually segmented by attributes and distributed across different parties. Federated learning empowers collaborative training without exposing local data or models. As we demonstrate through designed attacks, even with a…

Machine Learning · Computer Science 2021-04-30 Shuang Zhang , Liyao Xiang , Xi Yu , Pengzhi Chu , Yingqi Chen , Chen Cen , Li Wang