English
Related papers

Related papers: Privacy Auditing with Zero (0) Training Run

200 papers

Recently, recommender systems have achieved promising performances and become one of the most widely used web applications. However, recommender systems are often trained on highly sensitive user data, thus potential data leakage from…

Cryptography and Security · Computer Science 2021-09-17 Minxing Zhang , Zhaochun Ren , Zihan Wang , Pengjie Ren , Zhumin Chen , Pengfei Hu , Yang Zhang

Differential privacy is an information theoretic constraint on algorithms and code. It provides quantification of privacy leakage and formal privacy guarantees that are currently considered the gold standard in privacy protections. In this…

Cryptography and Security · Computer Science 2020-05-14 Daniel Kifer , Solomon Messing , Aaron Roth , Abhradeep Thakurta , Danfeng Zhang

Differential privacy offers formal quantitative guarantees for algorithms over datasets, but it assumes attackers that know and can influence all but one record in the database. This assumption often vastly overapproximates the attackers'…

Cryptography and Security · Computer Science 2020-12-01 Damien Desfontaines , Esfandiar Mohammadi , Elisabeth Krahmer , David Basin

With the increasing demands for privacy protection, privacy-preserving machine learning has been drawing much attention in both academia and industry. However, most existing methods have their limitations in practical applications. On the…

Machine Learning · Computer Science 2022-02-22 Fei Zheng , Chaochao Chen , Xiaolin Zheng , Mingjie Zhu

A surge in data-driven applications enhances everyday life but also raises serious concerns about private information leakage. Hence many privacy auditing tools are emerging for checking if the data sanitization performed meets the privacy…

Cryptography and Security · Computer Science 2024-11-26 Shiming Wang , Liyao Xiang , Bowei Cheng , Zhe Ji , Tianran Sun , Xinbing Wang

Differential privacy has emerged as the most studied framework for privacy-preserving machine learning. However, recent studies show that enforcing differential privacy guarantees can not only significantly degrade the utility of the model,…

Machine Learning · Computer Science 2025-01-27 Kai Yao , Marc Juarez

Lack of trust between organisations and privacy concerns about their data are impediments to an otherwise potentially symbiotic joint data analysis. We propose DataRing, a data sharing system that allows mutually mistrusting participants to…

Cryptography and Security · Computer Science 2021-06-21 Tham Nguyen , Hassan Jameel Asghar , Raghav Bhakar , Dali Kaafar , Farhad Farokhi

With the growing adoption of data privacy regulations, the ability to erase private or copyrighted information from trained models has become a crucial requirement. Traditional unlearning methods often assume access to the complete training…

Machine Learning · Computer Science 2025-12-22 Umit Yigit Basaran , Sk Miraj Ahmed , Amit Roy-Chowdhury , Basak Guler

The memorization of training data by neural networks raises pressing concerns for privacy and security. Recent work has shown that, under certain conditions, portions of the training set can be reconstructed directly from model parameters.…

Machine Learning · Computer Science 2025-09-26 Yehonatan Refael , Guy Smorodinsky , Ofir Lindenbaum , Itay Safran

There is an increasing concern that most current published research findings are false. The main cause seems to lie in the fundamental disconnection between theory and practice in data analysis. While the former typically relies on…

Machine Learning · Statistics 2019-03-06 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

Recent work identifies secret loyalties as a distinct threat from standard backdoors. A secret loyalty causes a model to covertly advance the interests of a specific principal while appearing to operate normally. We construct the first…

Cryptography and Security · Computer Science 2026-05-13 Alfie Lamerton , Fabien Roger

The potential risk of privacy leakage prevents users from sharing their honest opinions on social platforms. This paper addresses the problem of privacy preservation if the query returns the histogram of rankings. The framework of…

Artificial Intelligence · Computer Science 2014-09-25 Shang Shang , Tiance Wang , Paul Cuff , Sanjeev Kulkarni

Federated learning (FL) has attracted widespread attention because it supports the joint training of models by multiple participants without moving private dataset. However, there are still many security issues in FL that deserve…

Cryptography and Security · Computer Science 2024-05-08 Huang Zeng , Anjia Yang , Jian Weng , Min-Rong Chen , Fengjun Xiao , Yi Liu , Ye Yao

Federated learning enables training a global machine learning model from data distributed across multiple sites, without having to move the data. This is particularly relevant in healthcare applications, where data is rife with personal,…

Cryptography and Security · Computer Science 2020-02-24 Olivia Choudhury , Aris Gkoulalas-Divanis , Theodoros Salonidis , Issa Sylla , Yoonyoung Park , Grace Hsu , Amar Das

The preservation of privacy has emerged as a critical topic in the era of artificial intelligence. However, current work focuses on user-oriented privacy, overlooking severe enterprise data leakage risks exacerbated by the…

Cryptography and Security · Computer Science 2025-08-11 Zhihao Yao , Yuxuan Gu , Xiachong Feng , Weitao Ma , Bo Li , Xiaocheng Feng

With the extensive use of machine learning technologies, data providers encounter increasing privacy risks. Recent legislation, such as GDPR, obligates organizations to remove requested data and its influence from a trained model. Machine…

Computers and Society · Computer Science 2024-11-07 Hengzhu Liu , Tianqing Zhu , Lefeng Zhang , Ping Xiong

Motivated by settings in which predictive models may be required to be non-discriminatory with respect to certain attributes (such as race), but even collecting the sensitive attribute may be forbidden or restricted, we initiate the study…

Machine Learning · Computer Science 2019-06-04 Matthew Jagielski , Michael Kearns , Jieming Mao , Alina Oprea , Aaron Roth , Saeed Sharifi-Malvajerdi , Jonathan Ullman

In the rapid advancement of artificial intelligence, privacy protection has become crucial, giving rise to machine unlearning. Machine unlearning is a technique that removes specific data influences from trained models without the need for…

Machine Learning · Computer Science 2025-06-23 Wenhan Chang , Tianqing Zhu , Ping Xiong , Yufeng Wu , Faqian Guan , Wanlei Zhou

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

Real-world data is usually segmented by attributes and distributed across different parties. Federated learning empowers collaborative training without exposing local data or models. As we demonstrate through designed attacks, even with a…

Machine Learning · Computer Science 2021-04-30 Shuang Zhang , Liyao Xiang , Xi Yu , Pengzhi Chu , Yingqi Chen , Chen Cen , Li Wang