English
Related papers

Related papers: Exploring Privacy and Fairness Risks in Sharing Di…

200 papers

Federated learning is a recent advance in privacy protection. In this context, a trusted curator aggregates parameters optimized in decentralized fashion by multiple clients. The resulting model is then distributed back to all clients,…

Cryptography and Security · Computer Science 2018-03-02 Robin C. Geyer , Tassilo Klein , Moin Nabi

A large body of research has shown that machine learning models are vulnerable to membership inference (MI) attacks that violate the privacy of the participants in the training data. Most MI research focuses on the case of a single…

Machine Learning · Computer Science 2022-05-16 Matthew Jagielski , Stanley Wu , Alina Oprea , Jonathan Ullman , Roxana Geambasu

Deploying machine learning models in production may allow adversaries to infer sensitive information about training data. There is a vast literature analyzing different types of inference risks, ranging from membership inference to…

With the emergence of smart cities, Internet of Things (IoT) devices as well as deep learning technologies have witnessed an increasing adoption. To support the requirements of such paradigm in terms of memory and computation, joint and…

Networking and Internet Architecture · Computer Science 2020-10-27 Emna Baccour , Aiman Erbad , Amr Mohamed , Mounir Hamdi , Mohsen Guizani

This paper surveys recent work in the intersection of differential privacy (DP) and fairness. It reviews the conditions under which privacy and fairness may have aligned or contrasting goals, analyzes how and why DP may exacerbate bias and…

Machine Learning · Computer Science 2022-09-09 Ferdinando Fioretto , Cuong Tran , Pascal Van Hentenryck , Keyu Zhu

Differentially private models seek to protect the privacy of data the model is trained on, making it an important component of model security and privacy. At the same time, data scientists and machine learning engineers seek to use…

Cryptography and Security · Computer Science 2021-03-17 Erick Galinkin

The ability to transfer adversarial attacks from one model (the surrogate) to another model (the victim) has been an issue of concern within the machine learning (ML) community. The ability to successfully evade unseen models represents an…

Machine Learning · Computer Science 2021-09-28 Luke E. Richards , André Nguyen , Ryan Capps , Steven Forsythe , Cynthia Matuszek , Edward Raff

Large-scale pre-trained models are increasingly adapted to downstream tasks through a new paradigm called prompt learning. In contrast to fine-tuning, prompt learning does not update the pre-trained model's parameters. Instead, it only…

Cryptography and Security · Computer Science 2023-10-19 Yixin Wu , Rui Wen , Michael Backes , Pascal Berrang , Mathias Humbert , Yun Shen , Yang Zhang

Federated learning enables data sharing in healthcare contexts where it might otherwise be difficult due to data-use-ordinances or security and communication constraints. Distributed and shared data models allow models to become…

Cryptography and Security · Computer Science 2023-08-04 Navya Annapareddy , Yingzheng Liu , Judy Fox

This paper studies model-inversion attacks, in which the access to a model is abused to infer information about the training data. Since its first introduction, such attacks have raised serious concerns given that training data usually…

Machine Learning · Computer Science 2020-04-21 Yuheng Zhang , Ruoxi Jia , Hengzhi Pei , Wenxiao Wang , Bo Li , Dawn Song

Private regression has received attention from both database and security communities. Recent work by Fredrikson et al. (USENIX Security 2014) analyzed the functional mechanism (Zhang et al. VLDB 2012) for training linear regression models…

Cryptography and Security · Computer Science 2015-12-22 Xi Wu , Matthew Fredrikson , Wentao Wu , Somesh Jha , Jeffrey F. Naughton

The integration of fairness and privacy in centralized data-driven applications is critical, especially as these systems increasingly influence sectors with significant societal impact. Current methods rarely address privacy, fairness, and…

Machine Learning · Computer Science 2026-05-26 Imesh Ekanayake , Elham Naghizade , Jeffrey Chan

Smart Meters (SMs) are able to share the power consumption of users with utility providers almost in real-time. These fine-grained signals carry sensitive information about users, which has raised serious concerns from the privacy…

Signal Processing · Electrical Eng. & Systems 2021-11-29 Mohammadhadi Shateri , Francisco Messina , Pablo Piantanida , Fabrice Labeau

A critical concern in data-driven processes is to build models whose outcomes do not discriminate against some demographic groups, including gender, ethnicity, or age. To ensure non-discrimination in learning tasks, knowledge of the group…

Machine Learning · Computer Science 2022-04-12 Cuong Tran , Keyu Zhu , Ferdinando Fioretto , Pascal Van Hentenryck

As machine learning becomes a practice and commodity, numerous cloud-based services and frameworks are provided to help customers develop and deploy machine learning applications. While it is prevalent to outsource model training and…

Cryptography and Security · Computer Science 2018-07-16 Tianwei Zhang , Zecheng He , Ruby B. Lee

Transfer learning, successful in knowledge translation across related tasks, faces a substantial privacy threat from membership inference attacks (MIAs). These attacks, despite posing significant risk to ML model's training data, remain…

Cryptography and Security · Computer Science 2025-01-22 Cong Wu , Jing Chen , Qianru Fang , Kun He , Ziming Zhao , Hao Ren , Guowen Xu , Yang Liu , Yang Xiang

Sharing of security data across organizational boundaries has often been advocated as a promising way to enhance cyber threat mitigation. However, collaborative security faces a number of important challenges, including privacy, trust, and…

Cryptography and Security · Computer Science 2017-03-02 Julien Freudiger , Emiliano De Cristofaro , Alex Brito

With the development of information science and technology, various industries have generated massive amounts of data, and machine learning is widely used in the analysis of big data. However, if the privacy of machine learning…

Cryptography and Security · Computer Science 2023-01-11 Jingyi Ge

Adversarial attacks can mislead neural network classifiers. The defense against adversarial attacks is important for AI safety. Adversarial purification is a family of approaches that defend adversarial attacks with suitable pre-processing.…

Machine Learning · Computer Science 2023-10-31 Boya Zhang , Weijian Luo , Zhihua Zhang

In this work, we propose information laundering, a novel framework for enhancing model privacy. Unlike data privacy that concerns the protection of raw data information, model privacy aims to protect an already-learned model that is to be…

Cryptography and Security · Computer Science 2020-09-16 Xinran Wang , Yu Xiang , Jun Gao , Jie Ding