English
Related papers

Related papers: Trade-Offs Between Fairness and Privacy in Languag…

200 papers

Natural Language Processing (NLP) models have been found discriminative against groups of different social identities such as gender and race. With the negative consequences of these undesired biases, researchers have responded with…

Computation and Language · Computer Science 2022-05-26 Lu Cheng , Suyu Ge , Huan Liu

Machine learning models have demonstrated promising performance in many areas. However, the concerns that they can be biased against specific demographic groups hinder their adoption in high-stake applications. Thus, it is essential to…

Machine Learning · Computer Science 2023-05-31 Canyu Chen , Yueqing Liang , Xiongxiao Xu , Shangyu Xie , Ashish Kundu , Ali Payani , Yuan Hong , Kai Shu

This article deals with adversarial attacks towards deep learning systems for Natural Language Processing (NLP), in the context of privacy protection. We study a specific type of attack: an attacker eavesdrops on the hidden representations…

Computation and Language · Computer Science 2018-08-29 Maximin Coavoux , Shashi Narayan , Shay B. Cohen

An information theoretic privacy mechanism design problem for two scenarios is studied where the private data is either hidden or observable. In each scenario, privacy leakage constraints are considered using two different measures. In…

Information Theory · Computer Science 2022-05-11 Amirreza Zamani , Tobias J. Oechtering , Mikael Skoglund

We consider the problem of fitting a linear model to data held by individuals who are concerned about their privacy. Incentivizing most players to truthfully report their data to the analyst constrains our design to mechanisms that provide…

Computer Science and Game Theory · Computer Science 2015-06-12 Rachel Cummings , Stratis Ioannidis , Katrina Ligett

In order to build reliable and trustworthy NLP applications, models need to be both fair across different demographics and explainable. Usually these two objectives, fairness and explainability, are optimized and/or examined independently…

Computation and Language · Computer Science 2023-11-14 Stephanie Brandl , Emanuele Bugliarello , Ilias Chalkidis

Language model alignment has become an important component of AI safety, allowing safe interactions between humans and language models, by enhancing desired behaviors and inhibiting undesired ones. It is often done by tuning the model or…

Computation and Language · Computer Science 2025-05-28 Yotam Wolf , Noam Wies , Dorin Shteyman , Binyamin Rothberg , Yoav Levine , Amnon Shashua

Large Language Models (LLMs) have achieved remarkable progress in natural language understanding, reasoning, and autonomous decision-making. However, these advancements have also come with significant privacy concerns. While significant…

Cryptography and Security · Computer Science 2026-01-27 Yuntao Du , Zitao Li , Ninghui Li , Bolin Ding

Although Large Language Models (LLMs) have become increasingly integral to diverse applications, their capabilities raise significant privacy concerns. This survey offers a comprehensive overview of privacy risks associated with LLMs and…

Cryptography and Security · Computer Science 2025-05-06 Kang Chen , Xiuze Zhou , Yuanguo Lin , Shibo Feng , Li Shen , Pengcheng Wu

Machine learning models are deployed as a central component in decision making and policy operations with direct impact on individuals' lives. In order to act ethically and comply with government regulations, these models need to make fair…

Machine Learning · Computer Science 2023-11-28 Bogdan Ficiu , Neil D. Lawrence , Andrei Paleyes

Recordings in everyday life require privacy preservation of the speech content and speaker identity. This contribution explores the influence of noise and reverberation on the trade-off between privacy and utility for low-cost…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-04 Jule Pohlhausen , Francesco Nespoli , Joerg Bitzer

Language models are the new state-of-the-art natural language processing (NLP) models and they are being increasingly used in many NLP tasks. Even though there is evidence that language models are biased, the impact of that bias on the…

Computation and Language · Computer Science 2024-04-29 Fatma Elsafoury , Stamos Katsigiannis

Given the progressive nature of the world today, fairness is a very important social aspect in various areas, and it has long been studied with the advent of technology. To the best of our knowledge, methods of quantifying fairness errors…

Cryptography and Security · Computer Science 2022-07-21 Saswat Das , Rakshit Naidu

An important problem in deep learning is the privacy and security of neural networks (NNs). Both aspects have long been considered separately. To date, it is still poorly understood how privacy enhancing training affects the robustness of…

Cryptography and Security · Computer Science 2021-05-18 Franziska Boenisch , Philip Sperl , Konstantin Böttinger

While the entire field of privacy preserving data analytics is focused on the privacy-utility tradeoff, recent work has shown that privacy preserving data publishing can introduce different levels of utility across different population…

Computers and Society · Computer Science 2021-11-09 David Pujol , Ashwin Machanavajjhala

Due to the recent popularity of online social networks, coupled with people's propensity to disclose personal information in an effort to achieve certain gratifications, the problem of navigating the tradeoff between privacy and utility…

Information Theory · Computer Science 2020-03-12 Chandra Sharma , George Amariucai

We study statistical risk minimization problems under a privacy model in which the data is kept confidential even from the learner. In this local privacy framework, we establish sharp upper and lower bounds on the convergence rates of…

Machine Learning · Statistics 2013-10-11 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

Data collected about individuals is regularly used to make decisions that impact those same individuals. We consider settings where sensitive personal data is used to decide who will receive resources or benefits. While it is well known…

Databases · Computer Science 2020-01-28 Satya Kuppam , Ryan Mckenna , David Pujol , Michael Hay , Ashwin Machanavajjhala , Gerome Miklau

Security, privacy, and fairness have become critical in the era of data science and machine learning. More and more we see that achieving universally secure, private, and fair systems is practically impossible. We have seen for example how…

Machine Learning · Statistics 2017-05-24 Jure Sokolic , Qiang Qiu , Miguel R. D. Rodrigues , Guillermo Sapiro

Differential privacy has emerged as the most studied framework for privacy-preserving machine learning. However, recent studies show that enforcing differential privacy guarantees can not only significantly degrade the utility of the model,…

Machine Learning · Computer Science 2025-01-27 Kai Yao , Marc Juarez