English
Related papers

Related papers: Can Querying for Bias Leak Protected Attributes? A…

200 papers

Security, privacy, and fairness have become critical in the era of data science and machine learning. More and more we see that achieving universally secure, private, and fair systems is practically impossible. We have seen for example how…

Machine Learning · Statistics 2017-05-24 Jure Sokolic , Qiang Qiu , Miguel R. D. Rodrigues , Guillermo Sapiro

Community detection is a fundamental task in complex network analysis. Fairness-aware community detection seeks to prevent biased node partitions, typically framed in terms of individual fairness, which requires similar nodes to be treated…

Social and Information Networks · Computer Science 2026-02-19 Fabrizio Corriera , Frank W. Takes , Akrati Saxena

Fair machine learning methods seek to train models that balance model performance across demographic subgroups defined over sensitive attributes like race and gender. Although sensitive attributes are typically assumed to be known during…

Machine Learning · Computer Science 2024-03-22 Akshaj Kumar Veldanda , Ivan Brugere , Sanghamitra Dutta , Alan Mishler , Siddharth Garg

We show that participating in federated learning can be detrimental to group fairness. In fact, the bias of a few parties against under-represented groups (identified by sensitive attributes such as gender or race) can propagate through the…

Machine Learning · Computer Science 2023-09-06 Hongyan Chang , Reza Shokri

The astonishing successes of ML have raised growing concern for the fairness of modern methods when deployed in real world settings. However, studies on fairness have mostly focused on supervised ML, while unsupervised outlier detection…

Machine Learning · Computer Science 2024-08-28 Xueying Ding , Rui Xi , Leman Akoglu

Transparency and explainability are two important aspects to be considered when employing black-box machine learning models in high-stake applications. Providing counterfactual explanations is one way of catering this requirement. However,…

Information Theory · Computer Science 2025-08-06 Shreya Meel , Mohamed Nomeir , Pasan Dissanayake , Sanghamitra Dutta , Sennur Ulukus

Bias in data can have unintended consequences that propagate to the design, development, and deployment of machine learning models. In the financial services sector, this can result in discrimination from certain financial instruments and…

Cryptography and Security · Computer Science 2019-11-12 Reginald Bryant , Celia Cintas , Isaac Wambugu , Andrew Kinai , Komminist Weldemariam

Machine learning algorithms are extensively used to make increasingly more consequential decisions about people, so achieving optimal predictive performance can no longer be the only focus. A particularly important consideration is fairness…

Machine Learning · Computer Science 2020-06-09 Giulio Morina , Viktoriia Oliinyk , Julian Waton , Ines Marusic , Konstantinos Georgatzis

An information-theoretic privacy mechanism design is studied, where an agent observes useful data $Y$ which is correlated with the private data $X$. The agent wants to reveal the information to a user, hence, the agent utilizes a privacy…

Information Theory · Computer Science 2026-01-09 Amirreza Zamani , Parastoo Sadeghi , Mikael Skoglund

We turn the definition of individual fairness on its head---rather than ascertaining the fairness of a model given a predetermined metric, we find a metric for a given model that satisfies individual fairness. This can facilitate the…

Machine Learning · Computer Science 2020-10-14 Samuel Yeom , Matt Fredrikson

Algorithmic decisions are now being used on a daily basis, and based on Machine Learning (ML) processes that may be complex and biased. This raises several concerns given the critical impact that biased decisions may have on individuals or…

Machine Learning · Computer Science 2020-11-03 Guilherme Alves , Vaishnavi Bhargava , Miguel Couceiro , Amedeo Napoli

We propose a general statistical inference framework to capture the privacy threat incurred by a user that releases data to a passive but curious adversary, given utility constraints. We show that applying this general framework to the…

Information Theory · Computer Science 2012-10-09 Flavio du Pin Calmon , Nadia Fawaz

Unsupervised anomaly detection is a critical task in many high-social-impact applications such as finance, healthcare, social media, and cybersecurity, where demographics involving age, gender, race, disease, etc, are used frequently. In…

Machine Learning · Computer Science 2025-05-19 Feng Xiao , Xiaoying Tang , Jicong Fan

While model fairness improvement has been explored previously, existing methods invariably rely on adjusting explicit sensitive attribute values in order to improve model fairness in downstream tasks. However, we observe a trend in which…

Machine Learning · Computer Science 2024-09-30 Hongliang Ni , Lei Han , Tong Chen , Shazia Sadiq , Gianluca Demartini

Previous studies have developed fairness methods for biased models that exhibit discriminatory behaviors towards specific subgroups. While these models have shown promise in achieving fair predictions, recent research has identified their…

Machine Learning · Computer Science 2024-08-28 Huan Tian , Guangsheng Zhang , Bo Liu , Tianqing Zhu , Ming Ding , Wanlei Zhou

Machine learning models are central to people's lives and impact society in ways as fundamental as determining how people access information. The gravity of these models imparts a responsibility to model developers to ensure that they are…

Applications · Statistics 2020-07-13 Cyrus DiCiccio , Sriram Vasudevan , Kinjal Basu , Krishnaram Kenthapadi , Deepak Agarwal

Fairness in algorithmic decision-making is often framed in terms of individual fairness, which requires that similar individuals receive similar outcomes. A system violates individual fairness if there exists a pair of inputs differing only…

Software Engineering · Computer Science 2026-02-19 Ranit Debnath Akash , Ashish Kumar , Verya Monjezi , Ashutosh Trivedi , Gang , Tan , Saeid Tizpaz-Niari

There is increasing attention to evaluating the fairness of search system ranking decisions. These metrics often consider the membership of items to particular groups, often identified using protected attributes such as gender or ethnicity.…

Information Retrieval · Computer Science 2021-08-12 Ömer Kırnap , Fernando Diaz , Asia Biega , Michael Ekstrand , Ben Carterette , Emine Yılmaz

Deep neural networks (DNNs) are increasingly used in real-world applications (e.g. facial recognition). This has resulted in concerns about the fairness of decisions made by these models. Various notions and measures of fairness have been…

Machine Learning · Computer Science 2021-01-22 Vedant Nanda , Samuel Dooley , Sahil Singla , Soheil Feizi , John P. Dickerson

We consider the problem of fitting a linear model to data held by individuals who are concerned about their privacy. Incentivizing most players to truthfully report their data to the analyst constrains our design to mechanisms that provide…

Computer Science and Game Theory · Computer Science 2015-06-12 Rachel Cummings , Stratis Ioannidis , Katrina Ligett