English
Related papers

Related papers: Fair Representations by Compression

200 papers

In recent years, most fairness strategies in machine learning models focus on mitigating unwanted biases by assuming that the sensitive information is observed. However this is not always possible in practice. Due to privacy purposes and…

Machine Learning · Computer Science 2022-10-17 Vincent Grari , Sylvain Lamprier , Marcin Detyniecki

Applications that deal with sensitive information may have restrictions placed on the data available to a machine learning (ML) classifier. For example, in some applications, a classifier may not have direct access to sensitive attributes,…

Machine Learning · Computer Science 2024-03-13 Zachary McBride Lazri , Danial Dervovic , Antigoni Polychroniadou , Ivan Brugere , Dana Dachman-Soled , Min Wu

Learning data representations that are transferable and are fair with respect to certain protected attributes is crucial to reducing unfair decisions while preserving the utility of the data. We propose an information-theoretically…

Machine Learning · Computer Science 2020-03-17 Jiaming Song , Pratyusha Kalluri , Aditya Grover , Shengjia Zhao , Stefano Ermon

The representations of conditional entropy and conditional mutual information are significant in explaining the unique effects among variables. While previous studies based on conditional contrastive sampling have effectively removed…

Machine Learning · Computer Science 2025-01-07 Keng Hou Leong , Yuxuan Xiu , Wai Kin , Chan

We study the problem of performing classification in a manner that is fair for sensitive groups, such as race and gender. This problem is tackled through the lens of disentangled and locally fair representations. We learn a locally fair…

Machine Learning · Computer Science 2022-05-06 Yaron Gurovich , Sagie Benaim , Lior Wolf

As an important problem in modern data analytics, classification has witnessed varieties of applications from different domains. Different from conventional classification approaches, fair classification concerns the issues of unintentional…

Machine Learning · Statistics 2020-12-25 Qing Ye , Weijun Xie

We consider the problem of compressing memoryless binary data with or without side information at the decoder. We review the parity- and the syndrome-based approaches and discuss their theoretical limits, assuming that there exists a…

Information Theory · Computer Science 2010-08-03 Lorenzo Cappellari , Andrea De Giusti

Neural network architectures have been extensively employed in the fair representation learning setting, where the objective is to learn a new representation for a given vector which is independent of sensitive information. Various…

Machine Learning · Computer Science 2022-01-19 Mattia Cerrato , Marius Köppel , Alexander Segner , Stefan Kramer

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

Machine Learning · Statistics 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

Sensitive attributes such as race are rarely available to learners in real world settings as their collection is often restricted by laws and regulations. We give a scheme that allows individuals to release their sensitive information…

Machine Learning · Computer Science 2020-07-14 Hussein Mozannar , Mesrob I. Ohannessian , Nathan Srebro

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

Feature selection eliminates redundancy among features to improve downstream task performance while reducing computational overhead. Existing methods often struggle to capture intricate feature interactions and adapt across diverse…

Machine Learning · Computer Science 2026-03-02 Rui Liu , Tao Zhe , Yanjie Fu , Feng Xia , Ted Senator , Dongjie Wang

Data containing human or social attributes may over- or under-represent groups with respect to salient social attributes such as gender or race, which can lead to biases in downstream applications. This paper presents an algorithmic…

Machine Learning · Computer Science 2020-07-01 L. Elisa Celis , Vijay Keswani , Nisheeth K. Vishnoi

Fair machine learning methods seek to train models that balance model performance across demographic subgroups defined over sensitive attributes like race and gender. Although sensitive attributes are typically assumed to be known during…

Machine Learning · Computer Science 2024-03-22 Akshaj Kumar Veldanda , Ivan Brugere , Sanghamitra Dutta , Alan Mishler , Siddharth Garg

The issue of fairness in machine learning stems from the fact that historical data often displays biases against specific groups of people which have been underprivileged in the recent past, or still are. In this context, one of the…

Machine Learning · Computer Science 2022-01-19 Mattia Cerrato , Marius Köppel , Alexander Segner , Stefan Kramer

Encoded text representations often capture sensitive attributes about individuals (e.g., race or gender), which raise privacy concerns and can make downstream models unfair to certain groups. In this work, we propose FEDERATE, an approach…

Computation and Language · Computer Science 2022-05-13 Gaurav Maheshwari , Pascal Denis , Mikaela Keller , Aurélien Bellet

Fair clustering has gained increasing attention in recent years, especially in applications involving socially sensitive attributes. However, existing fair clustering methods often lack interpretability, limiting their applicability in…

Machine Learning · Computer Science 2025-11-27 Mudi Jiang , Jiahui Zhou , Xinying Liu , Zengyou He , Zhikui Chen

Feature selection is a prevalent data preprocessing paradigm for various learning tasks. Due to the expensive cost of acquiring supervision information, unsupervised feature selection sparks great interests recently. However, existing…

Machine Learning · Computer Science 2021-06-07 Xiaoying Xing , Hongfu Liu , Chen Chen , Jundong Li

In this paper, we study an information-theoretic problem of designing a fair representation that attains bounded statistical (demographic) parity. More specifically, an agent uses some useful data $X$ to solve a task $T$. Since both $X$ and…

Information Theory · Computer Science 2025-08-19 Amirreza Zamani , Abolfazl Changizi , Ragnar Thobaben , Mikael Skoglund

Representation Learning in a heterogeneous space with mixed variables of numerical and categorical types has interesting challenges due to its complex feature manifold. Moreover, feature learning in an unsupervised setup, without class…

Machine Learning · Statistics 2020-10-15 Souradip Chakraborty , Ekansh Verma , Saswata Sahoo , Jyotishka Datta