English
Related papers

Related papers: Information-Theoretic Fairness with A Bounded Stat…

200 papers

We study fairness in classification, where individuals are classified, e.g., admitted to a university, and the goal is to prevent discrimination against individuals based on their membership in some group, while maintaining utility for the…

Computational Complexity · Computer Science 2011-11-30 Cynthia Dwork , Moritz Hardt , Toniann Pitassi , Omer Reingold , Rich Zemel

We consider problems of authentication using secret key generation under a privacy constraint on the enrolled source data. An adversary who has access to the stored description and correlated side information tries to deceive the…

Cryptography and Security · Computer Science 2015-04-08 Kittipong Kittichokechai , Giuseppe Caire

Bounded rationality, that is, decision-making and planning under resource limitations, is widely regarded as an important open problem in artificial intelligence, reinforcement learning, computational neuroscience and economics. This paper…

Machine Learning · Statistics 2015-12-22 Pedro A. Ortega , Daniel A. Braun , Justin Dyer , Kee-Eung Kim , Naftali Tishby

We introduce a boosting algorithm to pre-process data for fairness. Starting from an initial fair but inaccurate distribution, our approach shifts towards better data fitting while still ensuring a minimal fairness guarantee. To do so, it…

Machine Learning · Statistics 2023-08-16 Alexander Soen , Hisham Husain , Richard Nock

Diversity maximization problem is a well-studied problem where the goal is to find $k$ diverse items. Fair diversity maximization aims to select a diverse subset of $k$ items from a large dataset, while requiring that each group of items be…

Data Structures and Algorithms · Computer Science 2025-06-11 Florian Adriaens , Nikolaj Tatti

Statistical modeling can involve a tension between assumptions and statistical identification. The law of the observable data may not uniquely determine the value of a target parameter without invoking a key assumption, and, while…

Methodology · Statistics 2022-12-06 Paul Gustafson

We consider the problem of deep fair clustering, which partitions data into clusters via the representations extracted by deep neural networks while hiding sensitive data attributes. To achieve fairness, existing methods present a variety…

Machine Learning · Computer Science 2024-03-26 Xiang Zhang

We present a data-driven prescriptive framework for fair decisions, motivated by hiring. An employer evaluates a set of applicants based on their observable attributes. The goal is to hire the best candidates while avoiding bias with regard…

Econometrics · Economics 2022-06-22 Yinchu Zhu , Ilya O. Ryzhov

Intelligent systems must deploy internal representations that are simultaneously structured -- to support broad generalization -- and selective -- to preserve input identity. We expose a fundamental limit on this tradeoff. For any model…

Effective machine learning models can automatically learn useful information from a large quantity of data and provide decisions in a high accuracy. These models may, however, lead to unfair predictions in certain sense among the population…

Machine Learning · Computer Science 2020-06-19 Mingliang Chen , Min Wu

When machine-learning algorithms are used in high-stakes decisions, we want to ensure that their deployment leads to fair and equitable outcomes. This concern has motivated a fast-growing literature that focuses on diagnosing and addressing…

Computers and Society · Computer Science 2023-09-26 Talia Gillis , Bryce McLaughlin , Jann Spiess

We present a unified framework for quantifying the similarity between representations through the lens of \textit{usable} information, offering a rigorous theoretical and empirical synthesis across three key dimensions. First, addressing…

Machine Learning · Computer Science 2026-05-29 Antonio Almudévar , Alfonso Ortega

Reducing hidden bias in the data and ensuring fairness in algorithmic data analysis has recently received significant attention. We complement several recent papers in this line of research by introducing a general method to reduce bias in…

Data Structures and Algorithms · Computer Science 2021-03-09 Aris Anagnostopoulos , Luca Becchetti , Adriano Fazzone , Cristina Menghini , Chris Schwiegelshohn

This paper proposes an operational measure of non-stochastic information leakage to formalize privacy against a brute-force guessing adversary. The information is measured by non-probabilistic uncertainty of uncertain variables, the…

Information Theory · Computer Science 2021-07-05 Ni Ding , Farhad Farokhi

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

Organizations that own data face increasing legal liability for its discriminatory use against protected demographic groups, extending to contractual transactions involving third parties access and use of the data. This is problematic,…

Machine Learning · Computer Science 2020-06-17 Xavier Gitiaux , Huzefa Rangwala

We propose a new family of fairness definitions for classification problems that combine some of the best properties of both statistical and individual notions of fairness. We posit not only a distribution over individuals, but also a…

Machine Learning · Computer Science 2019-12-18 Michael Kearns , Aaron Roth , Saeed Sharifi-Malvajerdi

This paper proposes an information-theoretic representation learning framework, named conditional information flow maximization, to extract noise-invariant sufficient representations for the input data and target task. It promotes the…

Machine Learning · Computer Science 2024-08-13 Dou Hu , Lingwei Wei , Wei Zhou , Songlin Hu

A deterministic privacy metric using non-stochastic information theory is developed. Particularly, minimax information is used to construct a measure of information leakage, which is inversely proportional to the measure of privacy. Anyone…

Information Theory · Computer Science 2019-03-07 Farhad Farokhi

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the risk of the resulting statistical estimators. We develop private versions of classical…

Statistics Theory · Mathematics 2017-11-16 John Duchi , Martin Wainwright , Michael Jordan