English
Related papers

Related papers: Equitability Analysis of the Maximal Information C…

200 papers

Computers are increasingly used to make decisions that have significant impact in people's lives. Often, these predictions can affect different population subgroups disproportionately. As a result, the issue of fairness has received much…

Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable…

Machine Learning · Computer Science 2025-07-01 Haosen Ge , Hamsa Bastani , Osbert Bastani

We study some of the most commonly used mutual information estimators, based on histograms of fixed or adaptive bin size, $k$-nearest neighbors and kernels, and focus on optimal selection of their free parameters. We examine the consistency…

Data Analysis, Statistics and Probability · Physics 2015-05-13 Angeliki Papana , Dimitris Kugiumtzis

This paper considers the problem of appearance indication of useful acoustic signal in the signal/noise mixture. Various information characteristics (information entropy, Jensen-Shannon divergence, spectral information divergence and…

Methodology · Statistics 2023-04-14 Leonid Berlin , Andrey Galyaev , Pavel Lysenko

For many tasks, the reward function is inaccessible to introspection or too complex to be specified procedurally, and must instead be learned from user data. Prior work has evaluated learned reward functions by evaluating policies optimized…

Machine Learning · Computer Science 2021-03-19 Adam Gleave , Michael Dennis , Shane Legg , Stuart Russell , Jan Leike

Relational data augmentation is a powerful technique for enhancing data analytics and improving machine learning models by incorporating columns from external datasets. However, it is challenging to efficiently discover relevant external…

Databases · Computer Science 2025-03-06 Aécio Santos , Flip Korn , Juliana Freire

Mutual information (MI) is a useful information-theoretic measure to quantify the statistical dependence between two random variables: $X$ and $Y$. Often, we are interested in understanding how the dependence between $X$ and $Y$ in one set…

Information Theory · Computer Science 2025-07-22 Chetan Gohil , Oliver M Cliff , James M. Shine , Ben D. Fulcher , Joseph T. Lizier

Conformal prediction is a statistically rigorous method for quantifying uncertainty in models by having them output sets of predictions, with larger sets indicating more uncertainty. However, prediction sets are not inherently actionable;…

Machine Learning · Computer Science 2025-02-17 Jesse C. Cresswell , Bhargava Kumar , Yi Sui , Mouloud Belbahri

Estimating the proportion of signals hidden in a large amount of noise variables is of interest in many scientific inquires. In this paper, we consider realistic but theoretically challenging settings with arbitrary covariance dependence…

Methodology · Statistics 2021-04-12 X. Jessie Jeng

We study fair resource allocation under a connectedness constraint wherein a set of indivisible items are arranged on a path and only connected subsets of items may be allocated to the agents. An allocation is deemed fair if it satisfies…

Computer Science and Game Theory · Computer Science 2021-01-27 Neeldhara Misra , Chinmay Sonar , P. R. Vaidyanathan , Rohit Vaish

Information retrieval (IR) systems often leverage query data to suggest relevant items to users. This introduces the possibility of unfairness if the query (i.e., input) and the resulting recommendations unintentionally correlate with…

Machine Learning · Statistics 2019-09-17 Rinat Khaziev , Bryce Casavant , Pearce Washabaugh , Amy A. Winecoff , Matthew Graham

Metric search commonly involves finding objects similar to a given sample object. We explore a generalization, where the desired result is a fair tradeoff between multiple query objects. This builds on previous results on complex queries,…

Data Structures and Algorithms · Computer Science 2021-08-10 Magnus Lie Hetland , Halvard Hummel

The Jaccard similarity index has often been employed in science and technology as a means to quantify the similarity between two sets. When modified to operate on real-valued values, the Jaccard similarity index can be applied to compare…

Data Analysis, Statistics and Probability · Physics 2024-10-23 Gonzalo Travieso , Alexandre Benatti , Luciano da F. Costa

Fairness concerns about algorithmic decision-making systems have been mainly focused on the outputs (e.g., the accuracy of a classifier across individuals or groups). However, one may additionally be concerned with fairness in the inputs.…

Machine Learning · Computer Science 2020-05-26 Bashir Rastegarpanah , Mark Crovella , Krishna P. Gummadi

Estimation of mutual information between (multidimensional) real-valued variables is used in analysis of complex systems, biological systems, and recently also quantum systems. This estimation is a hard problem, and universally good…

Quantitative Methods · Quantitative Biology 2019-08-14 Caroline M. Holmes , Ilya Nemenman

With the rapid growth in language processing applications, fairness has emerged as an important consideration in data-driven solutions. Although various fairness definitions have been explored in the recent literature, there is lack of…

Machine Learning · Computer Science 2022-03-17 Satyapriya Krishna , Rahul Gupta , Apurv Verma , Jwala Dhamala , Yada Pruksachatkun , Kai-Wei Chang

With the growing adoption of machine learning (ML) systems in areas like law enforcement, criminal justice, finance, hiring, and admissions, it is increasingly critical to guarantee the fairness of decisions assisted by ML. In this paper,…

Machine Learning · Computer Science 2024-05-17 Meiyu Zhong , Ravi Tandon

The task of infomin learning aims to learn a representation with high utility while being uninformative about a specified target, with the latter achieved by minimising the mutual information between the representation and the target. It…

Machine Learning · Computer Science 2023-02-22 Yanzhi Chen , Weihao Sun , Yingzhen Li , Adrian Weller

This article proposes a new method to estimate an existing mutual information based dependence measure using histogram density estimates. Finding a suitable bin length for histogram is an open problem. We propose a new way of computing the…

Information Theory · Computer Science 2015-09-15 Namita Jain , C. A. Murthy

The most fundamental problem in statistics is the inference of an unknown probability distribution from a finite number of samples. For a specific observed data set, answers to the following questions would be desirable: (1) Estimation:…

Statistics Theory · Mathematics 2013-01-23 Ali Kinkhabwala