English
Related papers

Related papers: What will it take to generate fairness-preserving …

200 papers

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their…

Machine Learning · Computer Science 2019-06-05 Gregory Plumb , Maruan Al-Shedivat , Eric Xing , Ameet Talwalkar

The treatment of fairness in decision-making literature usually involves quantifying fairness using objective measures. This work takes a critical stance to highlight the limitations of these approaches (group fairness and individual…

Computers and Society · Computer Science 2024-07-03 Sarra Tajouri , Alexis Tsoukiàs

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

Applying standard machine learning approaches for classification can produce unequal results across different demographic groups. When then used in real-world settings, these inequities can have negative societal impacts. This has motivated…

Machine Learning · Computer Science 2022-01-13 Preston Putzel , Scott Lee

In this work, we argue for the importance of causal reasoning in creating fair algorithms for decision making. We give a review of existing approaches to fairness, describe work in causality necessary for the understanding of causal…

Artificial Intelligence · Computer Science 2018-05-16 Joshua R. Loftus , Chris Russell , Matt J. Kusner , Ricardo Silva

Although neural networks can achieve very high predictive performance on various different tasks such as image recognition or natural language processing, they are often considered as opaque "black boxes". The difficulty of interpreting the…

Machine Learning · Statistics 2020-01-22 Enguerrand Horel , Virgile Mison , Tao Xiong , Kay Giesecke , Lidia Mangu

Fairness in AI and machine learning systems has become a fundamental problem in the accountability of AI systems. While the need for accountability of AI models is near ubiquitous, healthcare in particular is a challenging field where…

Machine Learning · Computer Science 2021-02-09 Ming Yuan , Vikas Kumar , Muhammad Aurangzeb Ahmad , Ankur Teredesai

Causal machine learning tools are beginning to see use in real-world policy evaluation tasks to flexibly estimate treatment effects. One issue with these methods is that the machine learning models used are generally black boxes, i.e.,…

Machine Learning · Computer Science 2024-04-01 Patrick Rehill , Nicholas Biddle

Fairness in machine learning is of considerable interest in recent years owing to the propensity of algorithms trained on historical data to amplify and perpetuate historical biases. In this paper, we argue for a formal reconstruction of…

Artificial Intelligence · Computer Science 2023-06-27 Vaishak Belle

Most AI systems are black boxes generating reasonable outputs for given inputs. Some domains, however, have explainability and trustworthiness requirements that cannot be directly met by these approaches. Various methods have therefore been…

Artificial Intelligence · Computer Science 2024-10-28 Hormoz Shahrzad , Babak Hodjat , Risto Miikkulainen

Algorithmic fairness has aroused considerable interests in data mining and machine learning communities recently. So far the existing research has been mostly focusing on the development of quantitative metrics to measure algorithm…

Machine Learning · Computer Science 2021-08-12 Weishen Pan , Sen Cui , Jiang Bian , Changshui Zhang , Fei Wang

It is well understood that classification algorithms, for example, for deciding on loan applications, cannot be evaluated for fairness without taking context into account. We examine what can be learned from a fairness oracle equipped with…

Machine Learning · Computer Science 2020-04-07 Cynthia Dwork , Christina Ilvento , Guy N. Rothblum , Pragya Sur

Recent attempts to achieve fairness in predictive models focus on the balance between fairness and accuracy. In sensitive applications such as healthcare or criminal justice, this trade-off is often undesirable as any increase in prediction…

Machine Learning · Statistics 2018-12-12 Irene Chen , Fredrik D. Johansson , David Sontag

In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to…

Machine Learning · Computer Science 2022-07-14 José Pombal , André F. Cruz , João Bravo , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

Though recommender systems are defined by personalization, recent work has shown the importance of additional, beyond-accuracy objectives, such as fairness. Because users often expect their recommendations to be purely personalized, these…

Information Retrieval · Computer Science 2021-03-17 Nasim Sonboli , Jessie J. Smith , Florencia Cabral Berenfus , Robin Burke , Casey Fiesler

Recent work in explanation generation for decision making agents has looked at how unexplained behavior of autonomous systems can be understood in terms of differences in the model of the system and the human's understanding of the same,…

Artificial Intelligence · Computer Science 2018-02-06 Tathagata Chakraborti , Sarath Sreedharan , Sachin Grover , Subbarao Kambhampati

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

While research on applications and evaluations of explanation methods continues to expand, fairness of the explanation methods concerning disparities in their performance across subgroups remains an often overlooked aspect. In this paper,…

Computation and Language · Computer Science 2025-05-05 Mahdi Dhaini , Ege Erdogan , Nils Feldhus , Gjergji Kasneci

What does it mean for a machine learning model to be `fair', in terms which can be operationalised? Should fairness consist of ensuring everyone has an equal probability of obtaining some benefit, or should we aim instead to minimise the…

Computers and Society · Computer Science 2021-03-24 Reuben Binns

We evaluated whether model explanations could efficiently detect bias in image classification by highlighting discriminating features, thereby removing the reliance on sensitive attributes for fairness calculations. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Schrasing Tong , Lalana Kagal