English
Related papers

Related papers: Revealing Neural Network Bias to Non-Experts Throu…

200 papers

Biases in Artificial Intelligence (AI) or Machine Learning (ML) systems due to skewed datasets problematise the application of prediction models in practice. Representation bias is a prevalent form of bias found in the majority of datasets.…

Human-Computer Interaction · Computer Science 2024-07-16 Aditya Bhattacharya , Simone Stumpf , Katrien Verbert

Heuristics and cognitive biases are an integral part of human decision-making. Automatically detecting a particular cognitive bias could enable intelligent tools to provide better decision-support. Detecting the presence of a cognitive bias…

Human-Computer Interaction · Computer Science 2024-01-15 Stephen Pilli

As the demand for interpretable machine learning approaches continues to grow, there is an increasing necessity for human involvement in providing informative explanations for model decisions. This is necessary for building trust and…

Machine Learning · Computer Science 2024-10-29 Peiyu Li , Omar Bahri , Pouya Hosseinzadeh , Soukaïna Filali Boubrahimi , Shah Muhammad Hamdi

Fair machine learning aims to mitigate the biases of model predictions against certain subpopulations regarding sensitive attributes such as race and gender. Among the many existing fairness notions, counterfactual fairness measures the…

Machine Learning · Computer Science 2022-01-12 Jing Ma , Ruocheng Guo , Mengting Wan , Longqi Yang , Aidong Zhang , Jundong Li

Many modern machine learning algorithms mitigate bias by enforcing fairness constraints across coarsely-defined groups related to a sensitive attribute like gender or race. However, these algorithms seldom account for within-group…

Machine Learning · Computer Science 2023-01-24 Myra Cheng , Maria De-Arteaga , Lester Mackey , Adam Tauman Kalai

In recent years, the rapid advancement of machine learning (ML) models, particularly transformer-based pre-trained models, has revolutionized Natural Language Processing (NLP) and Computer Vision (CV) fields. However, researchers have…

Computation and Language · Computer Science 2023-09-27 Nayeon Lee , Yejin Bang , Holy Lovenia , Samuel Cahyawijaya , Wenliang Dai , Pascale Fung

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by additionally making use of graph structure based on the relational inductive bias (edge bias), rather than treating the nodes as collections of independent and identically…

Machine Learning · Computer Science 2023-11-07 Sitao Luan , Chenqing Hua , Qincheng Lu , Jiaqi Zhu , Xiao-Wen Chang , Doina Precup

The measurement of bias in machine learning often focuses on model performance across identity subgroups (such as man and woman) with respect to groundtruth labels. However, these methods do not directly measure the associations that a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Osman Aka , Ken Burke , Alex Bäuerle , Christina Greer , Margaret Mitchell

A growing proportion of human interactions are digitized on social media platforms and subjected to algorithmic decision-making, and it has become increasingly important to ensure fair treatment from these algorithms. In this work, we…

Information Retrieval · Computer Science 2020-09-21 Rashidul Islam , Kamrun Naher Keya , Ziqian Zeng , Shimei Pan , James Foulds

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Although much progress has been made in visual emotion recognition, researchers have realized that modern deep networks tend to exploit dataset characteristics to learn spurious statistical associations between the input and the target.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yuedong Chen , Xu Yang , Tat-Jen Cham , Jianfei Cai

Named Entity Recognition (NER) is often the first step towards automated Knowledge Base (KB) generation from raw text. In this work, we assess the bias in various Named Entity Recognition (NER) systems for English across different…

Computation and Language · Computer Science 2020-08-11 Shubhanshu Mishra , Sijun He , Luca Belli

Graph Neural Networks (GNNs) perform well in community detection and molecule classification. Counterfactual Explanations (CE) provide counter-examples to overcome the transparency limitations of black-box models. Due to the growing…

Machine Learning · Computer Science 2024-06-12 Mario Alfonso Prado-Romero , Bardh Prenkaj , Giovanni Stilo , Fosca Giannotti

Many recent neural models have shown remarkable empirical results in Machine Reading Comprehension, but evidence suggests sometimes the models take advantage of dataset biases to predict and fail to generalize on out-of-sample data. While…

Computation and Language · Computer Science 2022-07-20 Yifan Zhong , Haohan Wang , Eric P. Xing

Ensuring a neural network is not relying on protected attributes (e.g., race, sex, age) for predictions is crucial in advancing fair and trustworthy AI. While several promising methods for removing attribute bias in neural networks have…

Machine Learning · Computer Science 2023-11-17 Jiazhi Li , Mahyar Khayatkhoei , Jiageng Zhu , Hanchen Xie , Mohamed E. Hussein , Wael AbdAlmageed

Large language models (LLMs) have garnered significant attention for their remarkable performance in a continuously expanding set of natural language processing tasks. However, these models have been shown to harbor inherent societal…

Computation and Language · Computer Science 2023-10-16 Abel Salinas , Louis Penafiel , Robert McCormack , Fred Morstatter

Interpreting the inference-time behavior of deep neural networks remains a challenging problem. Existing approaches to counterfactual explanation typically ask: What is the closest alternative input that would alter the model's prediction…

Machine Learning · Computer Science 2026-02-12 Brian Hyeongseok Kim , Jacqueline L. Mitchell , Chao Wang

Deep neural networks often rely on spurious correlations in training data, leading to biased or unfair predictions in safety-critical domains such as medicine and autonomous driving. While conventional bias mitigation typically requires…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Sai Siddhartha Chary Aylapuram , Veeraraju Elluru , Shivang Agarwal

Graph Neural Networks (GNNs) have shown satisfying performance in various graph analytical problems. Hence, they have become the \emph{de facto} solution in a variety of decision-making scenarios. However, GNNs could yield biased results…

Machine Learning · Computer Science 2022-06-27 Yushun Dong , Song Wang , Yu Wang , Tyler Derr , Jundong Li

Counterfactual explanations are increasingly used as an Explainable Artificial Intelligence (XAI) technique to provide stakeholders of complex machine learning algorithms with explanations for data-driven decisions. The popularity of…

Artificial Intelligence · Computer Science 2023-04-26 Dieter Brughmans , Lissa Melis , David Martens