English
Related papers

Related papers: Revealing Neural Network Bias to Non-Experts Throu…

200 papers

Word vector embeddings have been shown to contain and amplify biases in data they are extracted from. Consequently, many techniques have been proposed to identify, mitigate, and attenuate these biases in word representations. In this paper,…

Computation and Language · Computer Science 2021-04-08 Archit Rathore , Sunipa Dev , Jeff M. Phillips , Vivek Srikumar , Yan Zheng , Chin-Chia Michael Yeh , Junpeng Wang , Wei Zhang , Bei Wang

Many modern Artificial Intelligence (AI) systems make use of data embeddings, particularly in the domain of Natural Language Processing (NLP). These embeddings are learnt from data that has been gathered "from the wild" and have been found…

Computation and Language · Computer Science 2018-06-19 Adam Sutton , Thomas Lansdall-Welfare , Nello Cristianini

Automatic facial emotion recognition is a challenging task that has gained significant scientific interest over the past few years, but the problem of emotion recognition for a group of people has been less extensively studied. However, it…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Samanyou Garg

Now that AI-driven moderation has become pervasive in everyday life, we often hear claims that "the AI is biased". While this is often said jokingly, the light-hearted remark reflects a deeper concern. How can we be certain that an online…

Computation and Language · Computer Science 2026-04-02 Subhojit Ghimire

Representation bias is one of the most common types of biases in artificial intelligence (AI) systems, causing AI models to perform poorly on underrepresented data segments. Although AI practitioners use various methods to reduce…

Human-Computer Interaction · Computer Science 2025-02-28 Aditya Bhattacharya , Simone Stumpf , Robin De Croon , Katrien Verbert

Counterfactual reasoning -- the practice of asking ``what if'' by varying inputs and observing changes in model behavior -- has become central to interpretable and fair AI. This thesis develops frameworks that use counterfactuals to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Pushkar Shukla

The paper proposes summarized attribution-based post-hoc explanations for the detection and identification of bias in data. A global explanation is proposed, and a step-by-step framework on how to detect and test bias is introduced. Since…

Machine Learning · Computer Science 2020-10-26 Agnieszka Mikołajczyk , Michał Grochowski , Arkadiusz Kwasigroch

Human society had a long history of suffering from cognitive biases leading to social prejudices and mass injustice. The prevalent existence of cognitive biases in large volumes of historical data can pose a threat of being manifested as…

Computers and Society · Computer Science 2020-07-29 Procheta Sen , Debasis Ganguly

Computer Vision (CV) has achieved remarkable results, outperforming humans in several tasks. Nonetheless, it may result in significant discrimination if not handled properly as CV systems highly depend on the data they are fed with and can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Simone Fabbrizzi , Symeon Papadopoulos , Eirini Ntoutsi , Ioannis Kompatsiaris

Gender bias is rampant in AI systems, causing bad user experience, injustices, and mental harm to women. School curricula fail to educate AI creators on this topic, leaving them unprepared to mitigate gender bias in AI. In this paper, we…

Human-Computer Interaction · Computer Science 2023-09-18 Kyrie Zhixuan Zhou , Jiaxun Cao , Xiaowen Yuan , Daniel E. Weissglass , Zachary Kilhoffer , Madelyn Rose Sanfilippo , Xin Tong

This paper presents an algorithm for enumerating biases in word embeddings. The algorithm exposes a large number of offensive associations related to sensitive features such as race and gender on publicly available embeddings, including a…

Computation and Language · Computer Science 2019-06-21 Nathaniel Swinger , Maria De-Arteaga , Neil Thomas Heffernan , Mark DM Leiserson , Adam Tauman Kalai

The continued improvements in the predictive accuracy of machine learning models have allowed for their widespread practical application. Yet, many decisions made with seemingly accurate models still require verification by domain experts.…

Human-Computer Interaction · Computer Science 2020-03-06 Oscar Gomez , Steffen Holter , Jun Yuan , Enrico Bertini

Bias in AI/ML-based systems is a ubiquitous problem and bias in AI/ML systems may negatively impact society. There are many reasons behind a system being biased. The bias can be due to the algorithm we are using for our problem or may be…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Vedant V. Kandge , Siddhant V. Kandge , Kajal Kumbharkar , Tanuja Pattanshetti

Fairness is a fundamental requirement for trustworthy and human-centered Artificial Intelligence (AI) system. However, deep neural networks (DNNs) tend to make unfair predictions when the training data are collected from different…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Ruichen Yao , Ziteng Cui , Xiaoxiao Li , Lin Gu

Recently, much attention has been paid to the societal impact of AI, especially concerns regarding its fairness. A growing body of research has identified unfair AI systems and proposed methods to debias them, yet many challenges remain.…

Artificial Intelligence · Computer Science 2021-04-20 Ziqian Zeng , Rashidul Islam , Kamrun Naher Keya , James Foulds , Yangqiu Song , Shimei Pan

Convolutional neural networks (CNNs) define the current state-of-the-art for image recognition. With their emerging popularity, especially for critical applications like medical image analysis or self-driving cars, confirmability is…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Keyang Zhou , Bernhard Kainz

Neural networks have achieved remarkable performance across various problem domains, but their widespread applicability is hindered by inherent limitations such as overconfidence in predictions, lack of interpretability, and vulnerability…

Machine Learning · Statistics 2023-09-29 Julyan Arbel , Konstantinos Pitas , Mariia Vladimirova , Vincent Fortuin

Detecting biases in artificial intelligence has become difficult because of the impenetrable nature of deep learning. The central difficulty is in relating unobservable phenomena deep inside models with observable, outside quantities that…

Computation and Language · Computer Science 2019-12-24 Lizhen Liang , Daniel E. Acuna

Artificial intelligence (AI) systems power the world we live in. Deep neural networks (DNNs) are able to solve tasks in an ever-expanding landscape of scenarios, but our eagerness to apply these powerful models leads us to focus on their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Loris Giulivi , Mark James Carman , Giacomo Boracchi

Bayesian Neural Networks (BNNs) provide a tool to estimate the uncertainty of a neural network by considering a distribution over weights and sampling different models for each input. In this paper, we propose a method for uncertainty…

Machine Learning · Computer Science 2024-10-28 Illia Oleksiienko , Dat Thanh Tran , Alexandros Iosifidis