English
Related papers

Related papers: Thinking Outside the Box: Orthogonal Approach to E…

200 papers

Predictive models are increasingly deployed for the purpose of determining access to services such as credit, insurance, and employment. Despite potential gains in productivity and efficiency, several potential problems have yet to be…

Machine Learning · Computer Science 2016-11-16 Julius Adebayo , Lalana Kagal

Mitigating the discrimination of machine learning models has gained increasing attention in medical image analysis. However, rare works focus on fair treatments for patients with multiple sensitive demographic ones, which is a crucial yet…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Wenlong Deng , Yuan Zhong , Qi Dou , Xiaoxiao Li

Deep learning has demonstrated state-of-the-art performance for a variety of challenging computer vision tasks. On one hand, this has enabled deep visual models to pave the way for a plethora of critical applications like disease…

Machine Learning · Computer Science 2020-06-29 Mohammad A. A. K. Jalwana , Naveed Akhtar , Mohammed Bennamoun , Ajmal Mian

Black box systems for automated decision making, often based on machine learning over (big) data, map a user's features into a class or a score without exposing the reasons why. This is problematic not only for lack of transparency, but…

Artificial Intelligence · Computer Science 2018-06-27 Dino Pedreschi , Fosca Giannotti , Riccardo Guidotti , Anna Monreale , Luca Pappalardo , Salvatore Ruggieri , Franco Turini

The research question this report addresses is: how, and to what extent, those directly involved with the design, development and employment of a specific black box algorithm can be certain that it is not unlawfully discriminating (directly…

Databases · Computer Science 2016-04-26 Steffen Staab , Sophie Stalla-Bourdillon , Laura Carmichael

AI-enhanced personality assessments are increasingly shaping hiring decisions, using affective computing to predict traits from the Big Five (OCEAN) model. However, integrating AI into these assessments raises ethical concerns, especially…

Human-Computer Interaction · Computer Science 2025-11-24 Dena F. Mujtaba , Nihar R. Mahapatra

Purpose: To analyze and remove protected feature effects in chest radiograph embeddings of deep learning models. Methods: An orthogonalization is utilized to remove the influence of protected features (e.g., age, sex, race) in CXR…

Machine Learning · Computer Science 2024-06-12 Tobias Weber , Michael Ingrisch , Bernd Bischl , David Rügamer

With the widespread and pervasive use of Artificial Intelligence (AI) for automated decision-making systems, AI bias is becoming more apparent and problematic. One of its negative consequences is discrimination: the unfair, or unequal…

Computers and Society · Computer Science 2021-06-07 Xavier Ferrer , Tom van Nuenen , Jose M. Such , Mark Coté , Natalia Criado

Measuring biases of vision systems with respect to protected attributes like gender and age is critical as these systems gain widespread use in society. However, significant correlations between attributes in benchmark datasets make it…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Chandan Singh , Guha Balakrishnan , Pietro Perona

Artificial Intelligence (AI) systems are not intrinsically neutral and biases trickle in any type of technological tool. In particular when dealing with people, the impact of AI algorithms' technical errors originating with mislabeled data…

Artificial Intelligence · Computer Science 2025-04-03 Camilla Quaresmini , Giuseppe Primiero

Biased human decisions have consequential impacts across various domains, yielding unfair treatment of individuals and resulting in suboptimal outcomes for organizations and society. In recognition of this fact, organizations regularly…

Machine Learning · Computer Science 2024-12-11 Wanxue Dong , Maria De-Arteaga , Maytal Saar-Tsechansky

To reduce human error and prejudice, many high-stakes decisions have been turned over to machine algorithms. However, recent research suggests that this does not remove discrimination, and can perpetuate harmful stereotypes. While…

Computers and Society · Computer Science 2019-12-18 Yuzi He , Keith Burghardt , Kristina Lerman

Current AI regulations require discarding sensitive features (e.g., gender, race, religion) in the algorithm's decision-making process to prevent unfair outcomes. However, even without sensitive features in the training set, algorithms can…

Machine Learning · Computer Science 2023-08-29 Giandomenico Cornacchia , Vito Walter Anelli , Fedelucio Narducci , Azzurra Ragone , Eugenio Di Sciascio

Information systems (IS) are frequently designed to leverage the negative effect of anchoring bias to influence individuals' decision-making (e.g., by manipulating purchase decisions). Recent advances in Artificial Intelligence (AI) and the…

Computers and Society · Computer Science 2024-05-09 Felix Haag , Carlo Stingl , Katrin Zerfass , Konstantin Hopf , Thorsten Staake

Machine learning systems are often trained using data collected from historical decisions. If past decisions were biased, then automated systems that learn from historical data will also be biased. We propose a black-box approach to…

Machine Learning · Computer Science 2021-02-08 Sahil Verma , Michael Ernst , Rene Just

When machine-learning algorithms are used in high-stakes decisions, we want to ensure that their deployment leads to fair and equitable outcomes. This concern has motivated a fast-growing literature that focuses on diagnosing and addressing…

Computers and Society · Computer Science 2023-09-26 Talia Gillis , Bryce McLaughlin , Jann Spiess

It has been rightfully emphasized that the use of AI for clinical decision making could amplify health disparities. An algorithm may encode protected characteristics, and then use this information for making predictions due to undesirable…

Machine Learning · Computer Science 2022-07-22 Ben Glocker , Charles Jones , Melanie Bernhardt , Stefan Winzeck

Predictive algorithms have a powerful potential to offer benefits in areas as varied as medicine or education. However, these algorithms and the data they use are built by humans, consequently, they can inherit the bias and prejudices…

Human-Computer Interaction · Computer Science 2022-03-22 Cristina Manresa-Yee , Silvia Ramis

AI-driven decision-making can lead to discrimination against certain individuals or social groups based on protected characteristics/attributes such as race, gender, or age. The domain of fairness-aware machine learning focuses on methods…

Machine Learning · Computer Science 2023-02-14 Arjun Roy , Jan Horstmann , Eirini Ntoutsi

From massive face-recognition-based surveillance and machine-learning-based decision systems predicting crime recidivism rates, to the move towards automated health diagnostic systems, artificial intelligence (AI) is being used in scenarios…

Computers and Society · Computer Science 2019-08-20 Timnit Gebru
‹ Prev 1 2 3 10 Next ›