English
Related papers

Related papers: Towards Socially Responsible AI: Cognitive Bias-Aw…

200 papers

We study fairness in supervised few-shot meta-learning models that are sensitive to discrimination (or bias) in historical data. A machine learning model trained based on biased data tends to make unfair predictions for users from minority…

Machine Learning · Computer Science 2020-09-25 Chen Zhao , Feng Chen

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

Large language models generate complex, open-ended outputs: instead of outputting a class label they write summaries, generate dialogue, or produce working code. In order to asses the reliability of these open-ended generation systems, we…

Computation and Language · Computer Science 2022-11-28 Erik Jones , Jacob Steinhardt

As algorithms increasingly inform and influence decisions made about individuals, it becomes increasingly important to address concerns that these algorithms might be discriminatory. The output of an algorithm can be discriminatory for many…

Machine Learning · Computer Science 2018-03-19 Úrsula Hébert-Johnson , Michael P. Kim , Omer Reingold , Guy N. Rothblum

This study analyzed images generated by three popular generative artificial intelligence (AI) tools - Midjourney, Stable Diffusion, and DALLE 2 - representing various occupations to investigate potential bias in AI generators. Our analysis…

General Economics · Economics 2024-03-06 Mi Zhou , Vibhanshu Abhishek , Timothy Derdenger , Jaymo Kim , Kannan Srinivasan

Current AI regulations require discarding sensitive features (e.g., gender, race, religion) in the algorithm's decision-making process to prevent unfair outcomes. However, even without sensitive features in the training set, algorithms can…

Machine Learning · Computer Science 2023-08-29 Giandomenico Cornacchia , Vito Walter Anelli , Fedelucio Narducci , Azzurra Ragone , Eugenio Di Sciascio

With the widespread adoption of machine learning in the real world, the impact of the discriminatory bias has attracted attention. In recent years, various methods to mitigate the bias have been proposed. However, most of them have not…

Machine Learning · Computer Science 2025-03-26 Kenji Kobayashi , Yuri Nakao

Cognitive biases have been studied in psychology, sociology, and behavioral economics for decades. Traditionally, they have been considered a negative human trait that leads to inferior decision-making, reinforcement of stereotypes, or can…

Information Retrieval · Computer Science 2024-09-02 Markus Schedl , Oleg Lesota , Stefan Brandl , Mohammad Lotfi , Gustavo Junior Escobedo Ticona , Shahed Masoudian

Traditional discussions of bias in large language models focus on a conception of bias closely tied to unfairness, especially as affecting marginalized groups. Recent work raises the novel possibility of assessing the outputs of large…

Artificial Intelligence · Computer Science 2023-11-21 David Thorstad

While the interpretability of machine learning models is often equated with their mere syntactic comprehensibility, we think that interpretability goes beyond that, and that human interpretability should also be investigated from the point…

Machine Learning · Statistics 2021-09-14 Tomáš Kliegr , Štěpán Bahník , Johannes Fürnkranz

This study describes a procedure for applying causal modeling to detect and mitigate algorithmic bias in a multiclass classification problem. The dataset was derived from the FairFace dataset, supplemented with emotional labels generated by…

Machine Learning · Computer Science 2025-01-15 Min Sik Byun , Wendy Wan Yee Hui , Wai Kwong Lau

Research in machine learning (ML) has primarily argued that models trained on incomplete or biased datasets can lead to discriminatory outputs. In this commentary, we propose moving the research focus beyond bias-oriented framings by…

Human-Computer Interaction · Computer Science 2021-09-17 Milagros Miceli , Julian Posada , Tianling Yang

Does machine learning and AI ensure that social biases thrive ? This paper aims to analyse this issue. Indeed, as algorithms are informed by data, if these are corrupted, from a social bias perspective, good machine learning algorithms…

Machine Learning · Statistics 2020-11-03 Bertrand K. Hassani

Despite being responsible for state-of-the-art results in several computer vision and natural language processing tasks, neural networks have faced harsh criticism due to some of their current shortcomings. One of them is that neural…

Most machine learning methods are known to capture and exploit biases of the training data. While some biases are beneficial for learning, others are harmful. Specifically, image captioning models tend to exaggerate biases present in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Kaylee Burns , Lisa Anne Hendricks , Kate Saenko , Trevor Darrell , Anna Rohrbach

Machine learning models are extensively being used to make decisions that have a significant impact on human life. These models are trained over historical data that may contain information about sensitive attributes such as race, sex,…

Machine Learning · Computer Science 2020-10-22 Ramanujam Madhavan , Mohit Wadhwa

Machine learning models have shown exceptional prowess in solving complex issues across various domains. However, these models can sometimes exhibit biased decision-making, resulting in unequal treatment of different groups. Despite…

Machine Learning · Computer Science 2025-06-26 Shuyi Chen , Shixiang Zhu

Human decision-making underlies all economic behavior. For the past four decades, human decision-making under uncertainty has continued to be explained by theoretical models based on prospect theory, a framework that was awarded the Nobel…

Machine Learning · Computer Science 2019-06-21 David D. Bourgin , Joshua C. Peterson , Daniel Reichman , Thomas L. Griffiths , Stuart J. Russell

Machine learning can impact people with legal or ethical consequences when it is used to automate decisions in areas such as insurance, lending, hiring, and predictive policing. In many of these scenarios, previous decisions have been made…

Machine Learning · Statistics 2018-03-09 Matt J. Kusner , Joshua R. Loftus , Chris Russell , Ricardo Silva

As different research works report and daily life experiences confirm, learning models can result in biased outcomes. The biased learned models usually replicate historical discrimination in society and typically negatively affect the less…

Robotics · Computer Science 2022-01-27 Juana Valeria Hurtado , Valentina Mejia