English
Related papers

Related papers: Societal biases reinforcement through machine lear…

200 papers

As machine learning applications proliferate, we need an understanding of their potential for harm. However, current fairness metrics are rarely grounded in human psychological experiences of harm. Drawing on the social psychology of…

Computers and Society · Computer Science 2025-05-27 Angelina Wang , Xuechunzi Bai , Solon Barocas , Su Lin Blodgett

Cyberbullying is a widespread adverse phenomenon among online social interactions in today's digital society. While numerous computational studies focus on enhancing the cyberbullying detection performance of machine learning algorithms,…

Computation and Language · Computer Science 2021-02-23 Oguzhan Gencoglu

In this work, we study the effects of feature-based explanations on distributive fairness of AI-assisted decisions, specifically focusing on the task of predicting occupations from short textual bios. We also investigate how any effects are…

Human-Computer Interaction · Computer Science 2024-03-20 Jakob Schoeffer , Maria De-Arteaga , Niklas Kuehl

With the widespread use of AI systems and applications in our everyday lives, it is important to take fairness issues into consideration while designing and engineering these types of systems. Such systems can be used in many sensitive…

Machine Learning · Computer Science 2022-01-26 Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , Aram Galstyan

This research explores how human-defined goals influence the behavior of Large Language Models (LLMs) through purpose-conditioned cognition. Using financial prediction tasks, we show that revealing the downstream use (e.g., predicting stock…

General Finance · Quantitative Finance 2026-05-07 Sean Cao , Wei Jiang , Hui Xu

Many machine learning systems make extensive use of large amounts of data regarding human behaviors. Several researchers have found various discriminatory practices related to the use of human-related machine learning systems, for example…

Machine Learning · Computer Science 2019-03-25 Elena Beretta , Antonio Santangelo , Bruno Lepri , Antonio Vetrò , Juan Carlos De Martin

With the widespread and pervasive use of Artificial Intelligence (AI) for automated decision-making systems, AI bias is becoming more apparent and problematic. One of its negative consequences is discrimination: the unfair, or unequal…

Computers and Society · Computer Science 2021-06-07 Xavier Ferrer , Tom van Nuenen , Jose M. Such , Mark Coté , Natalia Criado

Research in machine learning (ML) has primarily argued that models trained on incomplete or biased datasets can lead to discriminatory outputs. In this commentary, we propose moving the research focus beyond bias-oriented framings by…

Human-Computer Interaction · Computer Science 2021-09-17 Milagros Miceli , Julian Posada , Tianling Yang

There is increasing regulatory interest in whether machine learning algorithms deployed in consequential domains (e.g. in criminal justice) treat different demographic groups "fairly." However, there are several proposed notions of…

Theoretical Economics · Economics 2020-02-19 Christopher Jung , Sampath Kannan , Changhwa Lee , Mallesh M. Pai , Aaron Roth , Rakesh Vohra

Artificial Intelligence (AI) systems are not intrinsically neutral and biases trickle in any type of technological tool. In particular when dealing with people, the impact of AI algorithms' technical errors originating with mislabeled data…

Artificial Intelligence · Computer Science 2025-04-03 Camilla Quaresmini , Giuseppe Primiero

Credit is an essential component of financial wellbeing in America, and unequal access to it is a large factor in the economic disparities between demographic groups that exist today. Today, machine learning algorithms, sometimes trained on…

Machine Learning · Computer Science 2022-10-07 I. Elizabeth Kumar , Keegan E. Hines , John P. Dickerson

As financial institutions increasingly rely on machine learning models to automate lending decisions, concerns about algorithmic fairness have risen. This paper explores the tradeoff between enforcing fairness constraints (such as…

Computers and Society · Computer Science 2025-06-05 Aayam Bansal

Existing facial analysis systems have been shown to yield biased results against certain demographic subgroups. Due to its impact on society, it has become imperative to ensure that these systems do not discriminate based on gender,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Richa Singh , Puspita Majumdar , Surbhi Mittal , Mayank Vatsa

Machine learning software is increasingly being used to make decisions that affect people's lives. But sometimes, the core part of this software (the learned model), behaves in a biased manner that gives undue advantages to a specific group…

Software Engineering · Computer Science 2020-10-07 Joymallya Chakraborty , Suvodeep Majumder , Zhe Yu , Tim Menzies

Most fair regression algorithms mitigate bias towards sensitive sub populations and therefore improve fairness at group level. In this paper, we investigate the impact of such implementation of fair regression on the individual. More…

Machine Learning · Computer Science 2021-04-12 Boris Ruf , Marcin Detyniecki

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

Machine Learning · Computer Science 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

What we discover and see online, and consequently our opinions and decisions, are becoming increasingly affected by automated machine learned predictions. Similarly, the predictive accuracy of learning machines heavily depends on the…

Information Retrieval · Computer Science 2020-01-15 Sami Khenissi , Olfa Nasraoui

Reward models (RMs) are central to the alignment of language models (LMs). An RM often serves as a proxy for human preferences to guide downstream LM behavior. However, our understanding of RM behavior is limited. Our work (i) formalizes a…

Computation and Language · Computer Science 2025-10-09 Elle

The discovery of discriminatory bias in human or automated decision making is a task of increasing importance and difficulty, exacerbated by the pervasive use of machine learning and data mining. Currently, discrimination discovery largely…

Computers and Society · Computer Science 2019-11-05 Bilal Qureshi , Faisal Kamiran , Asim Karim , Salvatore Ruggieri , Dino Pedreschi

Artificial intelligence is used at various stages of the recruitment process to automatically select the best candidate for a position, with companies guaranteeing unbiased recruitment. However, the algorithms used are either trained by…

Artificial Intelligence · Computer Science 2025-05-06 Shuyu Wang , Angélique Saillet , Philomène Le Gall , Alain Lacroux , Christelle Martin-Lacroux , Vincent Brault