English
Related papers

Related papers: Statistical discrimination in learning agents

200 papers

In distributed processing, agents generally collect data generated by the same underlying unknown model (represented by a vector of parameters) and then solve an estimation or inference task cooperatively. In this paper, we consider the…

Information Theory · Computer Science 2015-06-16 Sheng-Yuan Tu , Ali H. Sayed

Humans have come to rely on machines for reducing excessive information to manageable representations. But this reliance can be abused -- strategic machines might craft representations that manipulate their users. How can a user make good…

Machine Learning · Computer Science 2022-06-20 Vineet Nair , Ganesh Ghalme , Inbal Talgam-Cohen , Nir Rosenfeld

As artificial agents increasingly integrate into professional environments, fundamental questions have emerged about how societal biases influence human-robot selection decisions. We conducted two comprehensive experiments (N = 1,038)…

Robotics · Computer Science 2026-01-21 Jiangen He , Wanqi Zhang , Jessica Barfield

In many predictive decision-making scenarios, such as credit scoring and academic testing, a decision-maker must construct a model that accounts for agents' propensity to "game" the decision rule by changing their features so as to receive…

Machine Learning · Computer Science 2022-08-26 Yonadav Shavit , Benjamin Edelman , Brian Axelrod

Machine learnt systems inherit biases against protected classes, historically disparaged groups, from training data. Usually, these biases are not explicit, they rely on subtle correlations discovered by training algorithms, and are…

Computers and Society · Computer Science 2018-03-22 Anupam Datta , Matt Fredrikson , Gihyuk Ko , Piotr Mardziel , Shayak Sen

Algorithmic discrimination is an important aspect when data is used for predictive purposes. This paper analyzes the relationships between discrimination and classification, data set partitioning, and decision models, as well as…

Computers and Society · Computer Science 2018-11-08 Jixue Liu , Jiuyong Li , Feiyue Ye , Lin Liu , Thuc Duy Le , Ping Xiong

Presence of bias (in datasets or tasks) is inarguably one of the most critical challenges in machine learning applications that has alluded to pivotal debates in recent years. Such challenges range from spurious associations between…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Ehsan Adeli , Qingyu Zhao , Adolf Pfefferbaum , Edith V. Sullivan , Li Fei-Fei , Juan Carlos Niebles , Kilian M. Pohl

Algorithmic discrimination is a condition that arises when data-driven software unfairly treats users based on attributes like ethnicity, race, gender, sexual orientation, religion, age, disability, or other personal characteristics.…

Software Engineering · Computer Science 2024-01-18 Ramandeep Singh Dehal , Mehak Sharma , Ronnie de Souza Santos

Predictive algorithms have a powerful potential to offer benefits in areas as varied as medicine or education. However, these algorithms and the data they use are built by humans, consequently, they can inherit the bias and prejudices…

Human-Computer Interaction · Computer Science 2022-03-22 Cristina Manresa-Yee , Silvia Ramis

Does machine learning and AI ensure that social biases thrive ? This paper aims to analyse this issue. Indeed, as algorithms are informed by data, if these are corrupted, from a social bias perspective, good machine learning algorithms…

Machine Learning · Statistics 2020-11-03 Bertrand K. Hassani

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

Algorithms learned from data are increasingly used for deciding many aspects in our life: from movies we see, to prices we pay, or medicine we get. Yet there is growing evidence that decision making by inappropriately trained algorithms may…

Artificial Intelligence · Computer Science 2017-08-03 Indre Zliobaite

Although many fairness criteria have been proposed to ensure that machine learning algorithms do not exhibit or amplify our existing social biases, these algorithms are trained on datasets that can themselves be statistically biased. In…

Machine Learning · Computer Science 2023-05-04 Yiqiao Liao , Parinaz Naghizadeh

Online social networks use recommender systems to suggest relevant information to their users in the form of personalized timelines. Studying how these systems expose people to information at scale is difficult to do as one cannot assume…

Social and Information Networks · Computer Science 2024-09-26 Nathan Bartley , Keith Burghardt , Kristina Lerman

Data-driven predictions are often perceived as inaccurate in hindsight due to behavioral responses. In this study, we explore the role of interface design choices in shaping individuals' decision-making processes in response to predictions…

Human-Computer Interaction · Computer Science 2024-04-29 Dongping Zhang , Jason Hartline , Jessica Hullman

Artificial Intelligence has the capacity to amplify and perpetuate societal biases and presents profound ethical implications for society. Gender bias has been identified in the context of employment advertising and recruitment tools, due…

Computation and Language · Computer Science 2020-05-19 Susan Leavy , Gerardine Meaney , Karen Wade , Derek Greene

Undesirable biases encoded in the data are key drivers of algorithmic discrimination. Their importance is widely recognized in the algorithmic fairness literature, as well as legislation and standards on anti-discrimination in AI. Despite…

Machine Learning · Computer Science 2025-07-15 Marina Ceccon , Giandomenico Cornacchia , Davide Dalle Pezze , Alessandro Fabris , Gian Antonio Susto

In AI-assisted decision-making, effective hybrid (human-AI) teamwork is not solely dependent on AI performance alone, but also on its impact on human decision-making. While prior work studies the effects of model accuracy on humans, we…

Human-Computer Interaction · Computer Science 2022-02-25 Andi Peng , Besmira Nushi , Emre Kiciman , Kori Inkpen , Ece Kamar

Data-driven algorithms play a large role in decision making across a variety of industries. Increasingly, these algorithms are being used to make decisions that have significant ramifications for people's social and economic well-being,…

Machine Learning · Computer Science 2018-09-26 J. Henry Hinnefeld , Peter Cooman , Nat Mammo , Rupert Deese

AI systems increasingly support human decision-making. In many cases, despite the algorithm's superior performance, the final decision remains in human hands. For example, an AI may assist doctors in determining which diagnostic tests to…

Artificial Intelligence · Computer Science 2026-02-20 Gali Noti , Kate Donahue , Jon Kleinberg , Sigal Oren