English
Related papers

Related papers: Diversity in Sociotechnical Machine Learning Syste…

200 papers

The definition and implementation of fairness in automated decisions has been extensively studied by the research community. Yet, there hides fallacious reasoning, misleading assertions, and questionable practices at the foundations of the…

Computers and Society · Computer Science 2023-06-05 Robert Lee Poe , Soumia Zohra El Mestari

Machine learning (ML) applications have automated numerous real-life tasks, improving both private and public life. However, the black-box nature of many state-of-the-art models poses the challenge of model verification; how can one be sure…

Machine Learning · Computer Science 2022-01-19 Ioannis Papantonis , Vaishak Belle

Many structured prediction tasks in machine vision have a collection of acceptable answers, instead of one definitive ground truth answer. Segmentation of images, for example, is subject to human labeling bias. Similarly, there are multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Michael Firman , Neill D. F. Campbell , Lourdes Agapito , Gabriel J. Brostow

With the universal adoption of machine learning in healthcare, the potential for the automation of societal biases to further exacerbate health disparities poses a significant risk. We explore algorithmic fairness from the perspective of…

Machine Learning · Computer Science 2024-04-02 Md Rahat Shahriar Zawad , Peter Washington

Machine Learning (ML) and 'Artificial Intelligence' ('AI') methods tend to replicate and amplify existing biases and prejudices, as do Robots with AI. For example, robots with facial recognition have failed to identify Black Women as human,…

Artificial Intelligence · Computer Science 2024-02-14 Andrew Hundt , Julia Schuller , Severin Kacianka

It is widely believed that diversity arising from different skills enhances the performance of teams, and in particular, their ability to learn and innovate. However, diversity has also been associated with negative effects on the…

Physics and Society · Physics 2023-07-03 Fabian Baumann , Agnieszka Czaplicka , Iyad Rahwan

Dataset diversity plays a pivotal role for the successful training of many machine learning models, particularly in the supervised fine-tuning (SFT) stage of large language model (LLM) development. Despite increasing recognition of its…

Computation and Language · Computer Science 2025-06-02 Haoyu Li , Xuhong Li , Yiming Dong , Kun Liu

Recent advancements in machine learning and deep learning have brought algorithmic fairness into sharp focus, illuminating concerns over discriminatory decision making that negatively impacts certain individuals or groups. These concerns…

Computers and Society · Computer Science 2024-05-16 Renqiang Luo , Tao Tang , Feng Xia , Jiaying Liu , Chengpei Xu , Leo Yu Zhang , Wei Xiang , Chengqi Zhang

Population diversity is crucial in evolutionary algorithms to enable global exploration and to avoid poor performance due to premature convergence. This book chapter reviews runtime analyses that have shown benefits of population diversity,…

Neural and Evolutionary Computing · Computer Science 2018-01-31 Dirk Sudholt

In order to create machine learning systems that serve a variety of users well, it is vital to not only achieve high average performance but also ensure equitable outcomes across diverse groups. However, most machine learning methods are…

Machine Learning · Computer Science 2024-03-01 Atharva Kulkarni , Lucio Dery , Amrith Setlur , Aditi Raghunathan , Ameet Talwalkar , Graham Neubig

With fairness concerns gaining significant attention in Machine Learning (ML), several bias mitigation techniques have been proposed, often compared against each other to find the best method. These benchmarking efforts tend to use a common…

Machine Learning · Computer Science 2024-11-20 Prakhar Ganesh , Usman Gohar , Lu Cheng , Golnoosh Farnadi

Current trends in pre-training Large Language Models (LLMs) primarily focus on the scaling of model and dataset size. While the quality of pre-training data is considered an important factor for training powerful LLMs, it remains a nebulous…

Computation and Language · Computer Science 2025-07-04 Brando Miranda , Alycia Lee , Sudharsan Sundar , Allison Casasola , Rylan Schaeffer , Elyas Obbad , Sanmi Koyejo

Stereotype detection is a challenging and subjective task, as certain statements, such as "Black people like to play basketball," may not appear overtly toxic but still reinforce racial stereotypes. With the increasing prevalence of large…

Computation and Language · Computer Science 2024-11-19 Zekun Wu , Sahan Bulathwela , Maria Perez-Ortiz , Adriano Soares Koshiyama

Algorithmic fairness in recommender systems requires close attention to the needs of a diverse set of stakeholders that may have competing interests. Previous work in this area has often been limited by fixed, single-objective definitions…

Information Retrieval · Computer Science 2024-10-08 Amanda Aird , Elena Štefancová , Cassidy All , Amy Voida , Martin Homola , Nicholas Mattei , Robin Burke

Extensive research on formal verification of machine learning (ML) systems indicates that learning from data alone often fails to capture underlying background knowledge. A variety of verifiers have been developed to ensure that a…

Logic in Computer Science · Computer Science 2023-11-17 Thomas Flinkow , Barak A. Pearlmutter , Rosemary Monahan

While the field of algorithmic fairness has brought forth many ways to measure and improve the fairness of machine learning models, these findings are still not widely used in practice. We suspect that one reason for this is that the field…

Computers and Society · Computer Science 2022-03-16 Corinna Hertweck , Christoph Heitz

Large Language Models (LLMs) are known to lack cultural representation and overall diversity in their generations, from expressing opinions to answering factual questions. To mitigate this problem, we propose multilingual prompting: a…

Computation and Language · Computer Science 2025-09-30 Qihan Wang , Shidong Pan , Tal Linzen , Emily Black

Group fairness in machine learning is an important area of research focused on achieving equitable outcomes across different groups defined by sensitive attributes such as race or gender. Federated Learning, a decentralized approach to…

Machine Learning · Computer Science 2025-09-15 Teresa Salazar , Helder Araújo , Alberto Cano , Pedro Henriques Abreu

This paper presents a system for diversity-aware autonomous conversation leveraging the capabilities of large language models (LLMs). The system adapts to diverse populations and individuals, considering factors like background,…

Robotics · Computer Science 2024-06-26 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

Intersectional fairness is a critical requirement for Machine Learning (ML) software, demanding fairness across subgroups defined by multiple protected attributes. This paper introduces FairHOME, a novel ensemble approach using higher order…

Machine Learning · Computer Science 2024-12-12 Zhenpeng Chen , Xinyue Li , Jie M. Zhang , Federica Sarro , Yang Liu