English
Related papers

Related papers: Diversity in Sociotechnical Machine Learning Syste…

200 papers

It has long been recognized that it is not enough for a Recommender System (RS) to provide recommendations based only on their relevance to users. Among many other criteria, the set of recommendations may need to be diverse. Diversity is…

Information Retrieval · Computer Science 2024-06-19 Diego Carraro , Derek Bridge

This paper presents research on enhancements to Large Language Models (LLMs) through the addition of diversity in its generated outputs. Our study introduces a configuration of multiple LLMs which demonstrates the diversities capable with a…

Computation and Language · Computer Science 2025-08-05 Purva Prasad Gosavi , Vaishnavi Murlidhar Kulkarni , Alan F. Smeaton

Machine Learning algorithms (ML) impact virtually every aspect of human lives and have found use across diverse sectors including healthcare, finance, and education. Often, ML algorithms have been found to exacerbate societal biases present…

Machine Learning · Computer Science 2025-06-02 Jonathan Vasquez , Carlotta Domeniconi , Huzefa Rangwala

Large language models (LLMs) are trained on vast, uncurated datasets that contain various forms of biases and language reinforcing harmful stereotypes that may be subsequently inherited by the models themselves. Therefore, it is essential…

Computation and Language · Computer Science 2024-10-01 Jacob-Junqi Tian , Omkar Dige , D. B. Emerson , Faiza Khan Khattak

Large language models often generate homogeneous outputs, but whether this is problematic depends on the specific task. For objective math tasks, responses may vary in terms of problem-solving strategy but should maintain the same…

Computation and Language · Computer Science 2026-04-23 Shomik Jain , Jack Lanchantin , Maximilian Nickel , Candace Ross , Karen Ullrich , Ashia Wilson , Jamelle Watson-Daniels

As large language models (LLMs) like GPT-4 and Llama 3 become integral to educational contexts, concerns are mounting over the cultural biases, power imbalances, and ethical limitations embedded within these technologies. Though generative…

Computation and Language · Computer Science 2025-01-08 Abdullah Mushtaq , Muhammad Rafay Naeem , Muhammad Imran Taj , Ibrahim Ghaznavi , Junaid Qadir

Current session-based recommender systems (SBRSs) mainly focus on maximizing recommendation accuracy, while few studies have been devoted to improve diversity beyond accuracy. Meanwhile, it is unclear how the accuracy-oriented SBRSs perform…

Information Retrieval · Computer Science 2023-06-01 Qing Yin , Hui Fang , Zhu Sun , Yew-Soon Ong

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This…

Machine Learning · Computer Science 2025-11-19 Fatima Kazi , Alex Young , Yash Inani , Setareh Rafatirad

Predictive algorithms are now used to help distribute a large share of our society's resources and sanctions, such as healthcare, loans, criminal detentions, and tax audits. Under the right circumstances, these algorithms can improve the…

Machine Learning · Computer Science 2023-02-21 Alex Chohlas-Wood , Madison Coots , Sharad Goel , Julian Nyarko

This paper investigates the parameter space of machine learning (ML) algorithms in aggravating or mitigating fairness bugs. Data-driven software is increasingly applied in social-critical applications where ensuring fairness is of paramount…

Software Engineering · Computer Science 2022-02-15 Saeid Tizpaz-Niari , Ashish Kumar , Gang Tan , Ashutosh Trivedi

Recommender systems often operate on item catalogs clustered by genres, and user bases that have natural clusterings into user types by demographic or psychographic attributes. Prior work on system-wide diversity has mainly focused on…

Information Retrieval · Computer Science 2019-08-28 Arda Antikacioglu , Tanvi Bajpai , R. Ravi

Research in machine learning (ML) has primarily argued that models trained on incomplete or biased datasets can lead to discriminatory outputs. In this commentary, we propose moving the research focus beyond bias-oriented framings by…

Human-Computer Interaction · Computer Science 2021-09-17 Milagros Miceli , Julian Posada , Tianling Yang

This paper aims to bring together the disciplines of social science (SS) and computer science (CS) in the design and implementation of a novel multidisciplinary framework for systematic, transparent, ethically-informed, and bias-aware…

Computers and Society · Computer Science 2025-05-07 Sacha Hasan , Mehdi Rizvi , Yingfang Yuan , Kefan Chen , Lynne Baillie , Wei Pang

Collaboration is key to STEM, where multidisciplinary team research can solve complex problems. However, inequality in STEM fields hinders their full potential, due to persistent psychological barriers in underrepresented students'…

Computers and Society · Computer Science 2024-02-02 Nia Nixon , Yiwen Lin , Lauren Snow

The integration of machine learning models in various real-world applications is becoming more prevalent to assist humans in their daily decision-making tasks as a result of recent advancements in this field. However, it has been discovered…

Machine Learning · Computer Science 2023-04-04 Ramtin Hosseini , Li Zhang , Bhanu Garg , Pengtao Xie

Issues can arise when research focused on fairness, transparency, or safety is conducted separately from research driven by practical deployment concerns and vice versa. This separation creates a growing need for translational work that…

Machine Learning · Computer Science 2025-04-29 Jamelle Watson-Daniels , Flavio du Pin Calmon , Alexander D'Amour , Carol Long , David C. Parkes , Berk Ustun

A recent flurry of research activity has attempted to quantitatively define "fairness" for decisions based on statistical and machine learning (ML) predictions. The rapid growth of this new field has led to wildly inconsistent terminology…

Applications · Statistics 2020-11-23 Shira Mitchell , Eric Potash , Solon Barocas , Alexander D'Amour , Kristian Lum

Reinforcement learning agents need a reward signal to learn successful policies. When this signal is sparse or the corresponding gradient is deceptive, such agents need a dedicated mechanism to efficiently explore their search space without…

Artificial Intelligence · Computer Science 2021-04-13 Alexandre Chenu , Nicolas Perrin-Gilbert , Stéphane Doncieux , Olivier Sigaud

Recent technological advancements in multimodal machine learning--including the rise of large language models (LLMs)--have improved our ability to collect, process, and analyze diverse multimodal data such as speech, video, and eye gaze in…

Due to the recent cases of algorithmic bias in data-driven decision-making, machine learning methods are being put under the microscope in order to understand the root cause of these biases and how to correct them. Here, we consider a basic…

Machine Learning · Computer Science 2016-10-25 L. Elisa Celis , Amit Deshpande , Tarun Kathuria , Nisheeth K. Vishnoi