English
Related papers

Related papers: Fairness and Bias in Multimodal AI: A Survey

200 papers

Algorithmic fairness and explainability are foundational elements for achieving responsible AI. In this paper, we focus on their interplay, a research area that is recently receiving increasing attention. To this end, we first present two…

Artificial Intelligence · Computer Science 2024-02-19 Christos Fragkathoulas , Vasiliki Papanikou , Danae Pla Karidi , Evaggelia Pitoura

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

Deep learning algorithms have demonstrated remarkable efficacy in various medical image analysis (MedIA) applications. However, recent research highlights a performance disparity in these algorithms when applied to specific subgroups, such…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Zikang Xu , Jun Li , Qingsong Yao , Han Li , Mingyue Zhao , S. Kevin Zhou

Large language models (LLMs) have garnered significant attention for their remarkable performance in a continuously expanding set of natural language processing tasks. However, these models have been shown to harbor inherent societal…

Computation and Language · Computer Science 2023-10-16 Abel Salinas , Louis Penafiel , Robert McCormack , Fred Morstatter

Understanding and addressing unfairness in LLMs are crucial for responsible AI deployment. However, there is a limited number of quantitative analyses and in-depth studies regarding fairness evaluations in LLMs, especially when applying…

Machine Learning · Computer Science 2024-05-07 Yunqi Li , Lanjing Zhang , Yongfeng Zhang

With the advance of Artificial Intelligence (AI), Large Language Models (LLMs) have gained prominence and been applied in diverse contexts. As they evolve into more sophisticated versions, it is essential to assess whether they reproduce…

Computation and Language · Computer Science 2025-08-15 Gustavo Bonil , Simone Hashiguti , Jhessica Silva , João Gondim , Helena Maia , Nádia Silva , Helio Pedrini , Sandra Avila

Gender bias in artificial intelligence (AI) has emerged as a pressing concern with profound implications for individuals' lives. This paper presents a comprehensive survey that explores gender bias in Transformer models from a linguistic…

Computation and Language · Computer Science 2023-06-21 Praneeth Nemani , Yericherla Deepak Joel , Palla Vijay , Farhana Ferdousi Liza

Transformer-based large language models (LLMs) and multi-agent systems (MAS) are increasingly embedded across the software development lifecycle (SDLC), yet their fairness implications for developer-facing tools remain underexplored despite…

Software Engineering · Computer Science 2026-04-16 Corey Yang-Smith , Ronnie de Souza Santos , Ahmad Abdellatif

Advancements in retrieving accessible information have evolved faster in the last few years compared to the decades since the internet's creation. Search engines, like Google, have been the number one way to find relevant data. They have…

Information Retrieval · Computer Science 2025-03-28 Karanbir Singh , William Ngu

Ensuring fairness in artificial intelligence (AI) is important to counteract bias and discrimination in far-reaching applications. Recent work has started to investigate how humans judge fairness and how to support machine learning (ML)…

Human-Computer Interaction · Computer Science 2022-04-25 Yuri Nakao , Simone Stumpf , Subeida Ahmed , Aisha Naseer , Lorenzo Strappelli

While Large Language Models (LLMs) have become ubiquitous in many fields, understanding and mitigating LLM biases is an ongoing issue. This paper provides a novel method for evaluating the demographic biases of various generative AI models.…

Computation and Language · Computer Science 2025-06-16 Jack H Fagan , Ruhaan Juyaal , Amy Yue-Ming Yu , Siya Pun

Large Language models (LLMs), such as ChatGPT, have gained popularity in recent years with the advancement of Natural Language Processing (NLP), with use cases spanning many disciplines and daily lives as well. LLMs inherit explicit and…

Computation and Language · Computer Science 2025-12-01 Fatima Kazi

Despite numerous efforts to mitigate their biases, ML systems continue to harm already-marginalized people. While predominant ML approaches assume bias can be removed and fair models can be created, we show that these are not always…

Computation and Language · Computer Science 2025-04-02 Lucy Havens , Benjamin Bach , Melissa Terras , Beatrice Alex

This study delves into the pervasive issue of gender issues in artificial intelligence (AI), specifically within automatic scoring systems for student-written responses. The primary objective is to investigate the presence of gender biases,…

Computers and Society · Computer Science 2025-01-29 Ehsan Latif , Xiaoming Zhai , Lei Liu

Advancements in Large Language Models (LLMs) have increased the performance of different natural language understanding as well as generation tasks. Although LLMs have breached the state-of-the-art performance in various tasks, they often…

Computation and Language · Computer Science 2025-05-28 Charaka Vinayak Kumar , Ashok Urlana , Gopichand Kanumolu , Bala Mallikarjunarao Garlapati , Pruthwik Mishra

Concerns regarding fairness and bias have been raised in recent years due to the growing use of machine learning models in crucial decision-making processes, especially when it comes to delicate characteristics like gender. In order to…

Machine Learning · Computer Science 2024-08-30 Saish Shinde

This thesis explores open-sourced machine learning (ML) model explanation tools to understand whether these tools can allow a layman to visualize, understand, and suggest intuitive remedies to unfairness in ML-based decision-support…

Machine Learning · Computer Science 2023-07-12 Normen Yu , Gang Tan , Saeid Tizpaz-Niari

Automated decision systems are increasingly used to take consequential decisions in problems such as job hiring and loan granting with the hope of replacing subjective human decisions with objective machine learning (ML) algorithms.…

Computers and Society · Computer Science 2023-06-21 Guilherme Alves , Fabien Bernier , Miguel Couceiro , Karima Makhlouf , Catuscia Palamidessi , Sami Zhioua

Machine learning algorithms are extensively used to make increasingly more consequential decisions about people, so achieving optimal predictive performance can no longer be the only focus. A particularly important consideration is fairness…

Machine Learning · Computer Science 2020-06-09 Giulio Morina , Viktoriia Oliinyk , Julian Waton , Ines Marusic , Konstantinos Georgatzis

Fairness in artificial intelligence and machine learning (AI/ML) models is becoming critically important, especially as decisions made by these systems impact diverse groups. In education, a vital sector for all countries, the widespread…

Machine Learning · Computer Science 2024-10-10 Nga Pham , Minh Kha Do , Tran Vu Dai , Pham Ngoc Hung , Anh Nguyen-Duc