English
Related papers

Related papers: Fairness of ChatGPT

200 papers

Artificial Intelligence (AI) has demonstrated remarkable capabilities in domains such as recruitment, finance, healthcare, and the judiciary. However, biases in AI systems raise ethical and societal concerns, emphasizing the need for…

Current methods for evaluating large language models (LLMs) typically focus on high-level tasks such as text generation, without targeting a particular AI application. This approach is not sufficient for evaluating LLMs for Responsible AI…

Computation and Language · Computer Science 2025-10-24 Alicia Sagae , Chia-Jung Lee , Sandeep Avula , Brandon Dang , Vanessa Murdock

AI tools, particularly large-scale language model (LLM) based applications such as ChatGPT, have the potential to simplify qualitative research. Through semi-structured interviews with seventeen participants, we identified challenges and…

Human-Computer Interaction · Computer Science 2025-05-14 He Zhang , Chuhao Wu , Jingyi Xie , Yao Lyu , Jie Cai , John M. Carroll

This paper investigates the challenges associated with bias, toxicity, unreliability, and lack of robustness in large language models (LLMs) such as ChatGPT. It emphasizes that these issues primarily stem from the quality and diversity of…

Computers and Society · Computer Science 2024-10-21 Federico Torrielli

The rise of generative artificial intelligence, particularly Large Language Models (LLMs), has intensified the imperative to scrutinize fairness alongside accuracy. Recent studies have begun to investigate fairness evaluations for LLMs…

Information Retrieval · Computer Science 2024-08-31 Chandan Kumar Sah , Lian Xiaoli , Muhammad Mirajul Islam

Large Language Models (LLMs) such as ChatGPT, have gained significant attention due to their impressive natural language processing capabilities. It is crucial to prioritize human-centered principles when utilizing these models.…

Computation and Language · Computer Science 2023-06-21 Yue Huang , Qihui Zhang , Philip S. Y , Lichao Sun

Artificial intelligence is seen as increasingly important, and potentially profoundly so, but the fields of AI ethics and AI engineering have not fully recognized that these technologies, including large language models (LLMs), will have…

Artificial Intelligence · Computer Science 2024-03-05 Sankalpa Ghose , Yip Fai Tse , Kasra Rasaee , Jeff Sebo , Peter Singer

Fairness is a growing concern for high-risk decision-making using Artificial Intelligence (AI) but ensuring it through purely technical means is challenging: there is no universally accepted fairness measure, fairness is context-dependent,…

Artificial Intelligence · Computer Science 2024-10-07 Evdoxia Taka , Yuri Nakao , Ryosuke Sonoda , Takuya Yokota , Lin Luo , Simone Stumpf

Artificial Intelligence (AI) models are now being utilized in all facets of our lives such as healthcare, education and employment. Since they are used in numerous sensitive environments and make decisions that can be life altering,…

Artificial Intelligence · Computer Science 2024-03-27 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

The ethical integration of Artificial Intelligence (AI) in healthcare necessitates addressing fairness-a concept that is highly context-specific across medical fields. Extensive studies have been conducted to expand the technical components…

Large language models (LLMs) have become increasingly sophisticated, leading to widespread deployment in sensitive applications where safety and reliability are paramount. However, LLMs have inherent risks accompanying them, including bias,…

Cryptography and Security · Computer Science 2024-06-21 Suriya Ganesh Ayyamperumal , Limin Ge

Advances in large language models (LLMs) have driven an explosion of interest about their societal impacts. Much of the discourse around how they will impact social equity has been cautionary or negative, focusing on questions like "how…

In this paper, we elaborate on how AI can support diversity and inclusion and exemplify research projects conducted in that direction. We start by looking at the challenges and progress in making large language models (LLMs) more…

Fairness in AI and machine learning systems has become a fundamental problem in the accountability of AI systems. While the need for accountability of AI models is near ubiquitous, healthcare in particular is a challenging field where…

Machine Learning · Computer Science 2021-02-09 Ming Yuan , Vikas Kumar , Muhammad Aurangzeb Ahmad , Ankur Teredesai

This paper studies the performance of large language models (LLMs), particularly regarding demographic fairness, in solving real-world healthcare tasks. We evaluate state-of-the-art LLMs with three prevalent learning frameworks across six…

Computation and Language · Computer Science 2024-12-10 Yue Zhou , Barbara Di Eugenio , Lu Cheng

The advancement of large language models (LLMs) has demonstrated strong capabilities across various applications, including mental health analysis. However, existing studies have focused on predictive performance, leaving the critical issue…

Computation and Language · Computer Science 2024-06-21 Yuqing Wang , Yun Zhao , Sara Alessandra Keller , Anne de Hond , Marieke M. van Buchem , Malvika Pillai , Tina Hernandez-Boussard

Bias and fairness risks in Large Language Models (LLMs) vary substantially across deployment contexts, yet existing approaches lack systematic guidance for selecting appropriate evaluation metrics. We present a decision framework that maps…

Computation and Language · Computer Science 2026-05-12 Dylan Bouchard

The rapid progress in Large Language Models (LLMs) could transform many fields, but their fast development creates significant challenges for oversight, ethical creation, and building user trust. This comprehensive review looks at key trust…

Computers and Society · Computer Science 2024-07-22 Md Meftahul Ferdaus , Mahdi Abdelguerfi , Elias Ioup , Kendall N. Niles , Ken Pathak , Steven Sloan

Generative AI models continue to become more powerful. The launch of ChatGPT in November 2022 has ushered in a new era of AI. ChatGPT and other similar chatbots have a range of capabilities, from answering student homework questions to…

Computers and Society · Computer Science 2023-06-14 Yanchen Wang , Lisa Singh

The widespread adoption of large language models (LLMs) underscores the urgent need to ensure their fairness. However, LLMs frequently present dominant viewpoints while ignoring alternative perspectives from minority parties, resulting in…

Computation and Language · Computer Science 2024-02-20 Tianlin Li , Xiaoyu Zhang , Chao Du , Tianyu Pang , Qian Liu , Qing Guo , Chao Shen , Yang Liu