English
Related papers

Related papers: Metamorphic Testing for Fairness Evaluation in Lar…

200 papers

Large Language Models (LLMs) are increasingly deployed in various applications, raising critical concerns about fairness and potential biases in their outputs. This paper explores the prioritization of metamorphic relations (MRs) in…

Computation and Language · Computer Science 2025-05-14 Suavis Giramata , Madhusudan Srinivasan , Venkat Naidu Gudivada , Upulee Kanewala

Using large language models (LLMs) to perform natural language processing (NLP) tasks has become increasingly pervasive in recent times. The versatile nature of LLMs makes them applicable to a wide range of such tasks. While the performance…

Software Engineering · Computer Science 2026-01-12 Steven Cho , Stefano Ruberto , Valerio Terragni

Fairness--the absence of unjustified bias--is a core principle in the development of Artificial Intelligence (AI) systems, yet it remains difficult to assess and enforce. Current approaches to fairness testing in large language models…

Software Engineering · Computer Science 2026-01-13 Miguel Romero-Arjona , José A. Parejo , Juan C. Alonso , Ana B. Sánchez , Aitor Arrieta , Sergio Segura

The widespread deployment of Large Language Models (LLMs) has intensified concerns about subtle social biases embedded in their outputs. Existing guardrails often fail when faced with indirect or contextually complex bias-inducing prompts.…

Software Engineering · Computer Science 2025-12-02 Sina Salimian , Gias Uddin , Sumon Biswas , Henry Leung

Large Language Models (LLMs) are widely used across multiple domains but continue to raise concerns regarding security and fairness. Beyond known attack vectors such as data poisoning and prompt injection, LLMs are also vulnerable to…

Artificial Intelligence · Computer Science 2025-10-01 Matheus Vinicius da Silva de Oliveira , Jonathan de Andrade Silva , Awdren de Lima Fontao

Large language models (LLMs) have introduced substantial challenges to software quality assurance due to their generative, probabilistic, and open-ended nature, which intensifies the oracle problem and limits the applicability of…

Software Engineering · Computer Science 2026-05-15 Zheng Zheng , Zenghui Zhou , Yinwang Xu , Daixu Ren , Tsong Yueh Chen

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

Computation and Language · Computer Science 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

Large Language Models (LLMs) push the bound-aries in natural language processing and generative AI, driving progress across various aspects of modern society. Unfortunately, the pervasive issue of bias in LLMs responses (i.e., predictions)…

Computation and Language · Computer Science 2025-05-20 Isabela Pereira Gregio , Ian Pons , Anna Helena Reali Costa , Artur Jordão

Over the last year, Large Language Models (LLMs) like ChatGPT have become widely available and have exhibited fairness issues similar to those in previous machine learning systems. Current research is primarily focused on analyzing and…

Machine Learning · Computer Science 2024-04-04 Anna Kruspe

Large Language Models (LLMs) are increasingly deployed in critical domains, yet they often exhibit biases inherited from training data, leading to fairness concerns. This work focuses on the problem of effectively detecting fairness…

Software Engineering · Computer Science 2025-06-04 Madhusudan Srinivasan , Jubril Abdel

Large Language Models (LLMs) have fundamentally transformed the field of natural language processing; however, their vulnerability to biases presents a notable obstacle that threatens both fairness and trust. This review offers an extensive…

Computation and Language · Computer Science 2025-09-19 Kiana Kiashemshaki , Mohammad Jalili Torkamani , Negin Mahmoudi , Meysam Shirdel Bilehsavar

Nowadays, Large Language Models (LLMs) are foundational components of modern software systems. As their influence grows, concerns about fairness have become increasingly pressing. Prior work has proposed metamorphic testing to detect…

Software Engineering · Computer Science 2025-12-19 Alessandra Parziale , Gianmario Voria , Valeria Pontillo , Gemma Catolino , Andrea De Lucia , Fabio Palomba

Large Language Models (LLMs) have made significant strides in the field of artificial intelligence, showcasing their ability to interact with humans and influence human cognition through information dissemination. However, recent studies…

Computation and Language · Computer Science 2024-11-25 Qingquan Zhang , Qiqi Duan , Bo Yuan , Yuhui Shi , Jialin Liu

Large Language Models (LLMs) have demonstrated remarkable success across various domains but often lack fairness considerations, potentially leading to discriminatory outcomes against marginalized populations. Unlike fairness in traditional…

Computation and Language · Computer Science 2024-08-09 Thang Doan Viet , Zichong Wang , Minh Nhat Nguyen , Wenbin Zhang

In recent years, Large language model-powered Automated Program Repair (LAPR) techniques have achieved state-of-the-art bug-fixing performance and have been pervasively applied and studied in both industry and academia. Nonetheless, LLMs…

Software Engineering · Computer Science 2025-03-11 Pengyu Xue , Linhao Wu , Zhen Yang , Zhongxing Yu , Zhi Jin , Ge Li , Yan Xiao , Shuo Liu , Xinyi Li , Hongyi Lin , Jingwen Wu

The growing deployment of large language models (LLMs) has amplified concerns regarding their inherent biases, raising critical questions about their fairness, safety, and societal impact. However, quantifying LLM bias remains a fundamental…

Computation and Language · Computer Science 2025-05-26 Alireza Arbabi , Florian Kerschbaum

The advancement of large language models (LLMs) has demonstrated strong capabilities across various applications, including mental health analysis. However, existing studies have focused on predictive performance, leaving the critical issue…

Computation and Language · Computer Science 2024-06-21 Yuqing Wang , Yun Zhao , Sara Alessandra Keller , Anne de Hond , Marieke M. van Buchem , Malvika Pillai , Tina Hernandez-Boussard

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

Computation and Language · Computer Science 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

Large Language Models (LLMs) have demonstrated remarkable success across various domains. However, despite their promising performance in numerous real-world applications, most of these algorithms lack fairness considerations. Consequently,…

Computation and Language · Computer Science 2024-12-20 Zhibo Chu , Zichong Wang , Wenbin Zhang
‹ Prev 1 2 3 10 Next ›