English
Related papers

Related papers: Bias Testing and Mitigation in Black Box LLMs usin…

200 papers

Large Language Models (LLMs) have become foundational in modern language-driven software applications, profoundly influencing daily life. A critical technique in leveraging their potential is role-playing, where LLMs simulate diverse roles…

Computers and Society · Computer Science 2026-04-23 Xinyue Li , Zhenpeng Chen , Jie M. Zhang , Ying Xiao , Tianlin Li , Weisong Sun , Yang Liu , Yiling Lou , Xuanzhe Liu

Large Language Models (LLMs) are widely used across multiple domains but continue to raise concerns regarding security and fairness. Beyond known attack vectors such as data poisoning and prompt injection, LLMs are also vulnerable to…

Artificial Intelligence · Computer Science 2025-10-01 Matheus Vinicius da Silva de Oliveira , Jonathan de Andrade Silva , Awdren de Lima Fontao

Multimodal Large Language Models (MLLMs) already achieve state-of-the-art results across a wide range of tasks and modalities. To push their reasoning ability further, recent studies explore advanced prompting schemes and post-training…

Artificial Intelligence · Computer Science 2025-09-09 Zhenyu Pan , Yutong Zhang , Jianshu Zhang , Haoran Lu , Haozheng Luo , Yuwei Han , Philip S. Yu , Manling Li , Han Liu

Large Language Models (LLMs) exhibit socio-economic biases that can propagate into downstream tasks. While prior studies have questioned whether intrinsic bias in LLMs affects fairness at the downstream task level, this work empirically…

Computation and Language · Computer Science 2025-09-23 'Mina Arzaghi' , 'Alireza Dehghanpour Farashah' , 'Florian Carichon' , ' Golnoosh Farnadi'

With the rise of Large Language Models (LLMs) such as ChatGPT, researchers have been working on how to utilize the LLMs for better recommendations. However, although LLMs exhibit black-box and probabilistic characteristics (meaning their…

Information Retrieval · Computer Science 2024-11-20 Madhurima Khirbat , Yongli Ren , Pablo Castells , Mark Sanderson

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

Computation and Language · Computer Science 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He

Social biases can manifest in language agency. However, very limited research has investigated such biases in Large Language Model (LLM)-generated content. In addition, previous works often rely on string-matching techniques to identify…

Computation and Language · Computer Science 2025-06-03 Yixin Wan , Kai-Wei Chang

Large language models (LLMs) are now widely deployed in user-facing applications, reaching hundreds of millions worldwide. As they become integrated into everyday tasks, growing reliance on their outputs raises significant concerns. In…

Computers and Society · Computer Science 2025-10-16 Robin Staab , Jasper Dekoninck , Maximilian Baader , Martin Vechev

Generating synthetic datasets via large language models (LLMs) has emerged as a promising approach to improve LLM performance. However, LLMs inherently reflect biases in their training data, leading to a critical challenge: when models are…

Machine Learning · Computer Science 2026-05-06 Miaomiao Li , Hao Chen , Yang Wang , Tingyuan Zhu , Weijia Zhang , Kaijie Zhu , Kam-Fai Wong , Jindong Wang

Financial institutions increasingly rely on large language models (LLMs) for high-stakes decision-making. However, these models risk perpetuating harmful biases if deployed without careful oversight. This paper investigates racial bias in…

General Economics · Economics 2025-06-24 Thomas R. Cook , Sophia Kazinnik

This paper investigates the subtle and often concealed biases present in Large Language Models (LLMs), focusing on implicit biases that may remain despite passing explicit bias tests. Implicit biases are significant because they influence…

Computation and Language · Computer Science 2024-10-01 Serene Lim , María Pérez-Ortiz

Although value-aligned language models (LMs) appear unbiased in explicit bias evaluations, they often exhibit stereotypes in implicit word association tasks, raising concerns about their fair usage. We investigate the mechanisms behind this…

Computation and Language · Computer Science 2025-06-10 Lihao Sun , Chengzhi Mao , Valentin Hofmann , Xuechunzi Bai

Advancements in Large Language Models (LLMs) have increased the performance of different natural language understanding as well as generation tasks. Although LLMs have breached the state-of-the-art performance in various tasks, they often…

Computation and Language · Computer Science 2025-05-28 Charaka Vinayak Kumar , Ashok Urlana , Gopichand Kanumolu , Bala Mallikarjunarao Garlapati , Pruthwik Mishra

Large language models (LLMs) have become increasingly sophisticated, leading to widespread deployment in sensitive applications where safety and reliability are paramount. However, LLMs have inherent risks accompanying them, including bias,…

Cryptography and Security · Computer Science 2024-06-21 Suriya Ganesh Ayyamperumal , Limin Ge

Large language models (LLMs) are transforming research on machine learning while galvanizing public debates. Understanding not only when these models work well and succeed but also why they fail and misbehave is of great societal relevance.…

Computation and Language · Computer Science 2024-10-16 Julian Coda-Forno , Kristin Witte , Akshay K. Jagadish , Marcel Binz , Zeynep Akata , Eric Schulz

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus…

Cryptography and Security · Computer Science 2025-11-26 Benji Peng , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Junyu Liu , Xinyuan Song , Qian Niu

Large Language Models (LLMs) are prone to generating content that exhibits gender biases, raising significant ethical concerns. Alignment, the process of fine-tuning LLMs to better align with desired behaviors, is recognized as an effective…

Computation and Language · Computer Science 2024-12-17 Tao Zhang , Ziqian Zeng , Yuxiang Xiao , Huiping Zhuang , Cen Chen , James Foulds , Shimei Pan

Artificial intelligence (AI), particularly in the form of large language models (LLMs) or chatbots, has become increasingly integrated into our daily lives. In the past five years, several LLMs have been introduced, including ChatGPT by…

Human-Computer Interaction · Computer Science 2026-05-06 Mouhacine Benosman

The rapid emergence of Large Language Models (LLMs) has precipitated a profound paradigm shift in Artificial Intelligence, delivering monumental engineering successes that increasingly impact modern society. However, a critical paradox…

Computation and Language · Computer Science 2026-03-13 Zeyu Gan , Ruifeng Ren , Wei Yao , Xiaolin Hu , Gengze Xu , Chen Qian , Huayi Tang , Zixuan Gong , Xinhao Yao , Pengwei Tang , Zhenxing Dou , Yong Liu

Large Language Models (LLMs) have advanced various Natural Language Processing (NLP) tasks, such as text generation and translation, among others. However, these models often generate texts that can perpetuate biases. Existing approaches to…

Computation and Language · Computer Science 2025-01-07 Shaina Raza , Oluwanifemi Bamgbose , Shardul Ghuge , Fatemeh Tavakol , Deepak John Reji , Syed Raza Bashir