English
Related papers

Related papers: BiasBusters: Uncovering and Mitigating Tool Select…

200 papers

As large language models (LLMs) become integral to intelligent user interfaces (IUIs), their role as decision-making agents raises critical concerns about alignment. Although extensive research has addressed issues such as factuality, bias,…

Artificial Intelligence · Computer Science 2025-04-23 Anna Karnysheva , Christian Drescher , Dietrich Klakow

Multimodal Large Language Models (MLLMs) already achieve state-of-the-art results across a wide range of tasks and modalities. To push their reasoning ability further, recent studies explore advanced prompting schemes and post-training…

Artificial Intelligence · Computer Science 2025-09-09 Zhenyu Pan , Yutong Zhang , Jianshu Zhang , Haoran Lu , Haozheng Luo , Yuwei Han , Philip S. Yu , Manling Li , Han Liu

The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When…

Information Retrieval · Computer Science 2025-11-04 Amirabbas Afzali , Amirreza Velae , Iman Ahmadi , Mohammad Aliannejadi

Existing evaluations of tool learning primarily focus on validating the alignment of selected tools for large language models (LLMs) with expected outcomes. However, these approaches rely on a limited set of scenarios where answers can be…

Computation and Language · Computer Science 2024-12-06 Junjie Ye , Guanyu Li , Songyang Gao , Caishuang Huang , Yilong Wu , Sixian Li , Xiaoran Fan , Shihan Dou , Tao Ji , Qi Zhang , Tao Gui , Xuanjing Huang

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus…

Cryptography and Security · Computer Science 2025-11-26 Benji Peng , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Junyu Liu , Xinyuan Song , Qian Niu

Warning: This paper contains examples of stereotypes and biases. Large Language Models (LLMs) exhibit considerable social biases, and various studies have tried to evaluate and mitigate these biases accurately. Previous studies use…

Computation and Language · Computer Science 2024-07-04 Rem Hida , Masahiro Kaneko , Naoaki Okazaki

In traditional decision making processes, social biases of human decision makers can lead to unequal economic outcomes for underrepresented social groups, such as women, racial or ethnic minorities. Recently, the increasing popularity of…

General Economics · Economics 2024-03-25 Jiafu An , Difang Huang , Chen Lin , Mingzhu Tai

Large language models (LLMs) are increasingly integral to information retrieval (IR), powering ranking, evaluation, and AI-assisted content creation. This widespread adoption necessitates a critical examination of potential biases arising…

Information Retrieval · Computer Science 2025-07-11 Krisztian Balog , Donald Metzler , Zhen Qin

The rapid advancement of large language models (LLMs) has inspired researchers to integrate them extensively into the academic workflow, potentially reshaping how research is practiced and reviewed. While previous studies highlight the…

Computation and Language · Computer Science 2025-10-15 Rui Li , Jia-Chen Gu , Po-Nien Kung , Heming Xia , Junfeng liu , Xiangwen Kong , Zhifang Sui , Nanyun Peng

Transformer-based agentic AI is rapidly being deployed on major platforms to help users shop, watch, and navigate content with less effort. While these systems can deliver impressive performance, a key concern is whether they may be less…

Computers and Society · Computer Science 2026-05-01 Jinhui Han , Ming Hu , Xilin Zhang

The importance of addressing fairness and bias in artificial intelligence (AI) systems cannot be over-emphasized. Mainstream media has been awashed with news of incidents around stereotypes and other types of bias in many of these systems…

Computation and Language · Computer Science 2024-09-10 Tosin Adewumi , Lama Alkhaled , Namrata Gurung , Goya van Boven , Irene Pagliai

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

Recent advancements in Large Language Models (LLMs) have positioned them as powerful tools for clinical decision-making, with rapidly expanding applications in healthcare. However, concerns about bias remain a significant challenge in the…

Artificial Intelligence · Computer Science 2024-10-23 Kenza Benkirane , Jackie Kay , Maria Perez-Ortiz

Recommendation systems for Web content distribution intricately connect to the information access and exposure opportunities for vulnerable populations. The emergence of Large Language Models-based Recommendation System (LRS) may introduce…

Information Retrieval · Computer Science 2024-02-26 Meng Jiang , Keqin Bao , Jizhi Zhang , Wenjie Wang , Zhengyi Yang , Fuli Feng , Xiangnan He

Large Language Models (LLMs) inherit societal biases from their training data, potentially leading to harmful or unfair outputs. While various techniques aim to mitigate these biases, their effects are often evaluated only along the…

Computation and Language · Computer Science 2025-11-25 Shireen Chand , Faith Baca , Emilio Ferrara

Text classification is a crucial task encountered frequently in practical scenarios, yet it is still under-explored in the era of large language models (LLMs). This study shows that LLMs are vulnerable to changes in the number and…

Computation and Language · Computer Science 2024-06-12 Zhenyi Lu , Jie Tian , Wei Wei , Xiaoye Qu , Yu Cheng , Wenfeng xie , Dangyang Chen

From disinformation spread by AI chatbots to AI recommendations that inadvertently reinforce stereotypes, textual bias poses a significant challenge to the trustworthiness of large language models (LLMs). In this paper, we propose a…

Computation and Language · Computer Science 2025-03-04 Tianyi Huang , Elsa Fan

Tool learning aims to enhance and expand large language models' (LLMs) capabilities with external tools, which has gained significant attention recently. Current methods have shown that LLMs can effectively handle a certain amount of tools…

Computation and Language · Computer Science 2024-10-01 Qiancheng Xu , Yongqi Li , Heming Xia , Wenjie Li

System prompts in Large Language Models (LLMs) are predefined directives that guide model behaviour, taking precedence over user inputs in text processing and generation. LLM deployers increasingly use them to ensure consistent responses…

Computers and Society · Computer Science 2025-06-24 Anna Neumann , Elisabeth Kirsten , Muhammad Bilal Zafar , Jatinder Singh

Detecting biases in structured data is a complex and time-consuming task. Existing automated techniques are limited in diversity of data types and heavily reliant on human case-by-case handling, resulting in a lack of generalizability.…

Artificial Intelligence · Computer Science 2025-04-08 Haoxuan Li , Mingyu Derek Ma , Jen-tse Huang , Zhaotian Weng , Wei Wang , Jieyu Zhao