English
Related papers

Related papers: ImplicitBBQ: Benchmarking Implicit Bias in Large L…

200 papers

Social bias is shaped by the accumulation of social perceptions towards targets across various demographic identities. To fully understand such social bias in large language models (LLMs), it is essential to consider the composite of social…

Computation and Language · Computer Science 2024-06-07 Jisu Shin , Hoyun Song , Huije Lee , Soyeong Jeong , Jong C. Park

With the advance of Artificial Intelligence (AI), Large Language Models (LLMs) have gained prominence and been applied in diverse contexts. As they evolve into more sophisticated versions, it is essential to assess whether they reproduce…

Computation and Language · Computer Science 2025-08-15 Gustavo Bonil , Simone Hashiguti , Jhessica Silva , João Gondim , Helena Maia , Nádia Silva , Helio Pedrini , Sandra Avila

Language models (LMs) rely on their parametric knowledge augmented with relevant contextual knowledge for certain tasks, such as question answering. However, the contextual knowledge can contain private information that may be leaked when…

Computation and Language · Computer Science 2025-12-17 James Flemings , Bo Jiang , Wanrong Zhang , Zafar Takhirov , Murali Annavaram

Large Language Models (LLMs) have emerged as powerful candidates to inform clinical decision-making processes. While these models play an increasingly prominent role in shaping the digital landscape, two growing concerns emerge in…

Computation and Language · Computer Science 2024-04-24 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Large language models (LLMs) often inherit and amplify social biases embedded in their training data. A prominent social bias is gender bias. In this regard, prior work has mainly focused on gender stereotyping bias - the association of…

Computation and Language · Computer Science 2025-06-18 Erik Derner , Sara Sansalvador de la Fuente , Yoan Gutiérrez , Paloma Moreda , Nuria Oliver

Handling implicit language is essential for natural language processing systems to achieve precise text understanding and facilitate natural interactions with users. Despite its importance, the absence of a metric for accurately measuring…

Computation and Language · Computer Science 2025-02-25 Yuxin Wang , Xiaomeng Zhu , Weimin Lyu , Saeed Hassanpour , Soroush Vosoughi

Large Language Models (LLMs) often provide chain-of-thought (CoT) reasoning traces that appear plausible, but may hide internal biases. We call these *unverbalized biases*. Monitoring models via their stated reasoning is therefore…

Machine Learning · Computer Science 2026-03-02 Iván Arcuschin , David Chanin , Adrià Garriga-Alonso , Oana-Maria Camburu

Large Language Models (LLMs) are known to exhibit social, demographic, and gender biases, often as a consequence of the data on which they are trained. In this work, we adopt a mechanistic interpretability approach to analyze how such…

Computation and Language · Computer Science 2025-06-09 Bhavik Chandna , Zubair Bashir , Procheta Sen

Existing fairness benchmarks for large language models (LLMs) primarily focus on simple tasks, such as multiple-choice questions, overlooking biases that may arise in more complex scenarios like long-text generation. To address this gap, we…

Computation and Language · Computer Science 2025-08-08 Wonje Jeung , Dongjae Jeon , Ashkan Yousefpour , Jonghyun Choi

The creation of benchmarks to evaluate the safety of Large Language Models is one of the key activities within the trusted AI community. These benchmarks allow models to be compared for different aspects of safety such as toxicity, bias,…

Artificial Intelligence · Computer Science 2025-06-23 Lina Berrayana , Sean Rooney , Luis Garcés-Erice , Ioana Giurgiu

As the breadth and depth of language model applications continue to expand rapidly, it is increasingly important to build efficient frameworks for measuring and mitigating the learned or inherited social biases of these models. In this…

Computation and Language · Computer Science 2023-07-21 Omkar Dige , Jacob-Junqi Tian , David Emerson , Faiza Khan Khattak

Natural language processing (NLP) models often replicate or amplify social bias from training data, raising concerns about fairness. At the same time, their black-box nature makes it difficult for users to recognize biased predictions and…

Computation and Language · Computer Science 2026-02-12 Yifan Wang , Mayank Jobanputra , Ji-Ung Lee , Soyoung Oh , Isabel Valera , Vera Demberg

Text-to-Image (TTI) models are powerful creative tools but risk amplifying harmful social biases. We frame representational societal bias assessment as an image curation and evaluation task and introduce a pilot benchmark of occupational…

Computation and Language · Computer Science 2025-09-03 Shaina Raza , Maximus Powers , Partha Pratim Saha , Mahveen Raza , Rizwan Qureshi

Large vision-language model (LVLM) based text-to-image (T2I) systems have become the dominant paradigm in image generation, yet whether they amplify social biases remains insufficiently understood. In this paper, we show that LVLM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 NaHyeon Park , Namin An , Kunhee Kim , Soyeon Yoon , Jiahao Huo , Hyunjung Shim

Social bias in machine learning has drawn significant attention, with work ranging from demonstrations of bias in a multitude of applications, curating definitions of fairness for different contexts, to developing algorithms to mitigate…

Computation and Language · Computer Science 2019-11-06 Yi Chern Tan , L. Elisa Celis

Users often assume that large language models (LLMs) share their cognitive alignment of context and intent, leading them to omit critical information in question-answering (QA) and produce ambiguous queries. Responses based on misaligned…

Computation and Language · Computer Science 2025-09-12 Zongxi Li , Yang Li , Haoran Xie , S. Joe Qin

Large Language Models (LLMs) are reported to hold undesirable attestation bias on inference tasks: when asked to predict if a premise P entails a hypothesis H, instead of considering H's conditional truthfulness entailed by P, LLMs tend to…

Computation and Language · Computer Science 2024-08-27 Tianyang Liu , Tianyi Li , Liang Cheng , Mark Steedman

The growing deployment of large language models (LLMs) across diverse cultural contexts necessitates a deeper understanding of LLMs' representations of different cultures. Prior work has focused on evaluating the cultural awareness of LLMs…

Computation and Language · Computer Science 2026-01-19 Haeun Yu , Seogyeong Jeong , Siddhesh Pawar , Jisu Shin , Jiho Jin , Junho Myung , Alice Oh , Isabelle Augenstein

Large language models sometimes produce false or misleading responses. Two approaches to this problem are honesty elicitation -- modifying prompts or weights so that the model answers truthfully -- and lie detection -- classifying whether a…

Machine Learning · Computer Science 2026-03-11 Helena Casademunt , Bartosz Cywiński , Khoi Tran , Arya Jakkli , Samuel Marks , Neel Nanda

Conceptual reasoning, the ability to reason in abstract and high-level perspectives, is key to generalization in human cognition. However, limited study has been done on large language models' capability to perform conceptual reasoning. In…

Computation and Language · Computer Science 2024-04-02 Ben Zhou , Hongming Zhang , Sihao Chen , Dian Yu , Hongwei Wang , Baolin Peng , Dan Roth , Dong Yu