English
Related papers

Related papers: Open-DeBias: Toward Mitigating Open-Set Bias in La…

200 papers

The adoption of large language models (LLMs) to assist clinicians has attracted remarkable attention. Existing works mainly adopt the close-ended question-answering (QA) task with answer options for evaluation. However, many clinical…

As the construction industry advances toward digital transformation, BIM (Building Information Modeling)-based design has become a key driver supporting intelligent construction. Despite Large Language Models (LLMs) have shown potential in…

Artificial Intelligence · Computer Science 2026-02-25 Jia-Rui Lin , Yun-Hong Cai , Xiang-Rui Ni , Shaojie Zhou , Peng Pan

Language models (LMs) are known to be prone to response biases, which present as option preference biases in fixed-response questions. It is therefore imperative to develop low-cost and effective response bias correction methods to improve…

Computation and Language · Computer Science 2026-02-16 Om Bhatt , Anna A. Ivanova

Embeddings play a pivotal role in the efficacy of Large Language Models. They are the bedrock on which these models grasp contextual relationships and foster a more nuanced understanding of language and consequently perform remarkably on a…

Computation and Language · Computer Science 2025-01-08 Aishik Rakshit , Smriti Singh , Shuvam Keshari , Arijit Ghosh Chowdhury , Vinija Jain , Aman Chadha

Large Language Models (LLMs) exhibit strong natural language processing capabilities but also inherit and amplify societal biases, including gender bias, raising fairness concerns. Existing debiasing methods face significant limitations:…

Computation and Language · Computer Science 2025-02-18 Hongye Qiu , Yue Xu , Meikang Qiu , Wenjie Wang

Question-answering (QA) models have advanced significantly in machine reading comprehension but often exhibit biases that hinder their performance, particularly with complex queries in adversarial conditions. This study evaluates the…

Computation and Language · Computer Science 2026-01-21 Yuefeng Wang , ChangJae Lee

Large Language Models (LLMs) have demonstrated considerable success in open-book question answering (QA), where the task requires generating answers grounded in a provided external context. A critical challenge in open-book QA is to ensure…

Computation and Language · Computer Science 2025-05-02 Ivan Vankov , Matyo Ivanov , Adriana Correia , Victor Botev

Societal biases present in pre-trained large language models are a critical issue as these models have been shown to propagate biases in countless downstream applications, rendering them unfair towards specific groups of people. Since…

Computation and Language · Computer Science 2023-06-08 Himanshu Thakur , Atishay Jain , Praneetha Vaddamanu , Paul Pu Liang , Louis-Philippe Morency

Despite growing interest in using Large Language Models (LLMs) for educational assessment, it remains unclear how closely they align with human scoring. We present a systematic evaluation of instruction-tuned LLMs across three open…

Computation and Language · Computer Science 2026-04-02 Filip J. Kucia , Anirban Chakraborty , Anna Wróblewska

Large language model (LLM)-based judges are widely adopted for automated evaluation and reward modeling, yet their judgments are often affected by judgment biases. Accurately evaluating these biases is essential for ensuring the reliability…

Computation and Language · Computer Science 2026-03-10 Hongli Zhou , Hui Huang , Rui Zhang , Kehai Chen , Bing Xu , Conghui Zhu , Tiejun Zhao , Muyun Yang

Large Language Models (LLMs) are deployed in high-stakes settings but can show demographic, gender, and geographic biases that undermine fairness and trust. Prior debiasing methods, including embedding-space projections, prompt-based…

Computation and Language · Computer Science 2026-03-24 Ravi Ranjan , Utkarsh Grover , Mayur Akewar , Xiaomin Lin , Agoritsa Polyzou

The use of Large Language Models (LLMs) in hiring has led to legislative actions to protect vulnerable demographic groups. This paper presents a novel framework for benchmarking hierarchical gender hiring bias in Large Language Models…

Computation and Language · Computer Science 2025-01-20 Ze Wang , Zekun Wu , Xin Guan , Michael Thaler , Adriano Koshiyama , Skylar Lu , Sachin Beepath , Ediz Ertekin , Maria Perez-Ortiz

Open-generation bias benchmarks evaluate social biases in Large Language Models (LLMs) by analyzing their outputs. However, the classifiers used in analysis often have inherent biases, leading to unfair conclusions. This study examines such…

Computation and Language · Computer Science 2025-01-22 Nathaniel Demchak , Xin Guan , Zekun Wu , Ziyi Xu , Adriano Koshiyama , Emre Kazim

Large Language Models (LLMs) perpetuate social biases, reflecting prejudices in their training data and reinforcing societal stereotypes and inequalities. Our work explores the potential of the Contact Hypothesis, a concept from social…

Computation and Language · Computer Science 2024-07-03 Chahat Raj , Anjishnu Mukherjee , Aylin Caliskan , Antonios Anastasopoulos , Ziwei Zhu

We present a novel approach to bias mitigation in large language models (LLMs) by applying steering vectors to modify model activations in forward passes. We compute 8 steering vectors, each corresponding to a different social bias axis,…

Machine Learning · Computer Science 2026-03-31 Zara Siddique , Irtaza Khalid , Liam D. Turner , Luis Espinosa-Anke

With the increasing adoption of large language models (LLMs) in education, concerns about inherent biases in these models have gained prominence. We evaluate LLMs for bias in the personalized educational setting, specifically focusing on…

Computation and Language · Computer Science 2025-02-11 Iain Weissburg , Sathvika Anand , Sharon Levy , Haewon Jeong

Large Language Models (LLMs) are increasingly adopted in financial analysis for interpreting complex market data and trends. However, their use is challenged by intrinsic biases (e.g., risk-preference bias) and a superficial understanding…

Computation and Language · Computer Science 2024-07-02 Yuhang Zhou , Yuchen Ni , Yunhui Gan , Zhangyue Yin , Xiang Liu , Jian Zhang , Sen Liu , Xipeng Qiu , Guangnan Ye , Hongfeng Chai

Word embeddings have been shown to produce remarkable results in tackling a vast majority of NLP related tasks. Unfortunately, word embeddings also capture the stereotypical biases that are prevalent in society, affecting the predictive…

Computation and Language · Computer Science 2024-11-20 Navya Yarrabelly , Vinay Damodaran , Feng-Guang Su

Large Multi-Modal Models (LMMs) have demonstrated impressive capabilities as general-purpose chatbots able to engage in conversations about visual inputs. However, their responses are influenced by societal biases present in their training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Neale Ratzlaff , Matthew Lyle Olson , Musashi Hinck , Estelle Aflalo , Shao-Yen Tseng , Vasudev Lal , Phillip Howard

Existing NLP datasets contain various biases that models can easily exploit to achieve high performances on the corresponding evaluation sets. However, focusing on dataset-specific biases limits their ability to learn more generalizable…

Computation and Language · Computer Science 2020-10-08 Mingzhu Wu , Nafise Sadat Moosavi , Andreas Rücklé , Iryna Gurevych