English
Related papers

Related papers: Evaluate Bias without Manual Test Sets: A Concept …

200 papers

Bias can be introduced in diverse ways in machine learning datasets, for example via selection or label bias. Although these bias types in themselves have an influence on important aspects of fair machine learning, their different impact…

Machine Learning · Computer Science 2026-03-11 Magali Legast , Toon Calders , François Fouss

Large Language Models (LLMs) have emerged as powerful candidates to inform clinical decision-making processes. While these models play an increasingly prominent role in shaping the digital landscape, two growing concerns emerge in…

Computation and Language · Computer Science 2024-04-24 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

As large language models (LLMs) become increasingly embedded in civic, educational, and political information environments, concerns about their potential political bias have grown. Prior research often evaluates such bias through simulated…

Computers and Society · Computer Science 2026-03-20 Tai-Quan Peng , Kaiqi Yang , Sanguk Lee , Hang Li , Yucheng Chu , Yuping Lin , Hui Liu

The emerging in-context learning (ICL) ability of large language models (LLMs) has prompted their use for predictive tasks in various domains with different data types, including tabular data, facilitated by serialization methods. However,…

Machine Learning · Computer Science 2025-11-18 Karuna Bhaila , Minh-Hao Van , Kennedy Edemacu , Chen Zhao , Feng Chen , Xintao Wu

We introduce a dataset of concept learning tasks that helps uncover implicit biases in large language models. Using in-context concept learning experiments, we found that language models may have a bias toward upward monotonicity in…

Computation and Language · Computer Science 2025-11-27 Leroy Z. Wang

With the internet's evolution, consumers increasingly rely on online reviews for service or product choices, necessitating that businesses analyze extensive customer feedback to enhance their offerings. While machine learning-based…

Computation and Language · Computer Science 2025-02-06 Yejian Zhang , Shingo Takada

Large Language Models (LLMs) can generate biased responses. Yet previous direct probing techniques contain either gender mentions or predefined gender stereotypes, which are challenging to comprehensively collect. Hence, we propose an…

Computation and Language · Computer Science 2024-02-20 Xiangjue Dong , Yibo Wang , Philip S. Yu , James Caverlee

This research investigates both explicit and implicit social biases exhibited by Vision-Language Models (VLMs). The key distinction between these bias types lies in the level of awareness: explicit bias refers to conscious, intentional…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jen-tse Huang , Jiantong Qin , Jianping Zhang , Youliang Yuan , Wenxuan Wang , Jieyu Zhao

Learning generalized models from biased data is an important undertaking toward fairness in deep learning. To address this issue, recent studies attempt to identify and leverage bias-conflicting samples free from spurious correlations…

Machine Learning · Computer Science 2024-11-04 Yeonsung Jung , Jaeyun Song , June Yong Yang , Jin-Hwa Kim , Sung-Yub Kim , Eunho Yang

Open-generation bias benchmarks evaluate social biases in Large Language Models (LLMs) by analyzing their outputs. However, the classifiers used in analysis often have inherent biases, leading to unfair conclusions. This study examines such…

Computation and Language · Computer Science 2025-01-22 Nathaniel Demchak , Xin Guan , Zekun Wu , Ziyi Xu , Adriano Koshiyama , Emre Kazim

Large language models (LLMs) are the foundation of the current successes of artificial intelligence (AI), however, they are unavoidably biased. To effectively communicate the risks and encourage mitigation efforts these models need adequate…

Computation and Language · Computer Science 2025-01-14 Carolin M. Schuster , Maria-Alexandra Dinisor , Shashwat Ghatiwala , Georg Groh

While advances in fairness and alignment have helped mitigate overt biases exhibited by large language models (LLMs) when explicitly prompted, we hypothesize that these models may still exhibit implicit biases when simulating human…

Computation and Language · Computer Science 2025-01-30 Yuxuan Li , Hirokazu Shirado , Sauvik Das

Large Language Models (LLMs) are widely used to evaluate natural language generation tasks as automated metrics. However, the likelihood, a measure of LLM's plausibility for a sentence, can vary due to superficial differences in sentences,…

Computation and Language · Computer Science 2025-11-11 Masanari Oi , Masahiro Kaneko , Ryuto Koike , Mengsay Loem , Naoaki Okazaki

Large vision-language models (LVLMs) have been rapidly developed and widely used in various fields, but the (potential) stereotypical bias in the model is largely unexplored. In this study, we present a pioneering measurement framework,…

Cryptography and Security · Computer Science 2024-10-10 Yukun Jiang , Zheng Li , Xinyue Shen , Yugeng Liu , Michael Backes , Yang Zhang

Language models (LM) are becoming prevalent in many language-based application spaces globally. Although these LMs are improving our day-to-day interactions with digital products, concerns remain whether open-ended languages or text…

Computation and Language · Computer Science 2022-06-27 Akhter Al Amin , Kazi Sinthia Kabir

We propose LENS, a modular approach for tackling computer vision problems by leveraging the power of large language models (LLMs). Our system uses a language model to reason over outputs from a set of independent and highly descriptive…

Computation and Language · Computer Science 2023-06-29 William Berrios , Gautam Mittal , Tristan Thrush , Douwe Kiela , Amanpreet Singh

The "LLM-as-a-Judge" paradigm, using Large Language Models (LLMs) as automated evaluators, is pivotal to LLM development, offering scalable feedback for complex tasks. However, the reliability of these judges is compromised by various…

Computation and Language · Computer Science 2026-05-22 Qingquan Li , Shaoyu Dou , Kailai Shao , Chao Chen , Haixiang Hu

Despite their success, Large-Language Models (LLMs) still face criticism due to their lack of interpretability. Traditional post-hoc interpretation methods, based on attention and gradient-based analysis, offer limited insights as they only…

Computation and Language · Computer Science 2025-07-17 Francesco De Santis , Philippe Bich , Gabriele Ciravegna , Pietro Barbiero , Danilo Giordano , Tania Cerquitelli

With the evolution of large language models (LLMs), their robustness against individual simple biases has been enhanced. However, we observe that the ensemble of multiple simple biases still exerts a significant adverse impact on LLMs.…

Computation and Language · Computer Science 2026-04-21 Zhouhao Sun , Zhiyuan Kan , Xiao Ding , Li Du , Bibo Cai , Yang Zhao , Bing Qin , Ting Liu

As Large Language Models (LLMs) have risen in prominence over the past few years, there has been concern over the potential biases in LLMs inherited from the training data. Previous studies have examined how LLMs exhibit implicit bias, such…

Computation and Language · Computer Science 2025-12-30 Lake Yin , Fan Huang