English
Related papers

Related papers: Bias Vector: Mitigating Biases in Language Models …

200 papers

Large language models (LLMs) trained on vast corpora suffer from inevitable stereotype biases. Mitigating these biases with fine-tuning could be both costly and data-hungry. Model editing methods, which focus on modifying LLMs in a post-hoc…

Computation and Language · Computer Science 2024-02-22 Jianhao Yan , Futing Wang , Yafu Li , Yue Zhang

Social biases can manifest in language agency. However, very limited research has investigated such biases in Large Language Model (LLM)-generated content. In addition, previous works often rely on string-matching techniques to identify…

Computation and Language · Computer Science 2025-06-03 Yixin Wan , Kai-Wei Chang

Generating synthetic datasets via large language models (LLMs) has emerged as a promising approach to improve LLM performance. However, LLMs inherently reflect biases in their training data, leading to a critical challenge: when models are…

Machine Learning · Computer Science 2026-05-06 Miaomiao Li , Hao Chen , Yang Wang , Tingyuan Zhu , Weijia Zhang , Kaijie Zhu , Kam-Fai Wong , Jindong Wang

Due to the implement of guardrails by developers, Large language models (LLMs) have demonstrated exceptional performance in explicit bias tests. However, bias in LLMs may occur not only explicitly, but also implicitly, much like humans who…

Computation and Language · Computer Science 2025-03-05 Xinru Lin , Luyang Li

Many studies have shown various biases targeting different demographic groups in language models, amplifying discrimination and harming fairness. Recent parameter modification debiasing approaches significantly degrade core capabilities…

Computation and Language · Computer Science 2025-10-01 Dianqing Liu , Yi Liu , Guoqing Jin , Zhendong Mao

The growing deployment of large language models (LLMs) has amplified concerns regarding their inherent biases, raising critical questions about their fairness, safety, and societal impact. However, quantifying LLM bias remains a fundamental…

Computation and Language · Computer Science 2025-05-26 Alireza Arbabi , Florian Kerschbaum

Recent studies have shown that generative language models often reflect and amplify societal biases in their outputs. However, these studies frequently conflate observed biases with other task-specific shortcomings, such as comprehension…

Computation and Language · Computer Science 2024-12-17 Akshita Jha , Sanchit Kabra , Chandan K. Reddy

Tabular machine learning problems often require time-consuming and labor-intensive feature engineering. Recent efforts have focused on using large language models (LLMs) to capitalize on their potential domain knowledge. At the same time,…

Machine Learning · Computer Science 2025-07-16 Jaris Küken , Lennart Purucker , Frank Hutter

Vision-language models (VLMs) pre-trained on extensive datasets can inadvertently learn biases by correlating gender information with specific objects or scenarios. Current methods, which focus on modifying inputs and monitoring changes in…

Artificial Intelligence · Computer Science 2025-06-09 Zhaotian Weng , Zijun Gao , Jerone Andrews , Jieyu Zhao

Biases in the dataset often enable the model to achieve high performance on in-distribution data, while poorly performing on out-of-distribution data. To mitigate the detrimental effect of the bias on the networks, previous works have…

Computation and Language · Computer Science 2023-12-07 Eojin Jeon , Mingyu Lee , Juhyeong Park , Yeachan Kim , Wing-Lam Mok , SangKeun Lee

Word embedding has become essential for natural language processing as it boosts empirical performances of various tasks. However, recent research discovers that gender bias is incorporated in neural word embeddings, and downstream tasks…

Computation and Language · Computer Science 2019-11-26 Zekun Yang , Juan Feng

Large language models (LLMs) have shown remarkable advances in language generation and understanding but are also prone to exhibiting harmful social biases. While recognition of these behaviors has generated an abundance of bias mitigation…

Large pre-trained vision-language models (VLMs) reduce the time for developing predictive models for various vision-grounded language downstream tasks by providing rich, adaptable image and text representations. However, these models suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Ashish Seth , Mayur Hemani , Chirag Agarwal

Large language models (LLMs) are increasingly used in clinical settings, raising concerns about racial bias in both generated medical text and clinical reasoning. Existing studies have identified bias in medical LLMs, but many focus on…

Computers and Society · Computer Science 2026-04-21 Sihao Xing , Zaur Gouliev

The advancement of Large Language Models (LLMs) has transformed Natural Language Processing (NLP), enabling performance across diverse tasks with little task-specific training. However, LLMs remain susceptible to social biases, particularly…

Computation and Language · Computer Science 2025-07-08 Melanie Galea , Claudia Borg

The rapid advancement of Vision-Language models (VLMs) has raised growing concerns that their black-box reasoning processes could lead to unintended forms of social bias. Current debiasing approaches focus on mitigating surface-level bias…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Na Min An , Yoonna Jang , Yusuke Hirota , Ryo Hachiuma , Isabelle Augenstein , Hyunjung Shim

As Large Language Models (LLMs) continue to evolve, they are increasingly being employed in numerous studies to simulate societies and execute diverse social tasks. However, LLMs are susceptible to societal biases due to their exposure to…

Computation and Language · Computer Science 2024-10-04 Angana Borah , Rada Mihalcea

Large Vision Language Models (LVLMs) such as LLaVA have demonstrated impressive capabilities as general-purpose chatbots that can engage in conversations about a provided input image. However, their responses are influenced by societal…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Neale Ratzlaff , Matthew Lyle Olson , Musashi Hinck , Shao-Yen Tseng , Vasudev Lal , Phillip Howard

Large Vision-Language Models (LVLMs) extend large language models with visual understanding, but remain vulnerable to hallucination, where outputs are fluent yet inconsistent with images. Recent studies link this issue to language bias-the…

Computation and Language · Computer Science 2026-05-26 Yangneng Chen , Jing Li

New Large Language Models (LLMs) become available every few weeks, and modern application developers confronted with the unenviable task of having to decide if they should switch to a new model. While human evaluation remains the gold…

Artificial Intelligence · Computer Science 2025-12-25 Suryaansh Jain , Umair Z. Ahmed , Shubham Sahai , Ben Leong