中文
相关论文

相关论文: Identifying and Mitigating Social Bias Knowledge i…

200 篇论文

Low-rank approximation techniques have become the de facto standard for fine-tuning Large Language Models (LLMs) due to their reduced computational and memory requirements. This paper investigates the effectiveness of these methods in…

机器学习 · 计算机科学 2024-05-30 Saswat Das , Marco Romanelli , Cuong Tran , Zarreen Reza , Bhavya Kailkhura , Ferdinando Fioretto

The Vision-Language Pre-training (VLP) models like CLIP have gained popularity in recent years. However, many works found that the social biases hidden in CLIP easily manifest in downstream tasks, especially in image retrieval, which can…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Junyang Wang , Yi Zhang , Jitao Sang

The need to assess LLMs for bias and fairness is critical, with current evaluations often being narrow, missing a broad categorical view. In this paper, we propose evaluating the bias and fairness of LLMs from a group fairness lens using a…

计算与语言 · 计算机科学 2025-12-04 Guanqun Bi , Yuqiang Xie , Lei Shen , Yanan Cao

As large language models (LLMs) become more integrated into societal systems, the risk of them perpetuating and amplifying harmful biases becomes a critical safety concern. Traditional methods for mitigating bias often rely on data…

人工智能 · 计算机科学 2025-08-13 Shivam Dubey

Large pre-trained language models contain societal biases and carry along these biases to downstream tasks. Current in-processing bias mitigation approaches (like adversarial training) impose debiasing by updating a model's parameters,…

计算与语言 · 计算机科学 2023-06-21 Deepak Kumar , Oleg Lesota , George Zerveas , Daniel Cohen , Carsten Eickhoff , Markus Schedl , Navid Rekabsaz

The growing deployment of large language models (LLMs) across diverse cultural contexts necessitates a deeper understanding of LLMs' representations of different cultures. Prior work has focused on evaluating the cultural awareness of LLMs…

计算与语言 · 计算机科学 2026-01-19 Haeun Yu , Seogyeong Jeong , Siddhesh Pawar , Jisu Shin , Jiho Jin , Junho Myung , Alice Oh , Isabelle Augenstein

Although Vision-Language Models (VLMs) have achieved remarkable success, the knowledge mechanisms underlying their social biases remain a black box, where fairness- and ethics-related problems harm certain groups of people in society. It is…

计算与语言 · 计算机科学 2026-02-12 Jian Lan , Udo Schlegel , Tanveer Hannan , Gengyuan Zhang , Haokun Chen , Thomas Seidl

Detecting stereotypes and biases in Large Language Models (LLMs) can enhance fairness and reduce adverse impacts on individuals or groups when these LLMs are applied. However, the majority of existing methods focus on measuring the model's…

计算与语言 · 计算机科学 2023-10-30 Yanhong Bai , Jiabao Zhao , Jinxin Shi , Tingjiang Wei , Xingjiao Wu , Liang He

Embeddings play a pivotal role in the efficacy of Large Language Models. They are the bedrock on which these models grasp contextual relationships and foster a more nuanced understanding of language and consequently perform remarkably on a…

计算与语言 · 计算机科学 2025-01-08 Aishik Rakshit , Smriti Singh , Shuvam Keshari , Arijit Ghosh Chowdhury , Vinija Jain , Aman Chadha

The growing deployment of large language models (LLMs) has amplified concerns regarding their inherent biases, raising critical questions about their fairness, safety, and societal impact. However, quantifying LLM bias remains a fundamental…

计算与语言 · 计算机科学 2025-05-26 Alireza Arbabi , Florian Kerschbaum

Large language models (LLMs) are increasingly deployed in high-stakes hiring applications, making decisions that directly impact people's careers and livelihoods. While prior studies suggest simple anti-bias prompts can eliminate…

机器学习 · 计算机科学 2025-06-13 Adam Karvonen , Samuel Marks

Despite numerous efforts to mitigate their biases, ML systems continue to harm already-marginalized people. While predominant ML approaches assume bias can be removed and fair models can be created, we show that these are not always…

计算与语言 · 计算机科学 2025-04-02 Lucy Havens , Benjamin Bach , Melissa Terras , Beatrice Alex

Large Language Models (LLMs) are increasingly adopted in financial analysis for interpreting complex market data and trends. However, their use is challenged by intrinsic biases (e.g., risk-preference bias) and a superficial understanding…

计算与语言 · 计算机科学 2024-07-02 Yuhang Zhou , Yuchen Ni , Yunhui Gan , Zhangyue Yin , Xiang Liu , Jian Zhang , Sen Liu , Xipeng Qiu , Guangnan Ye , Hongfeng Chai

In this paper, we introduce FairSense-AI: a multimodal framework designed to detect and mitigate bias in both text and images. By leveraging Large Language Models (LLMs) and Vision-Language Models (VLMs), FairSense-AI uncovers subtle forms…

计算与语言 · 计算机科学 2025-03-06 Shaina Raza , Mukund Sayeeganesh Chettiar , Matin Yousefabadi , Tahniat Khan , Marcelo Lotif

Fairness-aware learning aims to mitigate discrimination against specific protected social groups (e.g., those categorized by gender, ethnicity, age) while minimizing predictive performance loss. Despite efforts to improve fairness in…

机器学习 · 计算机科学 2025-05-02 Kewen Peng , Yicheng Yang , Hao Zhuo

Identifying bias in LLMs is ongoing. Because they are still in development, what is true today may be false tomorrow. We therefore need general strategies for debiasing that will outlive current models. Strategies developed for debiasing…

人工智能 · 计算机科学 2025-07-15 Thomas T. Hills

Model robustness to bias is often determined by the generalization on carefully designed out-of-distribution datasets. Recent debiasing methods in natural language understanding (NLU) improve performance on such datasets by pressuring…

计算与语言 · 计算机科学 2021-09-10 Michael Mendelson , Yonatan Belinkov

Recent generative large language models (LLMs) show remarkable performance in non-English languages, but when prompted in those languages they tend to express higher harmful social biases and toxicity levels. Prior work has shown that…

计算与语言 · 计算机科学 2025-06-03 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

Mitigation of biases, such as language models' reliance on gender stereotypes, is a crucial endeavor required for the creation of reliable and useful language technology. The crucial aspect of debiasing is to ensure that the models preserve…

计算与语言 · 计算机科学 2025-02-03 Tomasz Limisiewicz , David Mareček , Tomáš Musil

As machine learning algorithms are increasingly deployed for high-impact automated decision making, ethical and increasingly also legal standards demand that they treat all individuals fairly, without discrimination based on their age,…

机器学习 · 计算机科学 2021-05-03 Maarten Buyl , Tijl De Bie