中文
相关论文

相关论文: Debiasing Text Safety Classifiers through a Fairne…

200 篇论文

Large language models (LLMs) have become increasingly sophisticated, leading to widespread deployment in sensitive applications where safety and reliability are paramount. However, LLMs have inherent risks accompanying them, including bias,…

密码学与安全 · 计算机科学 2024-06-21 Suriya Ganesh Ayyamperumal , Limin Ge

Frontier Large Language Models (LLMs) can be socially discriminatory or sensitive to spurious features of their inputs. Because only well-resourced corporations can train frontier LLMs, we need robust test-time strategies to control such…

计算与语言 · 计算机科学 2024-10-08 Leonardo Cotta , Chris J. Maddison

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

计算与语言 · 计算机科学 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia

Bias mitigation approaches reduce models' dependence on sensitive features of data, such as social group tokens (SGTs), resulting in equal predictions across the sensitive features. In hate speech detection, however, equalizing model…

计算与语言 · 计算机科学 2021-08-05 Aida Mostafazadeh Davani , Ali Omrani , Brendan Kennedy , Mohammad Atari , Xiang Ren , Morteza Dehghani

Large Language Models (LLMs) have revolutionized Recommender Systems (RS) through advanced generative user modeling. However, LLM-based RS (LLM-RS) often inadvertently perpetuates bias present in the training data, leading to severe…

信息检索 · 计算机科学 2026-02-03 Jin Li , Huilin Gu , Shoujin Wang , Qi Zhang , Shui Yu , Chen Wang , Xiwei Xu , Fang Chen

Large language models (LLMs) are vulnerable when trained on datasets containing harmful content, which leads to potential jailbreaking attacks in two scenarios: the integration of harmful texts within crowdsourced data used for pre-training…

密码学与安全 · 计算机科学 2024-06-03 Xiaoqun Liu , Jiacheng Liang , Muchao Ye , Zhaohan Xi

With the evolution of large language models (LLMs), their robustness against individual simple biases has been enhanced. However, we observe that the ensemble of multiple simple biases still exerts a significant adverse impact on LLMs.…

计算与语言 · 计算机科学 2026-04-21 Zhouhao Sun , Zhiyuan Kan , Xiao Ding , Li Du , Bibo Cai , Yang Zhao , Bing Qin , Ting Liu

Large language models (LLMs) are approaching expert-level performance in medical question answering (QA), demonstrating strong potential to improve public healthcare. However, underlying biases related to sensitive attributes such as sex…

人工智能 · 计算机科学 2026-01-13 Ying Xiao , Jie Huang , Ruijuan He , Jing Xiao , Mohammad Reza Mousavi , Yepang Liu , Kezhi Li , Zhenpeng Chen , Jie M. Zhang

Language models frequently inherit societal biases from their training data. Numerous techniques have been proposed to mitigate these biases during both the pre-training and fine-tuning stages. However, fine-tuning a pre-trained debiased…

计算与语言 · 计算机科学 2024-10-03 Shahed Masoudian , Markus Frohmann , Navid Rekabsaz , Markus Schedl

Recent work on reducing bias in NLP models usually focuses on protecting or isolating information related to a sensitive attribute (like gender or race). However, when sensitive information is semantically entangled with the task…

计算与语言 · 计算机科学 2022-10-25 Zexue He , Yu Wang , Julian McAuley , Bodhisattwa Prasad Majumder

Large Language Models (LLMs) are being increasingly integrated into software systems, offering powerful capabilities but also raising concerns about fairness. Existing fairness benchmarks, however, focus on stereotype-specific associations,…

软件工程 · 计算机科学 2026-04-08 Gianmario Voria , Martina De Lucia , Alessandra Raia , Andrea De Lucia , Gemma Catolino , Fabio Palomba

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart…

计算与语言 · 计算机科学 2022-05-03 Kun Zhou , Beichen Zhang , Wayne Xin Zhao , Ji-Rong Wen

Despite frequent double-blind review, systemic biases related to author demographics still disadvantage underrepresented groups. We start from a simple hypothesis: if a post-review recommender is trained with an explicit fairness…

机器学习 · 计算机科学 2026-03-03 Uttamasha Anjally Oyshi , Susan Gauch

In this paper, we study counterfactual fairness in text classification, which asks the question: How would the prediction change if the sensitive attribute referenced in the example were different? Toxicity classifiers demonstrate a…

机器学习 · 计算机科学 2019-02-15 Sahaj Garg , Vincent Perot , Nicole Limtiaco , Ankur Taly , Ed H. Chi , Alex Beutel

We study the problem of generating counterfactual text for a classifier as a means for understanding and debugging classification. Given a textual input and a classification model, we aim to minimally alter the text to change the model's…

计算与语言 · 计算机科学 2021-10-25 Quintin Pope , Xiaoli Z. Fern

Large Language Models (LLMs) can infer sensitive attributes such as gender or age from indirect cues like names and pronouns, potentially biasing recommendations. While several debiasing methods exist, they require access to the LLMs'…

信息检索 · 计算机科学 2026-03-16 Mihaela Rotar , Theresia Veronika Rampisela , Maria Maistro

Weak supervision enables efficient development of training sets by reducing the need for ground truth labels. However, the techniques that make weak supervision attractive -- such as integrating any source of signal to estimate unknown…

机器学习 · 计算机科学 2023-11-30 Changho Shin , Sonia Cromp , Dyah Adila , Frederic Sala

Recent works in artificial intelligence fairness attempt to mitigate discrimination by proposing constrained optimization programs that achieve parity for some fairness statistic. Most assume availability of the class label, which is…

机器学习 · 计算机科学 2022-04-01 Wenbin Zhang , Jeremy C. Weiss

Large Language Models (LLMs) have made significant strides in Natural Language Processing but remain vulnerable to fairness-related issues, often reflecting biases inherent in their training data. These biases pose risks, particularly when…

计算与语言 · 计算机科学 2025-04-14 Harishwar Reddy , Madhusudan Srinivasan , Upulee Kanewala

Large language models (LLMs) are now widely deployed in user-facing applications, reaching hundreds of millions worldwide. As they become integrated into everyday tasks, growing reliance on their outputs raises significant concerns. In…

计算机与社会 · 计算机科学 2025-10-16 Robin Staab , Jasper Dekoninck , Maximilian Baader , Martin Vechev