中文
相关论文

相关论文: Debiasing Text Safety Classifiers through a Fairne…

200 篇论文

The presence of social biases in Natural Language Processing (NLP) and Information Retrieval (IR) systems is an ongoing challenge, which underlines the importance of developing robust approaches to identifying and evaluating such biases. In…

信息检索 · 计算机科学 2025-06-30 Maryam Mousavian , Zahra Abbasiantaeb , Mohammad Aliannejadi , Fabio Crestani

Discrimination can occur when the underlying unbiased labels are overwritten by an agent with potential bias, resulting in biased datasets that unfairly harm specific groups and cause classifiers to inherit these biases. In this paper, we…

机器学习 · 计算机科学 2023-12-27 Yixuan Zhang , Boyu Li , Zenan Ling , Feng Zhou

AI Safety Moderation (ASM) classifiers are designed to moderate content on social media platforms and to serve as guardrails that prevent Large Language Models (LLMs) from being fine-tuned on unsafe inputs. Owing to their potential for…

计算与语言 · 计算机科学 2025-01-24 Akshit Achara , Anshuman Chhabra

The increasing application of Artificial Intelligence and Machine Learning models poses potential risks of unfair behavior and, in light of recent regulations, has attracted the attention of the research community. Several researchers…

Large Language Models (LLMs) are prone to inheriting and amplifying societal biases embedded within their training data, potentially reinforcing harmful stereotypes related to gender, occupation, and other sensitive categories. This issue…

计算与语言 · 计算机科学 2024-08-28 Atmika Gorti , Manas Gaur , Aman Chadha

Counterfactual fairness methods address the question: How would the prediction change if the sensitive identity attributes referenced in the text instance were different? These methods are entirely based on generating counterfactuals for…

计算与语言 · 计算机科学 2022-03-08 Mohit Wadhwa , Mohan Bhambhani , Ashvini Jindal , Uma Sawant , Ramanujam Madhavan

The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When…

信息检索 · 计算机科学 2025-11-04 Amirabbas Afzali , Amirreza Velae , Iman Ahmadi , Mohammad Aliannejadi

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus…

密码学与安全 · 计算机科学 2025-11-26 Benji Peng , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Junyu Liu , Xinyuan Song , Qian Niu

Concerns regarding fairness and bias have been raised in recent years due to the growing use of machine learning models in crucial decision-making processes, especially when it comes to delicate characteristics like gender. In order to…

机器学习 · 计算机科学 2024-08-30 Saish Shinde

Large language models (LLMs) have achieved impressive performance on various natural language generation tasks. Nonetheless, they suffer from generating negative and harmful contents that are biased against certain demographic groups (e.g.,…

机器学习 · 计算机科学 2024-06-05 Tianci Liu , Haoyu Wang , Shiyang Wang , Yu Cheng , Jing Gao

Algorithmic fairness has become an important machine learning problem, especially for mission-critical Web applications. This work presents a self-supervised model, called DualFair, that can debias sensitive attributes like gender and race…

机器学习 · 计算机科学 2023-03-16 Sungwon Han , Seungeon Lee , Fangzhao Wu , Sundong Kim , Chuhan Wu , Xiting Wang , Xing Xie , Meeyoung Cha

Language Representation Models (LRMs) trained with real-world data may capture and exacerbate undesired bias and cause unfair treatment of people in various demographic groups. Several techniques have been investigated for applying…

计算与语言 · 计算机科学 2023-11-14 Chloe Qinyu Zhu , Rickard Stureborg , Brandon Fain

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

计算与语言 · 计算机科学 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

Counterfactual explanations can be used to interpret and debug text classifiers by producing minimally altered text inputs that change a classifier's output. In this work, we evaluate five methods for generating counterfactual explanations…

计算与语言 · 计算机科学 2024-11-06 Stephen McAleese , Mark Keane

Safety for Large Language Models (LLMs) has been an ongoing research focus since their emergence and is even more relevant nowadays with the increasing capacity of those models. Currently, there are several guardrails in place for all…

计算与语言 · 计算机科学 2025-12-25 Eduard Stefan Dinuta , Iustin Sirbu , Traian Rebedea

Large Language Models (LLMs) have advanced various Natural Language Processing (NLP) tasks, such as text generation and translation, among others. However, these models often generate texts that can perpetuate biases. Existing approaches to…

计算与语言 · 计算机科学 2025-01-07 Shaina Raza , Oluwanifemi Bamgbose , Shardul Ghuge , Fatemeh Tavakol , Deepak John Reji , Syed Raza Bashir

As Large Language Models (LLMs) have risen in prominence over the past few years, there has been concern over the potential biases in LLMs inherited from the training data. Previous studies have examined how LLMs exhibit implicit bias, such…

计算与语言 · 计算机科学 2025-12-30 Lake Yin , Fan Huang

While Vision-Language Models (VLMs) have achieved remarkable performance across diverse downstream tasks, recent studies have shown that they can inherit social biases from the training data and further propagate them into downstream…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Tangzheng Lian , Guanyu Hu , Yijing Ren , Dimitrios Kollias , Oya Celiktutan

Large Language Models (LLMs) have been observed to exhibit bias in numerous ways, potentially creating or worsening outcomes for specific groups identified by protected attributes such as sex, race, sexual orientation, or age. To help…

计算与语言 · 计算机科学 2025-01-30 Dylan Bouchard , Mohit Singh Chauhan , David Skarbrevik , Viren Bajaj , Zeya Ahmad

Large Language Models (LLMs) are increasingly deployed in contact-center Quality Assurance (QA) to automate agent performance evaluation and coaching feedback. While LLMs offer unprecedented scalability and speed, their reliance on…

计算与语言 · 计算机科学 2026-02-17 Kawin Mayilvaghanan , Siddhant Gupta , Ayush Kumar