中文
相关论文

相关论文: Self-Debiasing Large Language Models: Zero-Shot Re…

200 篇论文

Large language models (LLMs) exhibit social biases that reinforce harmful stereotypes, limiting their safe deployment. Most existing debiasing methods adopt a suppressive paradigm by modifying parameters, prompts, or neurons associated with…

人工智能 · 计算机科学 2026-01-30 Jinhao Pan , Chahat Raj , Anjishnu Mukherjee , Sina Mansouri , Bowen Wei , Shloka Yada , Ziwei Zhu

Self-Correction based on feedback improves the output quality of Large Language Models (LLMs). Moreover, as Self-Correction functions like the slow and conscious System-2 thinking from cognitive psychology's perspective, it can potentially…

计算与语言 · 计算机科学 2025-03-11 Panatchakorn Anantaprayoon , Masahiro Kaneko , Naoaki Okazaki

Large language models (LLMs), despite their remarkable capabilities, are susceptible to generating biased and discriminatory responses. As LLMs increasingly influence high-stakes decision-making (e.g., hiring and healthcare), mitigating…

计算与语言 · 计算机科学 2025-03-04 Jingling Li , Zeyu Tang , Xiaoyu Liu , Peter Spirtes , Kun Zhang , Liu Leqi , Yang Liu

When trained on large, unfiltered crawls from the internet, language models pick up and reproduce all kinds of undesirable biases that can be found in the data: they often generate racist, sexist, violent or otherwise toxic language. As…

计算与语言 · 计算机科学 2021-09-10 Timo Schick , Sahana Udupa , Hinrich Schütze

Large Language Models (LLMs) are capable of successfully performing many language processing tasks zero-shot (without training data). If zero-shot LLMs can also reliably classify and explain social phenomena like persuasiveness and…

计算与语言 · 计算机科学 2024-02-27 Caleb Ziems , William Held , Omar Shaikh , Jiaao Chen , Zhehao Zhang , Diyi Yang

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This…

机器学习 · 计算机科学 2025-11-19 Fatima Kazi , Alex Young , Yash Inani , Setareh Rafatirad

Recent work has shown pre-trained language models capture social biases from the large amounts of text they are trained on. This has attracted attention to developing techniques that mitigate such biases. In this work, we perform an…

计算与语言 · 计算机科学 2022-04-05 Nicholas Meade , Elinor Poole-Dayan , Siva Reddy

Large Language Models (LLMs) have demonstrated impressive zero-shot capabilities and versatility in NLP tasks, however they sometimes fail to maintain crucial invariances for specific tasks. One example is permutation sensitivity, where…

计算与语言 · 计算机科学 2024-03-21 Adian Liusie , Yassir Fathullah , Mark J. F. Gales

Large language models(LLM) are pre-trained on extensive corpora to learn facts and human cognition which contain human preferences. However, this process can inadvertently lead to these models acquiring biases and stereotypes prevalent in…

计算与语言 · 计算机科学 2024-03-22 Yuchen Cai , Ding Cao , Rongxi Guo , Yaqin Wen , Guiquan Liu , Enhong Chen

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

计算与语言 · 计算机科学 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

Large language models (LLMs) offer significant potential as tools to support an expanding range of decision-making tasks. Given their training on human (created) data, LLMs have been shown to inherit societal biases against protected…

人工智能 · 计算机科学 2024-10-07 Jessica Echterhoff , Yao Liu , Abeer Alessa , Julian McAuley , Zexue He

Advancements in Large Language Models (LLMs) have increased the performance of different natural language understanding as well as generation tasks. Although LLMs have breached the state-of-the-art performance in various tasks, they often…

Large language models (LLMs) have garnered significant attention for their remarkable performance in a continuously expanding set of natural language processing tasks. However, these models have been shown to harbor inherent societal…

计算与语言 · 计算机科学 2023-10-16 Abel Salinas , Louis Penafiel , Robert McCormack , Fred Morstatter

Denoising language models (DLMs) have been proposed as a powerful alternative to traditional language models (LMs) for automatic speech recognition (ASR), motivated by their ability to use bidirectional context and adapt to a specific ASR…

神经与进化计算 · 计算机科学 2025-12-16 Dorian Koch , Albert Zeyer , Nick Rossenbach , Ralf Schlüter , Hermann Ney

Large Language models (LLMs), such as ChatGPT, have gained popularity in recent years with the advancement of Natural Language Processing (NLP), with use cases spanning many disciplines and daily lives as well. LLMs inherit explicit and…

计算与语言 · 计算机科学 2025-12-01 Fatima Kazi

Large Language Models (LLMs) have advanced various Natural Language Processing (NLP) tasks, such as text generation and translation, among others. However, these models often generate texts that can perpetuate biases. Existing approaches to…

计算与语言 · 计算机科学 2025-01-07 Shaina Raza , Oluwanifemi Bamgbose , Shardul Ghuge , Fatemeh Tavakol , Deepak John Reji , Syed Raza Bashir

Large Language Models (LLMs) have excelled at language understanding and generating human-level text. However, even with supervised training and human alignment, these LLMs are susceptible to adversarial attacks where malicious users can…

Large Language models (LLMs), while powerful, exhibit harmful social biases. Debiasing is often challenging due to computational costs, data constraints, and potential degradation of multi-task language capabilities. This work introduces a…

计算与语言 · 计算机科学 2024-09-17 Pengrui Han , Rafal Kocielnik , Adhithya Saravanan , Roy Jiang , Or Sharir , Anima Anandkumar

Large Language Models inherit stereotypes from their pretraining data, leading to biased behavior toward certain social groups in many Natural Language Processing tasks, such as hateful speech detection or sentiment analysis. Surprisingly,…

计算与语言 · 计算机科学 2025-10-24 Anthony Dubreuil , Antoine Gourru , Christine Largeron , Amine Trabelsi

Large Language Models (LLMs) have fundamentally transformed the field of natural language processing; however, their vulnerability to biases presents a notable obstacle that threatens both fairness and trust. This review offers an extensive…

计算与语言 · 计算机科学 2025-09-19 Kiana Kiashemshaki , Mohammad Jalili Torkamani , Negin Mahmoudi , Meysam Shirdel Bilehsavar