English
Related papers

Related papers: Analyzing Bias in False Refusal Behavior of Large …

200 papers

Multilingual LLMs often have knowledge disparities across languages, with larger gaps in under-resourced languages. Teaching LLMs to abstain in the face of knowledge gaps is thus a promising strategy to mitigate hallucinations in…

Large Language Models (LLMs) have transformed natural language processing and hold growing promise for advancing science, healthcare, and decision-making. Yet their training paradigms remain dominated by affirmation-based inference, akin to…

Artificial Intelligence · Computer Science 2025-12-05 Peter B. Walker , Hannah Davidson , Aiden Foster , Matthew Lienert , Thomas Pardue , Dale Russell

Pre-trained language models (LMs) are shown to easily generate toxic language. In this work, we systematically explore domain-adaptive training to reduce the toxicity of language models. We conduct this study on three dimensions: training…

Computation and Language · Computer Science 2022-10-25 Boxin Wang , Wei Ping , Chaowei Xiao , Peng Xu , Mostofa Patwary , Mohammad Shoeybi , Bo Li , Anima Anandkumar , Bryan Catanzaro

Large Language Models (LLMs) commonly rely on explicit refusal prefixes for safety, making them vulnerable to prefix injection attacks. We introduce HumorReject, a novel data-driven approach that reimagines LLM safety by decoupling it from…

Machine Learning · Computer Science 2025-11-11 Zihui Wu , Haichang Gao , Jiacheng Luo , Zhaoxiang Liu

The deployment of Large Language Models (LLMs) in diverse applications necessitates an assurance of safety without compromising the contextual integrity of the generated content. Traditional approaches, including safety-specific fine-tuning…

Computation and Language · Computer Science 2024-07-01 Shaina Raza , Ananya Raval , Veronica Chatrath

Large language models (LLMs) inherit biases from their training data and alignment processes, influencing their responses in subtle ways. While many studies have examined these biases, little work has explored their robustness during…

Computation and Language · Computer Science 2024-11-06 Virgile Rennard , Christos Xypolopoulos , Michalis Vazirgiannis

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

Computation and Language · Computer Science 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

Large Language Models (LLMs) have revolutionized natural language processing, but their susceptibility to biases poses significant challenges. This comprehensive review examines the landscape of bias in LLMs, from its origins to current…

Computation and Language · Computer Science 2026-05-04 Yufei Guo , Muzhe Guo , Juntao Su , Zhou Yang , Mengqiu Zhu , Hongfei Li , Mengyang Qiu , Shuo Shuo Liu

Large Language Models (LLMs) can generate content that is as persuasive as human-written text and appear capable of selectively producing deceptive outputs. These capabilities raise concerns about potential misuse and unintended…

Computation and Language · Computer Science 2024-12-24 Cameron R. Jones , Benjamin K. Bergen

While the capabilities of Large Language Models (LLMs) have been studied in both Simplified and Traditional Chinese, it is yet unclear whether LLMs exhibit differential performance when prompted in these two variants of written Chinese.…

Computation and Language · Computer Science 2025-05-29 Hanjia Lyu , Jiebo Luo , Jian Kang , Allison Koenecke

Although large language models (LLMs) have apparently acquired a certain level of grammatical knowledge and the ability to make generalizations, they fail to interpret negation, a crucial step in Natural Language Processing. We try to…

Computation and Language · Computer Science 2023-10-25 Iker García-Ferrero , Begoña Altuna , Javier Álvez , Itziar Gonzalez-Dios , German Rigau

Given the black-box nature and complexity of large transformer language models (LM), concerns about generalizability and robustness present ethical implications for domains such as hate speech (HS) detection. Using the content rich Social…

Computation and Language · Computer Science 2024-11-12 Jennifer L. Chen , Faisal Ladhak , Daniel Li , Noémie Elhadad

Large Language Models (LLMs) are trained on large corpora written by humans and demonstrate high performance on various tasks. However, as humans are susceptible to cognitive biases, which can result in irrational judgments, LLMs can also…

Computation and Language · Computer Science 2024-12-03 Yasuaki Sumita , Koh Takeuchi , Hisashi Kashima

As Large Language Models (LLMs) become widely used to model and simulate human behavior, understanding their biases becomes critical. We developed an experimental framework using Big Five personality surveys and uncovered a previously…

Artificial Intelligence · Computer Science 2024-11-25 Aadesh Salecha , Molly E. Ireland , Shashanka Subrahmanya , João Sedoc , Lyle H. Ungar , Johannes C. Eichstaedt

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Phillip Howard , Anahita Bhiwandiwalla , Kathleen C. Fraser , Svetlana Kiritchenko

Multilingual Large Language Models (LLMs) offer powerful capabilities for cross-lingual fact-checking. However, these models often exhibit language bias, performing disproportionately better on high-resource languages such as English than…

Computation and Language · Computer Science 2025-09-30 Ivan Vykopal , Antonia Karamolegkou , Jaroslav Kopčan , Qiwei Peng , Tomáš Javůrek , Michal Gregor , Marián Šimko

We introduce a method to reduce refusal rates of large language models (LLMs) on sensitive content without modifying model weights or prompts. Motivated by the observation that refusals in certain models were often preceded by the specific…

Computation and Language · Computer Science 2025-06-02 Harvey Dam , Jonas Knochelmann , Vinu Joseph , Ganesh Gopalakrishnan

Generative large language models (LLMs) have been shown to exhibit harmful biases and stereotypes. While safety fine-tuning typically takes place in English, if at all, these models are being used by speakers of many different languages.…

Computation and Language · Computer Science 2024-07-18 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

Confirmation bias, the tendency to seek evidence that supports rather than challenges one's belief, hinders one's reasoning ability. We examine whether large language models (LLMs) exhibit confirmation bias by adapting the rule-discovery…

Computation and Language · Computer Science 2026-04-06 Ayush Rajesh Jhaveri , Anthony GX-Chen , Ilia Sucholutsky , Eunsol Choi

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

Computation and Language · Computer Science 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He