English
Related papers

Related papers: Analyzing Bias in False Refusal Behavior of Large …

200 papers

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

Computation and Language · Computer Science 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

Recently efforts have been made by social media platforms as well as researchers to detect hateful or toxic language using large language models. However, none of these works aim to use explanation, additional context and victim community…

Computation and Language · Computer Science 2023-10-31 Sarthak Roy , Ashish Harshavardhan , Animesh Mukherjee , Punyajoy Saha

Detoxifying offensive language while preserving the speaker's original intent is a challenging yet critical goal for improving the quality of online interactions. Although large language models (LLMs) show promise in rewriting toxic…

Computation and Language · Computer Science 2025-05-22 Xintong Wang , Yixiao Liu , Jingheng Pan , Liang Ding , Longyue Wang , Chris Biemann

Commercial Large Language Models (LLMs) have recently incorporated memory features to deliver personalised responses. This memory retains details such as user demographics and individual characteristics, allowing LLMs to adjust their…

Computation and Language · Computer Science 2025-05-06 Paloma Piot , Patricia Martín-Rodilla , Javier Parapar

Large language models (LLMs) are increasingly integrated into our daily lives and personalized. However, LLM personalization might also increase unintended side effects. Recent work suggests that persona prompting can lead models to falsely…

Computation and Language · Computer Science 2025-09-11 Flor Miriam Plaza-del-Arco , Paul Röttger , Nino Scherrer , Emanuele Borgonovo , Elmar Plischke , Dirk Hovy

Detecting hate speech and offensive language is essential for maintaining a safe and respectful digital environment. This study examines the limitations of state-of-the-art large language models (LLMs) in identifying offensive content…

Computation and Language · Computer Science 2024-06-19 Yunze Xiao , Yujia Hu , Kenny Tsu Wei Choo , Roy Ka-wei Lee

Existing approaches for Large language model (LLM) detoxification generally rely on training on large-scale non-toxic or human-annotated preference data, designing prompts to instruct the LLM to generate safe content, or modifying the model…

Computation and Language · Computer Science 2025-06-03 Yuanhe Tian , Mingjie Deng , Guoqing Jin , Yan Song

Large Language Models (LLMs) have been shown to contain biases in the process of integrating conflicting information when answering questions. Here we ask whether such biases also exist with respect to which language is used for each…

Computation and Language · Computer Science 2026-04-09 Robert Östling , Murathan Kurfalı

Large Language Models (LLMs) offer a lucrative promise for scalable content moderation, including hate speech detection. However, they are also known to be brittle and biased against marginalised communities and dialects. This requires…

Computation and Language · Computer Science 2025-10-14 Ananya Malik , Kartik Sharma , Shaily Bhatt , Lynnette Hui Xian Ng

Large language models (LLMs) have become integral tool for users from various backgrounds. LLMs, trained on vast corpora, reflect the linguistic and cultural nuances embedded in their pre-training data. However, the values and perspectives…

Computation and Language · Computer Science 2025-07-17 Songyuan Liu , Ziyang Zhang , Runze Yan , Wei Wu , Carl Yang , Jiaying Lu

Large Language Models (LLMs) have raised increasing concerns about their misuse in generating hate speech. Among all the efforts to address this issue, hate speech detectors play a crucial role. However, the effectiveness of different…

Cryptography and Security · Computer Science 2025-01-29 Xinyue Shen , Yixin Wu , Yiting Qu , Michael Backes , Savvas Zannettou , Yang Zhang

Safety alignment in large language models (LLMs), particularly for cybersecurity tasks, primarily focuses on preventing misuse. While this approach reduces direct harm, it obscures a complementary failure mode: denial of assistance to…

Cryptography and Security · Computer Science 2026-03-12 David Campbell , Neil Kale , Udari Madhushani Sehwag , Bert Herring , Nick Price , Dan Borges , Alex Levinson , Christina Q Knight

This study reveals a previously unexplored vulnerability in the safety alignment of Large Language Models (LLMs). Existing aligned LLMs predominantly respond to unsafe queries with refusals, which often begin with a fixed set of prefixes…

Cryptography and Security · Computer Science 2026-01-28 Yangyang Guo , Ziwei Xu , Si Liu , Zhiming Zheng , Mohan Kankanhalli

The proliferation of large language models (LLMs) has sparked widespread and general interest due to their strong language generation capabilities, offering great potential for both industry and research. While previous research delved into…

Artificial Intelligence · Computer Science 2024-07-09 Lukas Struppek , Minh Hieu Le , Dominik Hintersdorf , Kristian Kersting

Language models (LMs) can reproduce (or amplify) toxic language seen during training, which poses a risk to their practical application. In this paper, we conduct extensive experiments to study this phenomenon. We analyze the impact of…

Computation and Language · Computer Science 2022-03-08 Canwen Xu , Zexue He , Zhankui He , Julian McAuley

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of safety is imperative for deploying LMs in the real world; to…

Automatic detection of hate and abusive language is essential to combat its online spread. Moreover, recognising and explaining hate speech serves to educate people about its negative effects. However, most current detection models operate…

Computation and Language · Computer Science 2025-05-06 Paloma Piot , Javier Parapar

Hate speech has become pervasive in today's digital age. Although there has been considerable research to detect hate speech or generate counter speech to combat hateful views, these approaches still cannot completely eliminate the…

Computation and Language · Computer Science 2023-10-24 Vibhor Agarwal , Yu Chen , Nishanth Sastry

Although large language models (LLMs) have demonstrated their effectiveness in a wide range of applications, they have also been observed to perpetuate unwanted biases present in the training data, potentially leading to harm for…

Computation and Language · Computer Science 2026-03-09 Schrasing Tong , Eliott Zemour , Jessica Lu , Rawisara Lohanimit , Lalana Kagal

Large language models (LLMs) are transforming research on machine learning while galvanizing public debates. Understanding not only when these models work well and succeed but also why they fail and misbehave is of great societal relevance.…

Computation and Language · Computer Science 2024-10-16 Julian Coda-Forno , Kristin Witte , Akshay K. Jagadish , Marcel Binz , Zeynep Akata , Eric Schulz