English
Related papers

Related papers: Decoding Hate: Exploring Language Models' Reaction…

200 papers

Large language models (LLMs) have achieved impressive performance across natural language tasks and are increasingly deployed in real-world applications. Despite extensive safety alignment efforts, recent studies show that such alignment is…

Artificial Intelligence · Computer Science 2026-02-02 Yinzhi Zhao , Ming Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yifei Zhang

In this work, we present an extensive study on the use of pre-trained language models for the task of automatic Counter Narrative (CN) generation to fight online hate speech in English. We first present a comparative study to determine…

Computation and Language · Computer Science 2022-04-05 Serra Sinem Tekiroglu , Helena Bonaldi , Margherita Fanton , Marco Guerini

The proliferation of hate speech has inflicted significant societal harm, with its intensity and directionality closely tied to specific targets and arguments. In recent years, numerous machine learning-based methods have been developed to…

Computation and Language · Computer Science 2025-07-16 Zewen Bai , Liang Yang , Shengdi Yin , Yuanyuan Sun , Hongfei Lin

Online hate speech is an important issue that breaks the cohesiveness of online social communities and even raises public safety concerns in our societies. Motivated by this rising issue, researchers have developed many traditional machine…

Computation and Language · Computer Science 2021-03-23 Rui Cao , Roy Ka-Wei Lee , Tuan-Anh Hoang

Large Multimodal Models (LMMs) have achieved great success recently, demonstrating a strong capability to understand multimodal information and to interact with human users. Despite the progress made, the challenge of detecting high-risk…

Computation and Language · Computer Science 2024-06-26 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

This paper conducts a user study to assess whether three machine learning (ML) interpretability layouts can influence participants' views when evaluating sentences containing hate speech, focusing on the "Misogyny" and "Racism" classes.…

Human-Computer Interaction · Computer Science 2025-05-13 Thiago Freitas dos Santos , Nardine Osman , Marco Schorlemmer

We investigate the efficacy of Large Language Models (LLMs) in detecting implicit and explicit hate speech, examining how models with minimal safety alignment (uncensored) compare with more heavily aligned (censored) counterparts in a…

Computation and Language · Computer Science 2026-05-05 Sanjeeevan Selvaganapathy , Mehwish Nasim

The abstract outlines the problem of toxic comments on social media platforms, where individuals use disrespectful, abusive, and unreasonable language that can drive users away from discussions. This behavior is referred to as anti-social…

Machine Learning · Computer Science 2023-04-17 K. Poojitha , A. Sai Charish , M. Arun Kuamr Reddy , S. Ayyasamy

This paper aims to help structure the risk landscape associated with large-scale Language Models (LMs). In order to foster advances in responsible innovation, an in-depth understanding of the potential risks posed by these models is needed.…

Large language models (LLMs) often inherit biases from vast amounts of training corpora. Traditional debiasing methods, while effective to some extent, do not completely eliminate memorized biases and toxicity in LLMs. In this paper, we…

Computation and Language · Computer Science 2024-07-25 Huimin Lu , Masaru Isonuma , Junichiro Mori , Ichiro Sakata

Hate speech has become one of the most significant issues in modern society, having implications in both the online and the offline world. Due to this, hate speech research has recently gained a lot of traction. However, most of the work…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Mithun Das , Rohit Raj , Punyajoy Saha , Binny Mathew , Manish Gupta , Animesh Mukherjee

With the multiplication of social media platforms, which offer anonymity, easy access and online community formation, and online debate, the issue of hate speech detection and tracking becomes a growing challenge to society, individual,…

Computation and Language · Computer Science 2021-06-03 Md Saroar Jahan , Mourad Oussalah

As large language models (LLMs) become an important way of information access, there have been increasing concerns that LLMs may intensify the spread of unethical content, including implicit bias that hurts certain populations without…

Computation and Language · Computer Science 2025-07-14 Yuchen Wen , Keping Bi , Wei Chen , Jiafeng Guo , Xueqi Cheng

The rise of Large Language Models (LLMs) has revolutionized our comprehension of intelligence bringing us closer to Artificial Intelligence. Since their introduction, researchers have actively explored the applications of LLMs across…

Cryptography and Security · Computer Science 2024-02-05 Farzad Nourmohammadzadeh Motlagh , Mehrdad Hajizadeh , Mehryar Majd , Pejman Najafi , Feng Cheng , Christoph Meinel

We explore how large language models (LLMs) assess offensiveness in political discourse when prompted to adopt specific political and cultural perspectives. Using a multilingual subset of the MD-Agreement dataset centered on tweets from the…

Computation and Language · Computer Science 2025-10-06 Dzmitry Pihulski , Jan Kocoń

Large language models (LLMs) are popular for high-quality text generation but can produce harmful content, even when aligned with human values through reinforcement learning. Adversarial prompts can bypass their safety measures. We propose…

Computation and Language · Computer Science 2024-05-03 Mansi Phute , Alec Helbling , Matthew Hull , ShengYun Peng , Sebastian Szyller , Cory Cornelius , Duen Horng Chau

Language Models (LMs) often cannot be deployed because of their potential to harm users in hard-to-predict ways. Prior work identifies harmful behaviors before deployment by using human annotators to hand-write test cases. However, human…

Computation and Language · Computer Science 2022-02-08 Ethan Perez , Saffron Huang , Francis Song , Trevor Cai , Roman Ring , John Aslanides , Amelia Glaese , Nat McAleese , Geoffrey Irving

The widespread use of social media platforms like Twitter and Facebook has enabled people of all ages to share their thoughts and experiences, leading to an immense accumulation of user-generated content. However, alongside the benefits,…

Computation and Language · Computer Science 2025-03-26 Aniket Deroy , Subhankar Maity

Large language models (LLMs) offer new opportunities for scalable analysis of online discourse. Yet their use in multilingual social science research remains constrained by model size, cost and linguistic bias. We develop a lightweight,…

Computation and Language · Computer Science 2025-12-30 Andrea Nasuto , Stefano Maria Iacus , Francisco Rowe , Devika Jain

Large Language Models (LLMs) are increasingly used as automated annotators to scale dataset creation, yet their reliability as unbiased annotators--especially for low-resource and identity-sensitive settings--remains poorly understood. In…

Computation and Language · Computer Science 2026-03-03 Md. Najib Hasan , Touseef Hasan , Souvika Sarkar