English
Related papers

Related papers: Evaluating Large Language Models for Detecting Ant…

200 papers

Online social media platforms are central to everyday communication and information seeking. While these platforms serve positive purposes, they also provide fertile ground for the spread of hate speech, offensive language, and bullying…

Computation and Language · Computer Science 2025-10-03 Md Arid Hasan , Firoj Alam , Md Fahad Hossain , Usman Naseem , Syed Ishtiaque Ahmed

Nowadays, billions of people engage in communication and express their opinions on the internet daily. Unfortunately, not all of these expressions are friendly or compliant, making content moderation an indispensable task. A common approach…

Machine Learning · Computer Science 2024-03-08 Huan Ma , Changqing Zhang , Huazhu Fu , Peilin Zhao , Bingzhe Wu

Large Language Models (LLMs) offer a lucrative promise for scalable content moderation, including hate speech detection. However, they are also known to be brittle and biased against marginalised communities and dialects. This requires…

Computation and Language · Computer Science 2025-10-14 Ananya Malik , Kartik Sharma , Shaily Bhatt , Lynnette Hui Xian Ng

Automated counter-narratives (CN) offer a promising strategy for mitigating online hate speech, yet concerns about their affective tone, accessibility, and ethical risks remain. We propose a framework for evaluating Large Language Model…

Computation and Language · Computer Science 2025-06-05 Mikel K. Ngueajio , Flor Miriam Plaza-del-Arco , Yi-Ling Chung , Danda B. Rawat , Amanda Cercas Curry

Data annotation, the practice of assigning descriptive labels to raw data, is pivotal in optimizing the performance of machine learning models. However, it is a resource-intensive process susceptible to biases introduced by annotators. The…

This paper presents a competitive approach to multilingual subjectivity detection using large language models (LLMs) with few-shot prompting. We participated in Task 1: Subjectivity of the CheckThat! 2025 evaluation campaign. We show that…

Computation and Language · Computer Science 2025-07-11 Akram Elbouanani , Evan Dufraisse , Aboubacar Tuo , Adrian Popescu

The proliferation of hate speech on Chinese social media poses urgent societal risks, yet traditional systems struggle to decode context-dependent rhetorical strategies and evolving slang. To bridge this gap, we propose a novel three-stage…

Computation and Language · Computer Science 2025-12-11 Binglin Wu , Jiaxiu Zou , Xianneng Li

High-quality textual training data is essential for the success of multimodal data processing tasks, yet outputs from image captioning models like BLIP and GIT often contain errors and anomalies that are difficult to rectify using…

Computation and Language · Computer Science 2025-02-25 Elyas Meguellati , Nardiena Pratama , Shazia Sadiq , Gianluca Demartini

Machine learning methods are increasingly applied to analyze health-related public discourse based on large-scale data, but questions remain regarding their ability to accurately detect different types of health sentiments. Especially,…

Computation and Language · Computer Science 2025-07-08 Soojong Kim , Kwanho Kim , Hye Min Kim

Recent research leverages large language models (LLMs) for early mental health detection, such as depression, often optimized with machine-generated data. However, their detection may be subject to unknown weaknesses. Meanwhile, quality…

Computation and Language · Computer Science 2025-05-26 Zongru Shao , Xin Wang , Zhanyang Liu , Chenhan Wang , K. P. Subbalakshmi

Generative AI systems powered by Large Language Models (LLMs) usually use content moderation to prevent harmful content spread. To evaluate the robustness of content moderation, several metamorphic testing techniques have been proposed to…

Software Engineering · Computer Science 2025-03-24 Honghao Tan , Haibo Wang , Diany Pressato , Yisen Xu , Shin Hwei Tan

Large Language Models (LLMs) represent a major step toward artificial general intelligence, significantly advancing our ability to interact with technology. While LLMs perform well on Natural Language Processing tasks -- such as…

Computation and Language · Computer Science 2025-05-15 Brandon Smith , Mohamed Reda Bouadjenek , Tahsin Alamgir Kheya , Phillip Dawson , Sunil Aryal

As large language models (LLMs) become increasingly embedded in products used by millions, their outputs may influence individual beliefs and, cumulatively, shape public opinion. If the behavior of LLMs can be intentionally steered toward…

Computation and Language · Computer Science 2025-09-17 Paul Kröger , Emilio Barkett

The rise of social media and online communication platforms has led to the spread of Arabic textual posts and memes as a key form of digital expression. While these contents can be humorous and informative, they are also increasingly being…

Computation and Language · Computer Science 2025-08-25 Nouar AlDahoul , Yasir Zaki

Propaganda detection on social media remains challenging due to task complexity and limited high-quality labeled data. This paper introduces a novel framework that combines human expertise with Large Language Model (LLM) assistance to…

Computation and Language · Computer Science 2025-07-25 Ariana Sahitaj , Premtim Sahitaj , Veronika Solopova , Jiaao Li , Sebastian Möller , Vera Schmitt

In this study, we explore the use of Large Language Models (LLMs) to counteract hate speech. We conducted the first real-life A/B test assessing the effectiveness of LLM-generated counter-speech. During the experiment, we posted 753…

Computers and Society · Computer Science 2025-06-03 Jakub Podolak , Szymon Łukasik , Paweł Balawender , Jan Ossowski , Jan Piotrowski , Katarzyna Bąkowicz , Piotr Sankowski

Large Language Models, such as Generative Pre-trained Transformer 3 (aka. GPT-3), have been developed to understand language through the analysis of extensive text data, allowing them to identify patterns and connections between words.…

Computation and Language · Computer Science 2023-10-03 Baphumelele Masikisiki , Vukosi Marivate , Yvette Hlope

We created a fine-grained AI system for the detection of antisemitism. This Explainable AI will identify English and German anti-Semitic expressions of dehumanization, verbal aggression and conspiracies in online social media messages…

Computation and Language · Computer Science 2024-05-31 Tom De Smedt

The large scale usage of social media, combined with its significant impact, has made it increasingly important to understand it. In particular, identifying user communities, can be helpful for many downstream tasks. However, particularly…

Computation and Language · Computer Science 2024-06-04 Nikhil Mehta , Dan Goldwasser

The proliferation of hateful content in online videos poses severe threats to individual well-being and societal harmony. However, existing solutions for video hate detection either rely heavily on large-scale human annotations or lack…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yueming Sun , Long Yang , Jianbo Jiao , Zeyu Fu