English
Related papers

Related papers: Beyond Binary Moderation: Identifying Fine-Grained…

200 papers

Generative AI systems powered by Large Language Models (LLMs) usually use content moderation to prevent harmful content spread. To evaluate the robustness of content moderation, several metamorphic testing techniques have been proposed to…

Software Engineering · Computer Science 2025-03-24 Honghao Tan , Haibo Wang , Diany Pressato , Yisen Xu , Shin Hwei Tan

Aggressive comments on social media negatively impact human life. Such offensive contents are responsible for depression and suicidal-related activities. Since online social networking is increasing day by day, the hate content is also…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Mst Shapna Akter , Hossain Shahriar , Nova Ahmed , Alfredo Cuzzocrea

Gender-neutral translation (GNT) aims to avoid expressing the gender of human referents when the source text lacks explicit cues about the gender of those referents. Evaluating GNT automatically is particularly challenging, with current…

Computation and Language · Computer Science 2025-04-17 Andrea Piergentili , Beatrice Savoldi , Matteo Negri , Luisa Bentivogli

As generative large language models (LLMs) grow more performant and prevalent, we must develop comprehensive enough tools to measure and improve their fairness. Different prompt-based datasets can be used to measure social bias across…

Detecting toxic language including sexism, harassment and abusive behaviour, remains a critical challenge, particularly in its subtle and context-dependent forms. Existing approaches largely focus on isolated message-level classification,…

This study investigates the prevalence of violent language on incels.is. It evaluates GPT models (GPT-3.5 and GPT-4) for content analysis in social sciences, focusing on the impact of varying prompts and batch sizes on coding quality for…

Social and Information Networks · Computer Science 2024-01-05 Daniel Matter , Miriam Schirmer , Nir Grinberg , Jürgen Pfeffer

Gender stereotypes in introductory programming courses often go unnoticed, yet they can negatively influence young learners' interest and learning, particularly under-represented groups such as girls. Popular tutorials on block-based…

Computers and Society · Computer Science 2025-10-14 Isabella Graßl , Benedikt Fein , Gordon Fraser

Hate speech is a harmful form of online expression, often manifesting as derogatory posts. It is a significant risk in digital environments. With the rise of Large Language Models (LLMs), there is concern about their potential to replicate…

Computation and Language · Computer Science 2025-06-10 Paloma Piot , Javier Parapar

In the current context where online platforms have been effectively weaponized in a variety of geo-political events and social issues, Internet memes make fair content moderation at scale even more difficult. Existing work on meme…

Artificial Intelligence · Computer Science 2023-04-10 Abhinav Kumar Thakur , Filip Ilievski , Hông-Ân Sandlin , Zhivar Sourati , Luca Luceri , Riccardo Tommasini , Alain Mermoud

With the increasing role of Natural Language Processing (NLP) in various applications, challenges concerning bias and stereotype perpetuation are accentuated, which often leads to hate speech and harm. Despite existing studies on sexism and…

Computation and Language · Computer Science 2024-06-19 Mae Sosto , Alberto Barrón-Cedeño

To foster collaboration and inclusivity in Open Source Software (OSS) projects, it is crucial to understand and detect patterns of toxic language that may drive contributors away, especially those from underrepresented communities. Although…

Software Engineering · Computer Science 2023-07-31 Ramtin Ehsani , Rezvaneh Rezapour , Preetha Chatterjee

Social media platforms utilize Machine Learning (ML) and Artificial Intelligence (AI) powered recommendation algorithms to maximize user engagement, which can result in inadvertent exposure to harmful content. Current moderation efforts,…

Computation and Language · Computer Science 2025-05-30 Rajvardhan Oak , Muhammad Haroon , Claire Jo , Magdalena Wojcieszak , Anshuman Chhabra

The rapid integration of Large Language Models (LLMs) into various domains raises concerns about societal inequalities and information bias. This study examines biases in LLMs related to background, gender, and age, with a focus on their…

Computation and Language · Computer Science 2025-09-15 Willem Huijzer , Jieying Chen

The exponential growth of social media has profoundly transformed how information is created, disseminated, and absorbed, exceeding any precedent in the digital age. Regrettably, this explosion has also spawned a significant increase in the…

Computation and Language · Computer Science 2025-03-03 Hongzhan Lin , Ziyang Luo , Bo Wang , Ruichao Yang , Jing Ma

Online marketplaces, while revolutionizing global commerce, have inadvertently facilitated the proliferation of illicit activities, including drug trafficking, counterfeit sales, and cybercrimes. Traditional content moderation methods such…

Computation and Language · Computer Science 2026-03-06 Quoc Khoa Tran , Thanh Thi Nguyen , Campbell Wilson

Large language models (LLMs) are increasingly used to assess moral or ethical statements, yet their judgments may reflect social and linguistic biases. This work presents a controlled, sentence-level study of how grammatical person, number,…

Computation and Language · Computer Science 2026-03-17 Gustavo Lúcius Fernandes , Jeiverson C. V. M. Santos , Pedro O. S. Vaz-de-Melo

Large language models (LLMs) offer new opportunities for scalable analysis of online discourse. Yet their use in multilingual social science research remains constrained by model size, cost and linguistic bias. We develop a lightweight,…

Computation and Language · Computer Science 2025-12-30 Andrea Nasuto , Stefano Maria Iacus , Francisco Rowe , Devika Jain

Recent studies have revealed that the widely-used Pre-trained Language Models (PLMs) propagate societal biases from the large unmoderated pre-training corpora. Existing solutions require debiasing training processes and datasets for…

Computation and Language · Computer Science 2023-07-25 Somayeh Ghanbarzadeh , Yan Huang , Hamid Palangi , Radames Cruz Moreno , Hamed Khanpour

The widespread popularity of social media has led to an increase in hateful, abusive, and sexist language, motivating methods for the automatic detection of such phenomena. The goal of the SemEval shared task \textit{Towards Explainable…

Computation and Language · Computer Science 2023-06-07 Janis Goldzycher

Large Language Models (LLMs) are increasingly deployed to curate and rank human-created content, yet the nature and structure of their biases in these tasks remains poorly understood: which biases are robust across providers and platforms,…

Social and Information Networks · Computer Science 2026-04-20 Nicolò Pagan , Christopher Barrie , Chris Andrew Bail , Petter Törnberg