English
Related papers

Related papers: Who Decides What Is Harmful? Content Moderation Po…

200 papers

Though safety alignment has been applied to most large language models (LLMs), LLM service providers generally deploy a subsequent moderation as the external safety guardrail in real-world products. Existing moderators mainly practice a…

Computation and Language · Computer Science 2025-09-23 Yang Li , Qiang Sheng , Yehan Yang , Xueyao Zhang , Juan Cao

As Large Language Models (LLMs) transition from static tools to autonomous agents, traditional evaluation benchmarks that measure performance on downstream tasks are becoming insufficient. These methods fail to capture the emergent social…

Artificial Intelligence · Computer Science 2025-10-03 Zarreen Reza

Social media platforms utilize Machine Learning (ML) and Artificial Intelligence (AI) powered recommendation algorithms to maximize user engagement, which can result in inadvertent exposure to harmful content. Current moderation efforts,…

Computation and Language · Computer Science 2025-05-30 Rajvardhan Oak , Muhammad Haroon , Claire Jo , Magdalena Wojcieszak , Anshuman Chhabra

Centralized content moderation paradigm both falls short and over-reaches: 1) it fails to account for the subjective nature of harm, and 2) it acts with blunt suppression in response to content deemed harmful, even when such content can be…

Human-Computer Interaction · Computer Science 2026-02-11 Rayhan Rashed , Farnaz Jahanbakhsh

As AI systems become more integrated into daily life, the need for safer and more reliable moderation has never been greater. Large Language Models (LLMs) have demonstrated remarkable capabilities, surpassing earlier models in complexity…

Artificial Intelligence · Computer Science 2026-01-13 Naseem Machlovi , Maryam Saleki , Innocent Ababio , Ruhul Amin

This study examines social media users' preferences for the use of platform-wide moderation in comparison to user-controlled, personalized moderation tools to regulate three categories of norm-violating content - hate speech, sexually…

Human-Computer Interaction · Computer Science 2023-02-08 Shagun Jhaver , Amy Zhang

Recently, there has been an emergence of employing LLM-powered agents as believable human proxies, based on their remarkable decision-making capability. However, existing studies mainly focus on simulating human dialogue. Human non-verbal…

Information Retrieval · Computer Science 2023-10-16 Junjie Zhang , Yupeng Hou , Ruobing Xie , Wenqi Sun , Julian McAuley , Wayne Xin Zhao , Leyu Lin , Ji-Rong Wen

Sensitive information detection is crucial in content moderation to maintain safe online communities. Assisting in this traditionally manual process could relieve human moderators from overwhelming and tedious tasks, allowing them to focus…

Our study presents a multifaceted approach to enhancing user interaction and content relevance in social media platforms through a federated learning framework. We introduce personalized LLM Federated Learning and Context-based Social Media…

Machine Learning · Computer Science 2025-11-25 Sai Puppala , Ismail Hossain , Md Jahangir Alam , Sajedul Talukder

Moderating user-generated content on online platforms is crucial for balancing user safety and freedom of speech. Particularly in the United States, platforms are not subject to legal constraints prescribing permissible content. Each…

Large language models (LLMs) are increasingly deployed in multi-agent systems where agents communicate in natural language to solve tasks jointly. A key capability in such systems is consensus formation, where agents iteratively exchange…

Multiagent Systems · Computer Science 2026-05-12 Xiaolin Sun , Zixuan Liu , Yibin Hu , Zizhan Zheng

Students benefit from math problems contextualized to their interests. Large language models (LLMs) offer promise for efficient personalization at scale. However, LLM-generated personalized problems may often have problems such as…

Computers and Society · Computer Science 2026-04-08 Fareya Ikram , Nischal Ashok Kumar , Junyang Lu , Hunter McNichols , Candace Walkington , Neil Heffernan , Andrew S. Lan

When LLM-based multi-agent systems disagree, current practice treats this as noise to be resolved through consensus. We propose it can be signal. We focus on hate speech moderation, a domain where judgments depend on cultural context and…

Multiagent Systems · Computer Science 2026-04-07 Michał Wawer , Jarosław A. Chudziak

Millions of people rely on search functionality to find and explore content on entertainment platforms. Modern search systems use a combination of candidate generation and ranking approaches, with advanced methods leveraging deep learning…

Information Retrieval · Computer Science 2025-05-26 Adeep Hande , Kishorekumar Sundararajan , Sardar Hamidian , Ferhan Ture

Autonomous network management in Open Radio Access Networks requires intelligent decision making across conflicting objectives, yet existing LLM based multi agent systems employ homogeneous strategies and lack systematic predeployment…

Networking and Internet Architecture · Computer Science 2026-04-14 Zeinab Nezami , Syed Ali Raza Zaidi , Maryam Hafeez , Louis Powell , Vara Prasad Talari , Mallik Tatipamula

User profile embedded in the prompt template of personalized recommendation agents play a crucial role in shaping their decision-making process. High-quality user profiles are essential for aligning agent behavior with real user interests.…

Information Retrieval · Computer Science 2025-05-27 Yunxiao Shi , Wujiang Xu , Zeqi Zhang , Xing Zi , Qiang Wu , Min Xu

Most users agree to online privacy policies without reading or understanding them, even though these documents govern how personal data is collected, shared, and monetized. Privacy policies are typically long, legally complex, and difficult…

Cryptography and Security · Computer Science 2026-01-13 Sriharshini Kalvakuntla , Luoxi Tang , Yuqiao Meng , Zhaohan Xi

Growing evidence shows that proactive content moderation supported by AI can help improve online discourse. However, we know little about designing these systems, how design impacts efficacy and user experience, and how people perceive…

Human-Computer Interaction · Computer Science 2024-01-22 Mark Warner , Angelika Strohmayer , Matthew Higgs , Husnain Rafiq , Liying Yang , Lynne Coventry

Social media platforms mediate how billions form opinions and engage with public discourse. As autonomous AI agents increasingly participate in these spaces, understanding their behavioral fidelity becomes critical for platform governance…

Computation and Language · Computer Science 2026-04-23 Ljubisa Bojic , Alexander Felfernig , Bojana Dinic , Velibor Ilic , Achim Rettinger , Vera Mevorah , Damian Trilling

The proliferation of harmful online content--e.g., toxicity, spam, and negative sentiment--demands robust and adaptable moderation systems. However, prevailing moderation systems are centralized and task-specific, offering limited…

Computation and Language · Computer Science 2025-11-11 Rufan Zhang , Lin Zhang , Xianghang Mi