English
Related papers

Related papers: Who Decides What Is Harmful? Content Moderation Po…

200 papers

Large Language Model (LLM)-based multi-agent systems are increasingly used to simulate human interactions and solve collaborative tasks. A common practice is to assign agents with personas to encourage behavioral diversity. However, this…

Multiagent Systems · Computer Science 2025-11-18 Jiayi Li , Xiao Liu , Yansong Feng

Content moderation plays a critical role in shaping safe and inclusive online environments, balancing platform standards, user expectations, and regulatory frameworks. Traditionally, this process involves operationalising policies into…

The proliferation of Internet memes in the age of social media necessitates effective identification of harmful ones. Due to the dynamic nature of memes, existing data-driven models may struggle in low-resource scenarios where only a few…

Computation and Language · Computer Science 2024-11-11 Jianzhao Huang , Hongzhan Lin , Ziyan Liu , Ziyang Luo , Guang Chen , Jing Ma

Social media platforms have implemented automated content moderation tools to preserve community norms and mitigate online hate and harassment. Recently, these platforms have started to offer Personalized Content Moderation (PCM), granting…

Social and Information Networks · Computer Science 2024-05-17 Necdet Gurkan , Mohammed Almarzouq , Pon Rahul Murugaraj

Traditional recommender systems usually take the user-platform paradigm, where users are directly exposed under the control of the platform's recommendation algorithms. However, the defect of recommendation algorithms may put users in very…

Computation and Language · Computer Science 2025-06-02 Wujiang Xu , Yunxiao Shi , Zujie Liang , Xuying Ning , Kai Mei , Kun Wang , Xi Zhu , Min Xu , Yongfeng Zhang

Many research areas rely on data from the web to gain insights and test their methods. However, collecting comprehensive research datasets often demands manually reviewing many web pages to identify and record relevant data points, which is…

Multiagent Systems · Computer Science 2025-12-29 Sunith Vallabhaneni , Thomas Berkane , Maimuna Majumder

The volume of machine-generated content online has grown dramatically due to the widespread use of Large Language Models (LLMs), leading to new challenges for content moderation systems. Conventional content moderation classifiers, which…

Computation and Language · Computer Science 2026-05-26 Shaz Furniturewala , Arkaitz Zubiaga

The term filter bubble has been coined to describe the situation of online users which---due to filtering algorithms---live in a personalised information universe biased towards their own interests.In this paper we use an agent-based…

Social and Information Networks · Computer Science 2017-01-01 Thomas Gottron , Felix Schwagereit

The emergence of multi-agent systems introduces novel moderation challenges that extend beyond content filtering. Agents with malicious intent may contribute harmful content that appears benign to evade content-based moderation, while…

Artificial Intelligence · Computer Science 2026-05-15 Ali Al-Lawati , Nafis Tripto , Abolfazl Ansari , Jason Lucas , Suhang Wang , Dongwon Lee

Machine learning (ML) is widely used to moderate online content. Despite its scalability relative to human moderation, the use of ML introduces unique challenges to content moderation. One such challenge is predictive multiplicity: multiple…

Computers and Society · Computer Science 2024-02-28 Juan Felipe Gomez , Caio Vieira Machado , Lucas Monteiro Paes , Flavio P. Calmon

Personalization today is fundamentally platform-centric: services build user representations from the behavioral fragments they observe. Yet no platform can construct a complete picture of the user, as competitive incentives, legal…

Large Language Models (LLMs) have demonstrated impressive performance across diverse domains, yet they still encounter challenges such as insufficient domain-specific knowledge, biases, and hallucinations. This underscores the need for…

Computation and Language · Computer Science 2025-04-07 Hongliu Cao , Ilias Driouich , Robin Singh , Eoin Thomas

The proliferation of multimodal memes in the social media era demands that multimodal Large Language Models (mLLMs) effectively understand meme harmfulness. Existing benchmarks for assessing mLLMs on harmful meme understanding rely on…

Computation and Language · Computer Science 2025-07-03 Zixin Chen , Hongzhan Lin , Kaixin Li , Ziyang Luo , Zhen Ye , Guang Chen , Zhiyong Huang , Jing Ma

Online social networks offer a valuable lens to analyze both individual and collective phenomena. Researchers often use simulators to explore controlled scenarios, and the integration of Large Language Models (LLMs) makes these simulations…

Social and Information Networks · Computer Science 2026-04-06 Elisa Composta , Nicolo' Fontana , Francesco Corso , Francesco Pierri

For subjective tasks such as hate detection, where people perceive hate differently, the Large Language Model's (LLM) ability to represent diverse groups is unclear. By including additional context in prompts, we comprehensively analyze…

Computation and Language · Computer Science 2024-10-04 Sarah Masud , Sahajpreet Singh , Viktor Hangya , Alexander Fraser , Tanmoy Chakraborty

Accurately estimating how users respond to moderation interventions is paramount for developing effective and user-centred moderation strategies. However, this requires a clear understanding of which user characteristics are associated with…

Computers and Society · Computer Science 2025-10-24 Benedetta Tessa , Alejandro Moreo , Stefano Cresci , Tiziano Fagni , Fabrizio Sebastiani

We study the impact of content moderation policies in online communities. In our theoretical model, a platform chooses a content moderation policy and individuals choose whether or not to participate in the community according to the…

Data Structures and Algorithms · Computer Science 2023-10-17 Cynthia Dwork , Chris Hays , Jon Kleinberg , Manish Raghavan

Agent-Based Modelling (ABM) has emerged as an essential tool for simulating social networks, encompassing diverse phenomena such as information dissemination, influence dynamics, and community formation. However, manually configuring varied…

Generative AI systems powered by Large Language Models (LLMs) usually use content moderation to prevent harmful content spread. To evaluate the robustness of content moderation, several metamorphic testing techniques have been proposed to…

Software Engineering · Computer Science 2025-03-24 Honghao Tan , Haibo Wang , Diany Pressato , Yisen Xu , Shin Hwei Tan

Multi-agent AI systems can be used for simulating collective decision-making in scientific and practical applications. They can also be used to introduce a diverse group discussion step in chatbot pipelines, enhancing the cultural…

Artificial Intelligence · Computer Science 2024-08-16 Razan Baltaji , Babak Hemmatian , Lav R. Varshney