English
Related papers

Related papers: A Trade-off-centered Framework of Content Moderati…

200 papers

One trending application of LLM (large language model) is to use it for content moderation in online platforms. Most current studies on this application have focused on the metric of accuracy -- the extent to which LLMs make correct…

Computers and Society · Computer Science 2025-06-03 Tao Huang

Given the societal impact of unsafe content generated by large language models (LLMs), ensuring that LLM services comply with safety standards is a crucial concern for LLM service providers. Common content moderation methods are limited by…

Computation and Language · Computer Science 2024-09-06 Jialin Wu , Jiangyi Deng , Shengyuan Pang , Yanjiao Chen , Jiayang Xu , Xinfeng Li , Wenyuan Xu

With the growth of social media and large language models, content moderation has become crucial. Many existing datasets lack adequate representation of different groups, resulting in unreliable assessments. To tackle this, we propose a…

Computation and Language · Computer Science 2024-12-19 Shanu Kumar , Gauri Kholkar , Saish Mendke , Anubhav Sadana , Parag Agrawal , Sandipan Dandapat

Value trade-offs are an integral part of human decision-making and language use, however, current tools for interpreting such dynamic and multi-faceted notions of values in language models are limited. In cognitive science, so-called…

Computation and Language · Computer Science 2026-03-03 Sonia K. Murthy , Rosie Zhao , Jennifer Hu , Sham Kakade , Markus Wulfmeier , Peng Qian , Tomer Ullman

Social media users may perceive moderation decisions by the platform differently, which can lead to frustration and dropout. This study investigates users' perceived justice and fairness of online moderation decisions when they are exposed…

Human-Computer Interaction · Computer Science 2024-03-12 Jie Cai , Aashka Patel , Azadeh Naderi , Donghee Yvette Wohn

The emergence of multi-agent systems introduces novel moderation challenges that extend beyond content filtering. Agents with malicious intent may contribute harmful content that appears benign to evade content-based moderation, while…

Artificial Intelligence · Computer Science 2026-05-15 Ali Al-Lawati , Nafis Tripto , Abolfazl Ansari , Jason Lucas , Suhang Wang , Dongwon Lee

Accurately estimating how users respond to moderation interventions is paramount for developing effective and user-centred moderation strategies. However, this requires a clear understanding of which user characteristics are associated with…

Computers and Society · Computer Science 2025-10-24 Benedetta Tessa , Alejandro Moreo , Stefano Cresci , Tiziano Fagni , Fabrizio Sebastiani

As public discourse continues to move and grow online, conversations about divisive topics on social media platforms have also increased. These divisive topics prompt both contentious and non-contentious conversations. Although what…

Computation and Language · Computer Science 2022-04-07 Jacob Beel , Tong Xiang , Sandeep Soni , Diyi Yang

Crowdsourcing-based content moderation is a platform that hosts content moderation tasks for crowd workers to review user submissions (e.g. text, images and videos) and make decisions regarding the admissibility of the posted content, along…

Computer Science and Game Theory · Computer Science 2021-06-08 Sainath Sanga , Venkata Sriram Siddhardh Nadendla

Artificial intelligence algorithms have been used to enhance a wide variety of products and services, including assisting human decision making in high-stakes contexts. However, these algorithms are complex and have trade-offs, notably…

Human-Computer Interaction · Computer Science 2020-07-07 Bowen Yu , Ye Yuan , Loren Terveen , Zhiwei Steven Wu , Jodi Forlizzi , Haiyi Zhu

The exponential growth of digital content presents significant challenges for content safety. Current moderation systems, often based on single models or fixed pipelines, exhibit limitations in identifying implicit risks and providing…

Artificial Intelligence · Computer Science 2025-12-10 Yuxiang He , Jian Zhao , Yuchen Yuan , Tianle Zhang , Wei Cai , Haojie Cheng , Ziyan Shi , Ming Zhu , Haichuan Tang , Chi Zhang , Xuelong Li

The treatment of fairness in decision-making literature usually involves quantifying fairness using objective measures. This work takes a critical stance to highlight the limitations of these approaches (group fairness and individual…

Computers and Society · Computer Science 2024-07-03 Sarra Tajouri , Alexis Tsoukiàs

The internet has become a central medium through which `networked publics' express their opinions and engage in debate. Offensive comments and personal attacks can inhibit participation in these spaces. Automated content moderation aims to…

Computers and Society · Computer Science 2017-09-06 Reuben Binns , Michael Veale , Max Van Kleek , Nigel Shadbolt

Content moderation in online platforms faces persistent challenges due to the evolving complexity of user-generated content and the limitations of traditional rule-based and machine learning approaches. While recent advances in large…

Artificial Intelligence · Computer Science 2026-04-14 Haotian Lu , Yuchen Mou , Bingzhe Wu

Algorithmic fairness has become a central concern in computational decision-making systems, where ensuring equitable outcomes is essential for both ethical and legal reasons. Two dominant notions of fairness have emerged in the literature:…

Machine Learning · Computer Science 2026-02-03 Sandra Benítez-Peña , Blas Kolic , Victoria Menendez , Belén Pulido

Outside ideal settings, conventions are shaped by competing processes that can challenge the emergence of norms. This paper identifies three trade-offs challenging the diffusion of conventions: (I) the trade-off between the imperatives of…

Physics and Society · Physics 2025-03-17 Lucas Gautheron

Millions of people rely on search functionality to find and explore content on entertainment platforms. Modern search systems use a combination of candidate generation and ranking approaches, with advanced methods leveraging deep learning…

Information Retrieval · Computer Science 2025-05-26 Adeep Hande , Kishorekumar Sundararajan , Sardar Hamidian , Ferhan Ture

Centralized content moderation paradigm both falls short and over-reaches: 1) it fails to account for the subjective nature of harm, and 2) it acts with blunt suppression in response to content deemed harmful, even when such content can be…

Human-Computer Interaction · Computer Science 2026-02-11 Rayhan Rashed , Farnaz Jahanbakhsh

Complex conversation settings such as persuasion involve communicating changes in attitude or behavior, so users' perspectives need to be addressed, even when not directly related to the topic. In this work, we contribute a novel modular…

Computation and Language · Computer Science 2022-09-26 Maximillian Chen , Weiyan Shi , Feifan Yan , Ryan Hou , Jingwen Zhang , Saurav Sahay , Zhou Yu

Recommender Systems use the user's profile to generate a recommendation list with unknown items to a target user. Although the primary goal of traditional recommendation systems is to deliver the most relevant items, such an effort…

Information Retrieval · Computer Science 2022-04-11 Diego Corrêa da Silva , Frederico Araújo Durão