English
Related papers

Related papers: Content Moderation by LLM: From Accuracy to Legiti…

200 papers

Given the societal impact of unsafe content generated by large language models (LLMs), ensuring that LLM services comply with safety standards is a crucial concern for LLM service providers. Common content moderation methods are limited by…

Computation and Language · Computer Science 2024-09-06 Jialin Wu , Jiangyi Deng , Shengyuan Pang , Yanjiao Chen , Jiayang Xu , Xinfeng Li , Wenyuan Xu

Content moderation plays a critical role in shaping safe and inclusive online environments, balancing platform standards, user expectations, and regulatory frameworks. Traditionally, this process involves operationalising policies into…

Sensitive information detection is crucial in content moderation to maintain safe online communities. Assisting in this traditionally manual process could relieve human moderators from overwhelming and tedious tasks, allowing them to focus…

Large language models (LLMs) have exploded in popularity due to their ability to perform a wide array of natural language tasks. Text-based content moderation is one LLM use case that has received recent enthusiasm, however, there is little…

Human-Computer Interaction · Computer Science 2024-01-18 Deepak Kumar , Yousef AbuHashem , Zakir Durumeric

Millions of people rely on search functionality to find and explore content on entertainment platforms. Modern search systems use a combination of candidate generation and ranking approaches, with advanced methods leveraging deep learning…

Information Retrieval · Computer Science 2025-05-26 Adeep Hande , Kishorekumar Sundararajan , Sardar Hamidian , Ferhan Ture

The prevalence of harmful content on social media platforms poses significant risks to users and society, necessitating more effective and scalable content moderation strategies. Current approaches rely on human moderators, supervised…

Computation and Language · Computer Science 2025-01-27 Akash Bonagiri , Lucen Li , Rajvardhan Oak , Zeerak Babar , Magdalena Wojcieszak , Anshuman Chhabra

The growth of online platforms and user content requires strong content moderation systems that can handle complex inputs from various media types. While large language models (LLMs) are effective, their high computational cost and latency…

Computation and Language · Computer Science 2026-04-09 Shutong Zhang , Dylan Zhou , Yinxiao Liu , Yang Yang , Huiwen Luo , Wenfei Zou

The widespread dissemination of hate speech, harassment, harmful and sexual content, and violence across websites and media platforms presents substantial challenges and provokes widespread concern among different sectors of society.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Nouar AlDahoul , Myles Joshua Toledo Tan , Harishwar Reddy Kasireddy , Yasir Zaki

Content moderation in online platforms faces persistent challenges due to the evolving complexity of user-generated content and the limitations of traditional rule-based and machine learning approaches. While recent advances in large…

Artificial Intelligence · Computer Science 2026-04-14 Haotian Lu , Yuchen Mou , Bingzhe Wu

Large Language Models (LLMs) are increasingly deployed as gateways to information, yet their content moderation practices remain underexplored. This work investigates the extent to which LLMs refuse to answer or omit information when…

Computation and Language · Computer Science 2025-04-08 Sander Noels , Guillaume Bied , Maarten Buyl , Alexander Rogiers , Yousra Fettach , Jefrey Lijffijt , Tijl De Bie

Content moderation at scale remains one of the most pressing challenges in today's digital ecosystem, where billions of user- and AI-generated artifacts must be continuously evaluated for policy violations. Although recent advances in large…

Nowadays, billions of people engage in communication and express their opinions on the internet daily. Unfortunately, not all of these expressions are friendly or compliant, making content moderation an indispensable task. A common approach…

Machine Learning · Computer Science 2024-03-08 Huan Ma , Changqing Zhang , Huazhu Fu , Peilin Zhao , Bingzhe Wu

As internet access expands, so does exposure to harmful content, increasing the need for effective moderation. Research has demonstrated that large language models (LLMs) can be effectively utilized for social media moderation tasks,…

Computation and Language · Computer Science 2026-02-06 Hsuan-Yu Chou , Wajiha Naveed , Shuyan Zhou , Xiaowei Yang

Large language models (LLMs) are increasingly used in content moderation systems, where ensuring fairness and neutrality is essential. In this study, we examine how persona adoption influences the consistency and fairness of harmful content…

Computation and Language · Computer Science 2025-10-31 Stefano Civelli , Pietro Bernardelle , Nardiena A. Pratama , Gianluca Demartini

While research continues to investigate and improve the accuracy, fairness, and normative appropriateness of content moderation processes on large social media platforms, even the best process cannot be effective if users reject its…

Human-Computer Interaction · Computer Science 2022-10-07 Christina A. Pan , Sahil Yakhmi , Tara P. Iyer , Evan Strasnick , Amy X. Zhang , Michael S. Bernstein

Content moderation is a widely used strategy to prevent the dissemination of irregular information on social media platforms. Despite extensive research on developing automated models to support decision-making in content moderation, there…

Social and Information Networks · Computer Science 2024-08-23 Wangjiaxuan Xin , Kanlun Wang , Zhe Fu , Lina Zhou

With the growth of social media and large language models, content moderation has become crucial. Many existing datasets lack adequate representation of different groups, resulting in unreliable assessments. To tackle this, we propose a…

Computation and Language · Computer Science 2024-12-19 Shanu Kumar , Gauri Kholkar , Saish Mendke , Anubhav Sadana , Parag Agrawal , Sandipan Dandapat

Large Language Models (LLMs) have shown significant advances in text generation but often lack the reliability needed for autonomous deployment in high-stakes domains like healthcare, law, and finance. Existing approaches rely on external…

Artificial Intelligence · Computer Science 2024-11-12 Ninad Naik

Social media platforms utilize Machine Learning (ML) and Artificial Intelligence (AI) powered recommendation algorithms to maximize user engagement, which can result in inadvertent exposure to harmful content. Current moderation efforts,…

Computation and Language · Computer Science 2025-05-30 Rajvardhan Oak , Muhammad Haroon , Claire Jo , Magdalena Wojcieszak , Anshuman Chhabra

Large language models (LLMs) have shown promise in many natural language understanding tasks, including content moderation. However, these models can be expensive to query in real-time and do not allow for a community-specific approach to…

Computation and Language · Computer Science 2025-02-11 Xianyang Zhan , Agam Goyal , Yilun Chen , Eshwar Chandrasekharan , Koustuv Saha
‹ Prev 1 2 3 10 Next ›