English
Related papers

Related papers: Validating Multimedia Content Moderation Software …

200 papers

Current multimodal toxicity benchmarks typically use a single binary hatefulness label. This coarse approach conflates two fundamentally different characteristics of expression: tone and content. Drawing on communication science theory, we…

Computation and Language · Computer Science 2026-03-25 Nils A. Herrmann , Tobias Eder , Jingyi He , Georg Groh

Not Safe/Suitable for Work (NSFW) content is rampant on social networks and poses serious harm to citizens, especially minors. Current detection methods mainly rely on deep learning-based image recognition and classification. However, NSFW…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Han Bao , Qinying Wang , Zhi Chen , Qingming Li , Xuhong Zhang , Changjiang Li , Zonghui Wang , Shouling Ji , Wenzhi Chen

Previous studies on multimodal fake news detection mainly focus on the alignment and integration of cross-modal features, as well as the application of text-image consistency. However, they overlook the semantic enhancement effects of large…

Multimedia · Computer Science 2025-07-21 Peican Zhu , Yubo Jing , Le Cheng , Bin Chen , Xiaodong Cui , Lianwei Wu , Keke Tang

The emergence of Multimodal Foundation Models (MFMs) holds significant promise for transforming social media platforms. However, this advancement also introduces substantial security and ethical concerns, as it may facilitate malicious…

Social and Information Networks · Computer Science 2024-09-30 Kristina Radivojevic , Christopher McAleer , Catrell Conley , Cormac Kennedy , Paul Brenner

Short-form video platforms integrate text, visuals, and audio into complex communicative acts, yet existing research analyzes these modalities in isolation, lacking scalable frameworks to interpret their joint contributions. This study…

Multimedia · Computer Science 2026-01-22 Mingyue Zha , Ho-Chun Herbert Chang

Sentiment analysis, mostly based on text, has been rapidly developing in the last decade and has attracted widespread attention in both academia and industry. However, the information in the real world usually comes from multiple…

Computation and Language · Computer Science 2019-12-12 Feiyang Chen , Ziqian Luo , Yanyan Xu , Dengfeng Ke

With the rapid development of deep learning techniques, the generation and counterfeiting of multimedia material are becoming increasingly straightforward to perform. At the same time, sharing fake content on the web has become so simple…

Multimedia · Computer Science 2022-09-19 Davide Salvi , Brian Hosler , Paolo Bestagini , Matthew C. Stamm , Stefano Tubaro

Video moderation, which refers to remove deviant or explicit content from e-commerce livestreams, has become prevalent owing to social and engaging features. However, this task is tedious and time consuming due to the difficulties…

Human-Computer Interaction · Computer Science 2021-09-09 Tan Tang , Yanhong Wu , Lingyun Yu , Yuhong Li , Yingcai Wu

We study the impact of content moderation policies in online communities. In our theoretical model, a platform chooses a content moderation policy and individuals choose whether or not to participate in the community according to the…

Data Structures and Algorithms · Computer Science 2023-10-17 Cynthia Dwork , Chris Hays , Jon Kleinberg , Manish Raghavan

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

In the current context where online platforms have been effectively weaponized in a variety of geo-political events and social issues, Internet memes make fair content moderation at scale even more difficult. Existing work on meme…

Artificial Intelligence · Computer Science 2023-04-10 Abhinav Kumar Thakur , Filip Ilievski , Hông-Ân Sandlin , Zhivar Sourati , Luca Luceri , Riccardo Tommasini , Alain Mermoud

This paper analyzes the community safety guidelines of five text-to-image (T2I) generation platforms and audits five T2I models, focusing on prompts related to the representation of humans in areas that might lead to societal stigma. While…

Computers and Society · Computer Science 2024-09-27 Piera Riccio , Georgina Curto , Nuria Oliver

The proliferation of tobacco-related content on social media platforms poses significant challenges for public health monitoring and intervention. This paper introduces a novel multi-modal deep learning framework named Flow-Attention…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Naga VS Raviteja Chappa , Page Daniel Dobbs , Bhiksha Raj , Khoa Luu

Recommender systems traditionally represent items using unique identifiers (ItemIDs), but this approach struggles with large, dynamic item corpora and sparse long-tail data, limiting scalability and generalization. Semantic IDs, derived…

Information Retrieval · Computer Science 2026-03-03 Yi Xu , Moyu Zhang , Chenxuan Li , Zhihao Liao , Haibo Xing , Hao Deng , Jinxin Hu , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Internet memes, channels for humor, social commentary, and cultural expression, are increasingly used to spread toxic messages. Studies on the computational analyses of toxic memes have significantly grown over the past five years, and the…

Computation and Language · Computer Science 2026-04-20 Delfina Sol Martinez Pandiani , Erik Tjong Kim Sang , Davide Ceolin

Large language models (LLMs) have exploded in popularity due to their ability to perform a wide array of natural language tasks. Text-based content moderation is one LLM use case that has received recent enthusiasm, however, there is little…

Human-Computer Interaction · Computer Science 2024-01-18 Deepak Kumar , Yousef AbuHashem , Zakir Durumeric

Social media platforms moderate content for each user by incorporating the outputs of both platform-wide content moderation systems and, in some cases, user-configured personal moderation preferences. However, it is unclear (1) how end…

Human-Computer Interaction · Computer Science 2025-06-13 Shagun Jhaver , Alice Qian Zhang , Quanze Chen , Nikhila Natarajan , Ruotong Wang , Amy Zhang

Exponentially growing short video platforms (SVPs) face significant challenges in moderating content detrimental to users' mental health, particularly for minors. The dissemination of such content on SVPs can lead to catastrophic societal…

As posts on social media increase rapidly, analyzing the sentiments embedded in image-text pairs has become a popular research topic in recent years. Although existing works achieve impressive accomplishments in simultaneously harnessing…

Computation and Language · Computer Science 2025-12-04 Daiqing Wu , Dongbao Yang , Yu Zhou , Can Ma

Multimodal affective computing analyzes user-generated social media content to predict emotional states. However, a critical gap remains in understanding how visual content shapes cognitive interpretations and elicits specific affective…

Artificial Intelligence · Computer Science 2026-04-28 Nastaran Dab , Raziyeh Zall , Mohammadreza Kangavari