English
Related papers

Related papers: SAFE-MEME: Structured Reasoning Framework for Robu…

200 papers

In the past few years, there has been a surge of interest in multi-modal problems, from image captioning to visual question answering and beyond. In this paper, we focus on hate speech detection in multi-modal memes wherein memes pose an…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Abhishek Das , Japsimar Singh Wahi , Siyao Li

Hateful Meme Challenge proposed by Facebook AI has attracted contestants around the world. The challenge focuses on detecting hateful speech in multimodal memes. Various state-of-the-art deep learning models have been applied to this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Aijing Gao , Bingjun Wang , Jiaqi Yin , Yating Tian

The proliferation of multimodal content on social media presents significant challenges in understanding and moderating complex, context-dependent issues such as misinformation, hate speech, and propaganda. While efforts have been made to…

Computation and Language · Computer Science 2026-03-03 Mohamed Bayan Kmainasi , Abul Hasnat , Md Arid Hasan , Ali Ezzat Shahroor , Firoj Alam

The age of social media is flooded with Internet memes, necessitating a clear grasp and effective identification of harmful ones. This task presents a significant challenge due to the implicit meaning embedded in memes, which is not…

Computation and Language · Computer Science 2024-01-25 Hongzhan Lin , Ziyang Luo , Wei Gao , Jing Ma , Bo Wang , Ruichao Yang

With the proliferation of social media, accurate detection of hate speech has become critical to ensure safety online. To combat nuanced forms of hate speech, it is important to identify and thoroughly explain hate speech to help users…

Computation and Language · Computer Science 2023-11-23 Yongjin Yang , Joonkee Kim , Yujin Kim , Namgyu Ho , James Thorne , Se-young Yun

Memes on the Internet are often harmless and sometimes amusing. However, by using certain types of images, text, or combinations of both, the seemingly harmless meme becomes a multimodal type of hate speech -- a hateful meme. The Hateful…

Artificial Intelligence · Computer Science 2020-12-25 Riza Velioglu , Jewgeni Rose

While significant progress has been made using machine learning algorithms to detect hate speech, important technical challenges still remain to be solved in order to bring their performance closer to human accuracy. We investigate several…

Machine Learning · Computer Science 2020-12-25 Vlad Sandulescu

Exploiting social media to spread hate has tremendously increased over the years. Lately, multi-modal hateful content such as memes has drawn relatively more traction than uni-modal content. Moreover, the availability of implicit content…

Computation and Language · Computer Science 2023-02-14 Piush Aggarwal , Pranit Chawla , Mithun Das , Punyajoy Saha , Binny Mathew , Torsten Zesch , Animesh Mukherjee

In this work, we examine hateful memes from three complementary angles - how to detect them, how to explain their content and how to intervene them prior to being posted - by applying a range of strategies built on top of generative AI…

Computation and Language · Computer Science 2026-01-09 Naquee Rizwan , Subhankar Swain , Paramananda Bhaskar , Gagan Aryan , Shehryaar Shah Khan , Animesh Mukherjee

The age of social media is rife with memes. Understanding and detecting harmful memes pose a significant challenge due to their implicit meaning that is not explicitly conveyed through the surface text and image. However, existing harmful…

Computation and Language · Computer Science 2023-12-12 Hongzhan Lin , Ziyang Luo , Jing Ma , Long Chen

Hateful memes are widespread in social media and convey negative information. The main challenge of hateful memes detection is that the expressive meaning can not be well recognized by a single modality. In order to further integrate modal…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Weibo Zhang , Guihua Liu , Zhuohua Li , Fuqing Zhu

Hateful memes have emerged as a particularly challenging form of online abuse, motivating the development of automated detection systems. Most prior approaches rely on direct detection, producing only binary predictions. Such models fail to…

Computation and Language · Computer Science 2026-03-03 Jingbiao Mei , Mingsheng Sun , Jinghong Chen , Pengda Qin , Yuhong Li , Da Chen , Bill Byrne

Hateful and offensive content detection has been extensively explored in a single modality such as text. However, such toxic information could also be communicated via multimodal content such as online memes. Therefore, detecting multimodal…

Information Retrieval · Computer Science 2021-08-16 Rui Cao , Ziqing Fan , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

The rapid evolution of social media has provided enhanced communication channels for individuals to create online content, enabling them to express their thoughts and opinions. Multimodal memes, often utilized for playful or humorous…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Minh-Hao Van , Xintao Wu

Hateful Memes is a new challenge set for multimodal classification, focusing on detecting hate speech in multimodal memes. Difficult examples are added to the dataset to make it hard to rely on unimodal signals, which means only multimodal…

Computation and Language · Computer Science 2020-12-03 Xiayu Zhong

The prevalence of memes on social media has created the need to sentiment analyze their underlying meanings for censoring harmful content. Meme censoring systems by machine learning raise the need for a semi-supervised learning solution to…

Machine Learning · Computer Science 2023-05-17 Pham Thai Hoang Tung , Nguyen Tan Viet , Ngo Tien Anh , Phan Duy Hung

The automatic identification of harmful content online is of major concern for social media platforms, policymakers, and society. Researchers have studied textual, visual, and audio content, but typically in isolation. Yet, harmful content…

Internet memes have become powerful means to transmit political, psychological, and socio-cultural ideas. Although memes are typically humorous, recent days have witnessed an escalation of harmful memes used for trolling, cyberbullying, and…

The advent of social media has given rise to numerous ethical challenges, with hate speech among the most significant concerns. Researchers are attempting to tackle this problem by leveraging hate-speech detection and employing language…

Computation and Language · Computer Science 2023-05-31 Pranath Reddy Kumbam , Sohaib Uddin Syed , Prashanth Thamminedi , Suhas Harish , Ian Perera , Bonnie J. Dorr

Social media memes are a challenging domain for hate detection because they intertwine visual and textual cues into culturally nuanced messages. To tackle these challenges, we introduce TRACE, a hierarchical multimodal framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Girish A. Koushik , Helen Treharne , Aditya Joshi , Diptesh Kanojia