English
Related papers

Related papers: Hate-CLIPper: Multimodal Hateful Meme Classificati…

200 papers

Memes are an increasingly prevalent element of online discourse in social networks, especially among young audiences. They carry ideas and messages that range from humorous to hateful, and are widely consumed. Their potentially high impact…

Exploiting social media to spread hate has tremendously increased over the years. Lately, multi-modal hateful content such as memes has drawn relatively more traction than uni-modal content. Moreover, the availability of implicit content…

Computation and Language · Computer Science 2023-02-14 Piush Aggarwal , Pranit Chawla , Mithun Das , Punyajoy Saha , Binny Mathew , Torsten Zesch , Animesh Mukherjee

Hateful meme classification is a challenging multimodal task that requires complex reasoning and contextual background knowledge. Ideally, we could leverage an explicit external knowledge base to supplement contextual and cultural…

Computation and Language · Computer Science 2023-02-09 Rui Cao , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

Hateful videos present serious risks to online safety and real-world well-being, necessitating effective detection methods. Although multimodal classification approaches integrating information from several modalities outperform unimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Jiangbei Yue , Shuonan Yang , Tailin Chen , Jianbo Jiao , Zeyu Fu

Hateful memes often require compositional multimodal reasoning: the image and text may appear benign in isolation, yet their interaction conveys harmful intent. Although thinking-based multimodal large language models (MLLMs) have recently…

Computation and Language · Computer Science 2026-03-03 Mohamed Bayan Kmainasi , Mucahid Kutlu , Ali Ezzat Shahroor , Abul Hasnat , Firoj Alam

Memes act as cryptic tools for sharing sensitive ideas, often requiring contextual knowledge to interpret. This makes moderating multimodal memes challenging, as existing works either lack high-quality datasets on nuanced hate categories or…

Computation and Language · Computer Science 2024-12-31 Palash Nandi , Shivam Sharma , Tanmoy Chakraborty

While significant progress has been made using machine learning algorithms to detect hate speech, important technical challenges still remain to be solved in order to bring their performance closer to human accuracy. We investigate several…

Machine Learning · Computer Science 2020-12-25 Vlad Sandulescu

In recent years, monitoring hate speech and offensive language on social media platforms has become paramount due to its widespread usage among all age groups, races, and ethnicities. Consequently, there have been substantial research…

Machine Learning · Computer Science 2022-02-15 Aneri Rana , Sonali Jha

In this work, we examine hateful memes from three complementary angles - how to detect them, how to explain their content and how to intervene them prior to being posted - by applying a range of strategies built on top of generative AI…

Computation and Language · Computer Science 2026-01-09 Naquee Rizwan , Subhankar Swain , Paramananda Bhaskar , Gagan Aryan , Shehryaar Shah Khan , Animesh Mukherjee

With the continuous emergence of various social media platforms frequently used in daily life, the multimodal meme understanding (MMU) task has been garnering increasing attention. MMU aims to explore and comprehend the meanings of memes…

Computation and Language · Computer Science 2025-03-18 Li Zheng , Hao Fei , Ting Dai , Zuquan Peng , Fei Li , Huisheng Ma , Chong Teng , Donghong Ji

With a surge in the usage of social media postings to express opinions, emotions, and ideologies, there has been a significant shift towards the calibration of social media as a rapid medium of conveying viewpoints and outlooks over the…

Computation and Language · Computer Science 2023-09-26 Mohammad Kashif , Mohammad Zohair , Saquib Ali

Hateful content detection is one of the areas where deep learning can and should make a significant difference. The Hateful Memes Challenge from Facebook helps fulfill such potential by challenging the contestants to detect hateful speech…

Machine Learning · Computer Science 2021-06-23 Yang Li , Zinc Zhang , Hutchin Huang

While memes are often humorous, they are frequently used to disseminate hate, causing serious harm to individuals and society. Current approaches to hateful meme detection mainly rely on pre-trained language models. However, less focus has…

Computation and Language · Computer Science 2025-10-14 Weibin Cai , Jiayu Li , Reza Zafarani

Accurate detection and classification of online hate is a difficult task. Implicit hate is particularly challenging as such content tends to have unusual syntax, polysemic words, and fewer markers of prejudice (e.g., slurs). This problem is…

Computation and Language · Computer Science 2021-06-11 Austin Botelho , Bertie Vidgen , Scott A. Hale

The rapid growth of video content on platforms such as TikTok and YouTube has intensified the spread of multimodal hate speech, where harmful cues emerge subtly and asynchronously across visual, acoustic, and textual streams. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Qiyue Sun , Tailin Chen , Yinghui Zhang , Yuchen Zhang , Jiangbei Yue , Jianbo Jiao , Zeyu Fu

Social media memes are a challenging domain for hate detection because they intertwine visual and textual cues into culturally nuanced messages. To tackle these challenges, we introduce TRACE, a hierarchical multimodal framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Girish A. Koushik , Helen Treharne , Aditya Joshi , Diptesh Kanojia

The age of social media is rife with memes. Understanding and detecting harmful memes pose a significant challenge due to their implicit meaning that is not explicitly conveyed through the surface text and image. However, existing harmful…

Computation and Language · Computer Science 2023-12-12 Hongzhan Lin , Ziyang Luo , Jing Ma , Long Chen

Memes are a popular form of communicating trends and ideas in social media and on the internet in general, combining the modalities of images and text. They can express humor and sarcasm but can also have offensive content. Analyzing and…

Hate speech has become one of the most significant issues in modern society, having implications in both the online and the offline world. Due to this, hate speech research has recently gained a lot of traction. However, most of the work…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Mithun Das , Rohit Raj , Punyajoy Saha , Binny Mathew , Manish Gupta , Animesh Mukherjee

Internet memes have gained significant influence in communicating political, psychological, and sociocultural ideas. While memes are often humorous, there has been a rise in the use of memes for trolling and cyberbullying. Although a wide…

Computation and Language · Computer Science 2024-01-19 Prince Jha , Krishanu Maity , Raghav Jain , Apoorv Verma , Sriparna Saha , Pushpak Bhattacharyya