English
Related papers

Related papers: Improving Multimodal Hateful Meme Detection Exploi…

200 papers

Amidst the rise of Large Multimodal Models (LMMs) and their widespread application in generating and interpreting complex content, the risk of propagating biased and harmful memes remains significant. Current safety measures often fail to…

Artificial Intelligence · Computer Science 2025-05-01 Xuanyu Su , Yansong Li , Diana Inkpen , Nathalie Japkowicz

Hateful memes are a growing menace on social media. While the image and its corresponding text in a meme are related, they do not necessarily convey the same meaning when viewed individually. Hence, detecting hateful memes requires careful…

Computation and Language · Computer Science 2022-10-18 Gokul Karthik Kumar , Karthik Nandakumar

This work addresses the challenge of hate speech detection in Internet memes, and attempts using visual information to automatically detect hate speech, unlike any previous work of our knowledge. Memes are pixel-based multimedia documents…

Multimedia · Computer Science 2019-10-08 Benet Oriol Sabat , Cristian Canton Ferrer , Xavier Giro-i-Nieto

The automatic identification of harmful content online is of major concern for social media platforms, policymakers, and society. Researchers have studied textual, visual, and audio content, but typically in isolation. Yet, harmful content…

The proliferation of Internet memes in the age of social media necessitates effective identification of harmful ones. Due to the dynamic nature of memes, existing data-driven models may struggle in low-resource scenarios where only a few…

Computation and Language · Computer Science 2024-11-11 Jianzhao Huang , Hongzhan Lin , Ziyan Liu , Ziyang Luo , Guang Chen , Jing Ma

Social media platforms enable the propagation of hateful content across different modalities such as textual, auditory, and visual, necessitating effective detection methods. While recent approaches have shown promise in handling individual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Girish A. Koushik , Diptesh Kanojia , Helen Treharne

Hateful memes have emerged as a significant concern on the Internet. Detecting hateful memes requires the system to jointly understand the visual and textual modalities. Our investigation reveals that the embedding space of existing…

Computation and Language · Computer Science 2024-10-31 Jingbiao Mei , Jinghong Chen , Weizhe Lin , Bill Byrne , Marcus Tomalin

Hateful Memes is a new challenge set for multimodal classification, focusing on detecting hate speech in multimodal memes. Difficult examples are added to the dataset to make it hard to rely on unimodal signals, which means only multimodal…

Computation and Language · Computer Science 2020-12-03 Xiayu Zhong

As a multimodal medium combining images and text, memes frequently convey implicit harmful content through metaphors and humor, rendering the detection of harmful memes a complex and challenging task. Although recent studies have made…

Computation and Language · Computer Science 2026-04-02 Hexiang Gu , Qifan Yu , Yuan Liu , Zikang Li , Saihui Hou , Jian Zhao , Zhaofeng He

The proliferation of multimodal content on social media presents significant challenges in understanding and moderating complex, context-dependent issues such as misinformation, hate speech, and propaganda. While efforts have been made to…

Computation and Language · Computer Science 2026-03-03 Mohamed Bayan Kmainasi , Abul Hasnat , Md Arid Hasan , Ali Ezzat Shahroor , Firoj Alam

Memes are graphics and text overlapped so that together they present concepts that become dubious if one of them is absent. It is spread mostly on social media platforms, in the form of jokes, sarcasm, motivating, etc. After the success of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Tariq Habib Afridi , Aftab Alam , Muhammad Numan Khan , Jawad Khan , Young-Koo Lee

In recent years, monitoring hate speech and offensive language on social media platforms has become paramount due to its widespread usage among all age groups, races, and ethnicities. Consequently, there have been substantial research…

Machine Learning · Computer Science 2022-02-15 Aneri Rana , Sonali Jha

Hate speech online targets individuals or groups based on identity attributes and spreads rapidly, posing serious social risks. Memes, which combine images and text, have emerged as a nuanced vehicle for disseminating hate speech, often…

Multiagent Systems · Computer Science 2026-03-26 Rui Xing , Qi Chai , Jie Ma , Jing Tao , Pinghui Wang , Shuming Zhang , Xinping Wang , Hao Wang

State-of-the-art image and text classification models, such as Convolutional Neural Networks and Transformers, have long been able to classify their respective unimodal reasoning satisfactorily with accuracy close to or exceeding human…

Machine Learning · Computer Science 2022-12-20 Weijun Jin , Lance Wilhelm

The recently introduced hateful meme challenge demonstrates the difficulty of determining whether a meme is hateful or not. Specifically, both unimodal language models and multimodal vision-language models cannot reach the human level of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Efrat Blaier , Itzik Malkiel , Lior Wolf

In the past decade, social media platforms have been used for information dissemination and consumption. While a major portion of the content is posted to promote citizen journalism and public awareness, some content is posted to mislead…

Computation and Language · Computer Science 2024-10-08 Firoj Alam , Md. Rafiul Biswas , Uzair Shah , Wajdi Zaghouani , Georgios Mikros

With a surge in the usage of social media postings to express opinions, emotions, and ideologies, there has been a significant shift towards the calibration of social media as a rapid medium of conveying viewpoints and outlooks over the…

Computation and Language · Computer Science 2023-09-26 Mohammad Kashif , Mohammad Zohair , Saquib Ali

In the current context where online platforms have been effectively weaponized in a variety of geo-political events and social issues, Internet memes make fair content moderation at scale even more difficult. Existing work on meme…

Artificial Intelligence · Computer Science 2023-04-10 Abhinav Kumar Thakur , Filip Ilievski , Hông-Ân Sandlin , Zhivar Sourati , Luca Luceri , Riccardo Tommasini , Alain Mermoud

Memes are a dominant medium for online communication and manipulation because meaning emerges from interactions between embedded text, imagery, and cultural context. Existing meme research is distributed across tasks (hate, misogyny,…

While memes are often humorous, they are frequently used to disseminate hate, causing serious harm to individuals and society. Current approaches to hateful meme detection mainly rely on pre-trained language models. However, less focus has…

Computation and Language · Computer Science 2025-10-14 Weibin Cai , Jiayu Li , Reza Zafarani