English
Related papers

Related papers: Robust Harmful Meme Detection under Missing Modali…

200 papers

Exploiting social media to spread hate has tremendously increased over the years. Lately, multi-modal hateful content such as memes has drawn relatively more traction than uni-modal content. Moreover, the availability of implicit content…

Computation and Language · Computer Science 2023-02-14 Piush Aggarwal , Pranit Chawla , Mithun Das , Punyajoy Saha , Binny Mathew , Torsten Zesch , Animesh Mukherjee

In the past few years, there has been a surge of interest in multi-modal problems, from image captioning to visual question answering and beyond. In this paper, we focus on hate speech detection in multi-modal memes wherein memes pose an…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Abhishek Das , Japsimar Singh Wahi , Siyao Li

Internet memes, now a staple of digital communication, play a pivotal role in how users engage within online communities and allow researchers to gain insight into contemporary digital culture. These engaging user-generated content are…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Muzhaffar Hazman , Susan McKeever , Josephine Griffith

Harmful memes are ever-shifting in the Internet communities, which are difficult to analyze due to their type-shifting and temporal-evolving nature. Although these memes are shifting, we find that different memes may share invariant…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Ziyou Jiang , Mingyang Li , Junjie Wang , Yuekai Huang , Jie Huang , Zhiyuan Chang , Zhaoyang Li , Qing Wang

Hateful memes have emerged as a significant concern on the Internet. Detecting hateful memes requires the system to jointly understand the visual and textual modalities. Our investigation reveals that the embedding space of existing…

Computation and Language · Computer Science 2024-10-31 Jingbiao Mei , Jinghong Chen , Weizhe Lin , Bill Byrne , Marcus Tomalin

There is a rapid increase in the use of multimedia content in current social media platforms. One of the highly popular forms of such multimedia content are memes. While memes have been primarily invented to promote funny and buoyant…

Computation and Language · Computer Science 2025-03-25 Naquee Rizwan , Paramananda Bhaskar , Mithun Das , Swadhin Satyaprakash Majhi , Punyajoy Saha , Animesh Mukherjee

The proliferation of Internet memes in the age of social media necessitates effective identification of harmful ones. Due to the dynamic nature of memes, existing data-driven models may struggle in low-resource scenarios where only a few…

Computation and Language · Computer Science 2024-11-11 Jianzhao Huang , Hongzhan Lin , Ziyan Liu , Ziyang Luo , Guang Chen , Jing Ma

Detecting harmful memes is crucial for safeguarding the integrity and harmony of online environments, yet existing detection methods are often resource-intensive, inflexible, and lacking explainability, limiting their applicability in…

Computation and Language · Computer Science 2026-01-29 Fengjun Pan , Xiaobao Wu , Tho Quan , Anh Tuan Luu

The prevalence of memes on social media has created the need to sentiment analyze their underlying meanings for censoring harmful content. Meme censoring systems by machine learning raise the need for a semi-supervised learning solution to…

Machine Learning · Computer Science 2023-05-17 Pham Thai Hoang Tung , Nguyen Tan Viet , Ngo Tien Anh , Phan Duy Hung

Image-with-text memes combine text with imagery to achieve comedy, but in today's world, they also play a pivotal role in online communication, influencing politics, marketing, and social norms. A "meme template" is a preexisting layout or…

Computers and Society · Computer Science 2024-08-16 Levente Murgás , Marcell Nagy , Kate Barnes , Roland Molontay

Internet memes, channels for humor, social commentary, and cultural expression, are increasingly used to spread toxic messages. Studies on the computational analyses of toxic memes have significantly grown over the past five years, and the…

Computation and Language · Computer Science 2026-04-20 Delfina Sol Martinez Pandiani , Erik Tjong Kim Sang , Davide Ceolin

Harmful or abusive online content has been increasing over time, raising concerns for social media platforms, government agencies, and policymakers. Such harmful or abusive content can have major negative impact on society, e.g.,…

Computation and Language · Computer Science 2022-05-10 Rabindra Nath Nandi , Firoj Alam , Preslav Nakov

While memes are often humorous, they are frequently used to disseminate hate, causing serious harm to individuals and society. Current approaches to hateful meme detection mainly rely on pre-trained language models. However, less focus has…

Computation and Language · Computer Science 2025-10-14 Weibin Cai , Jiayu Li , Reza Zafarani

The rapid evolution of social media has provided enhanced communication channels for individuals to create online content, enabling them to express their thoughts and opinions. Multimodal memes, often utilized for playful or humorous…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Minh-Hao Van , Xintao Wu

Internet memes are a central element of online culture, blending images and text. While substantial research has focused on either the visual or textual components of memes, little attention has been given to their interplay. This gap…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Aidos Konyspay , Pakizar Shamoi , Malika Ziyada , Zhusup Smambayev

Hateful memes are an emerging method of spreading hate on the internet, relying on both images and text to convey a hateful message. We take an interpretable approach to hateful meme detection, using machine learning and simple heuristics…

Machine Learning · Computer Science 2021-08-24 Tanvi Deshpande , Nitya Mani

Memes often merge visuals with brief text to share humor or opinions, yet some memes contain harmful messages such as hate speech. In this paper, we introduces MemeBLIP2, a light weight multimodal system that detects harmful memes by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jiaqi Liu , Ran Tong , Aowei Shen , Shuzheng Li , Changlin Yang , Lisha Xu

Hateful meme detection is a new multimodal task that has gained significant traction in academic and industry research communities. Recently, researchers have applied pre-trained visual-linguistic models to perform the multimodal…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Ming Shan Hee , Roy Ka-Wei Lee , Wen-Haw Chong

This paper has been accepted in the NeurIPS 2024 D & B Track. Harmful memes have proliferated on the Chinese Internet, while research on detecting Chinese harmful memes significantly lags behind due to the absence of reliable datasets and…

Computation and Language · Computer Science 2024-10-04 Junyu Lu , Bo Xu , Xiaokun Zhang , Hongbo Wang , Haohao Zhu , Dongyu Zhang , Liang Yang , Hongfei Lin

The dissemination of hateful memes online has adverse effects on social media platforms and the real world. Detecting hateful memes is challenging, one of the reasons being the evolutionary nature of memes; new hateful memes can emerge by…

Social and Information Networks · Computer Science 2023-07-10 Yiting Qu , Xinlei He , Shannon Pierson , Michael Backes , Yang Zhang , Savvas Zannettou