English
Related papers

Related papers: Hate-CLIPper: Multimodal Hateful Meme Classificati…

200 papers

The prevalence of memes on social media has created the need to sentiment analyze their underlying meanings for censoring harmful content. Meme censoring systems by machine learning raise the need for a semi-supervised learning solution to…

Machine Learning · Computer Science 2023-05-17 Pham Thai Hoang Tung , Nguyen Tan Viet , Ngo Tien Anh , Phan Duy Hung

Current multimodal toxicity benchmarks typically use a single binary hatefulness label. This coarse approach conflates two fundamentally different characteristics of expression: tone and content. Drawing on communication science theory, we…

Computation and Language · Computer Science 2026-03-25 Nils A. Herrmann , Tobias Eder , Jingyi He , Georg Groh

Internet memes have emerged as an increasingly popular means of communication on the Web. Although typically intended to elicit humour, they have been increasingly used to spread hatred, trolling, and cyberbullying, as well as to target…

Computation and Language · Computer Science 2022-05-13 Shivam Sharma , Md. Shad Akhtar , Preslav Nakov , Tanmoy Chakraborty

Text-embedded images can serve as a means of spreading hate speech, propaganda, and extremist beliefs. Throughout the Russia-Ukraine war, both opposing factions heavily relied on text-embedded images as a vehicle for spreading propaganda…

Computation and Language · Computer Science 2023-07-27 Umitcan Sahin , Izzet Emre Kucukkaya , Oguzhan Ozcelik , Cagri Toraman

Internet memes have become a dominant form of expression on social media, including within the Bengali-speaking community. While often humorous, memes can also be exploited to spread offensive, harmful, and inflammatory content targeting…

Computation and Language · Computer Science 2026-02-27 Rakib Ullah , Mominul islam , Md Sanjid Hossain , Md Ismail Hossain

Online hate remains a significant societal challenge, especially as multimodal content enables subtle, culturally grounded, and implicit forms of harm. Hateful memes embed hostility through text-image interactions and humor, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sahajpreet Singh , Kokil Jaidka , Subhayan Mukerjee

The automatic identification of harmful content online is of major concern for social media platforms, policymakers, and society. Researchers have studied textual, visual, and audio content, but typically in isolation. Yet, harmful content…

The rapid rise of video content on platforms such as TikTok and YouTube has transformed information dissemination, but it has also facilitated the spread of harmful content, particularly hate videos. Despite significant efforts to combat…

Multimedia · Computer Science 2025-05-20 Yinghui Zhang , Tailin Chen , Yuchen Zhang , Zeyu Fu

In this work we target the problem of hate speech detection in multimodal publications formed by a text and an image. We gather and annotate a large scale dataset from Twitter, MMHS150K, and propose different models that jointly analyze…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Raul Gomez , Jaume Gibert , Lluis Gomez , Dimosthenis Karatzas

Hateful memes pose a unique challenge for current machine learning systems because their message is derived from both text- and visual-modalities. To this effect, Facebook released the Hateful Memes Challenge, a dataset of memes with…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Hannah Rose Kirk , Yennie Jun , Paulius Rauba , Gal Wachtel , Ruining Li , Xingjian Bai , Noah Broestl , Martin Doff-Sotta , Aleksandar Shtedritski , Yuki M. Asano

Internet Memes remain a challenging form of user-generated content for automated sentiment classification. The availability of labelled memes is a barrier to developing sentiment classifiers of multimodal memes. To address the shortage of…

Computation and Language · Computer Science 2025-08-08 Muzhaffar Hazman , Susan McKeever , Josephine Griffith

The widespread presence of hate speech on the internet, including formats such as text-based tweets and vision-language memes, poses a significant challenge to digital platform safety. Recent research has developed detection models tailored…

Computation and Language · Computer Science 2024-10-10 Ming Shan Hee , Aditi Kumaresan , Roy Ka-Wei Lee

Social media has a significant impact on people's lives. Hate speech on social media has emerged as one of society's most serious issues in recent years. Text and pictures are two forms of multimodal data that are distributed within…

Computation and Language · Computer Science 2024-09-18 Anusha Chhabra , Dinesh Kumar Vishwakarma

While hate speech detection (HSD) has been extensively studied in text, existing multi-modal approaches remain limited, particularly in videos. As modalities are not always individually informative, simple fusion methods fail to fully…

Detecting hate speech in videos remains challenging due to the complexity of multimodal content and the lack of fine-grained annotations in existing datasets. We present HateClipSeg, a large-scale multimodal dataset with both video-level…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Han Wang , Zhuoran Wang , Roy Ka-Wei Lee

In the past few years, the meme has become a new way of communication on the Internet. As memes are the images with embedded text, it can quickly spread hate, offence and violence. Classifying memes are very challenging because of their…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque

With growing role of social media in shaping public opinions and beliefs across the world, there has been an increased attention to identify and counter the problem of hate speech on social media. Hate speech on online spaces has serious…

Computation and Language · Computer Science 2021-03-03 Prashanth Vijayaraghavan , Hugo Larochelle , Deb Roy

In order to study online hate speech, the availability of datasets containing the linguistic phenomena of interest are of crucial importance. However, when it comes to specific target groups, for example teenagers, collecting such data may…

Computation and Language · Computer Science 2020-05-06 Alessio Palmero Aprosio , Stefano Menini , Sara Tonelli

Hate speech is a pressing issue in modern society, with significant effects both online and offline. Recent research in hate speech detection has primarily centered on text-based media, largely overlooking multimodal content such as videos.…

Multimedia · Computer Science 2024-08-13 Han Wang , Tan Rui Yang , Usman Naseem , Roy Ka-Wei Lee

Hateful meme detection is a new research area recently brought out that requires both visual, linguistic understanding of the meme and some background knowledge to performing well on the task. This technical report summarises the first…

Computation and Language · Computer Science 2020-12-16 Ron Zhu