English
Related papers

Related papers: An Interpretable Approach to Hateful Meme Detectio…

200 papers

Exploiting social media to spread hate has tremendously increased over the years. Lately, multi-modal hateful content such as memes has drawn relatively more traction than uni-modal content. Moreover, the availability of implicit content…

Computation and Language · Computer Science 2023-02-14 Piush Aggarwal , Pranit Chawla , Mithun Das , Punyajoy Saha , Binny Mathew , Torsten Zesch , Animesh Mukherjee

Amidst the rise of Large Multimodal Models (LMMs) and their widespread application in generating and interpreting complex content, the risk of propagating biased and harmful memes remains significant. Current safety measures often fail to…

Artificial Intelligence · Computer Science 2025-05-01 Xuanyu Su , Yansong Li , Diana Inkpen , Nathalie Japkowicz

In the current context where online platforms have been effectively weaponized in a variety of geo-political events and social issues, Internet memes make fair content moderation at scale even more difficult. Existing work on meme…

Artificial Intelligence · Computer Science 2023-04-10 Abhinav Kumar Thakur , Filip Ilievski , Hông-Ân Sandlin , Zhivar Sourati , Luca Luceri , Riccardo Tommasini , Alain Mermoud

Hateful memes are widespread in social media and convey negative information. The main challenge of hateful memes detection is that the expressive meaning can not be well recognized by a single modality. In order to further integrate modal…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Weibo Zhang , Guihua Liu , Zhuohua Li , Fuqing Zhu

Hateful meme detection is a new research area recently brought out that requires both visual, linguistic understanding of the meme and some background knowledge to performing well on the task. This technical report summarises the first…

Computation and Language · Computer Science 2020-12-16 Ron Zhu

The age of social media is flooded with Internet memes, necessitating a clear grasp and effective identification of harmful ones. This task presents a significant challenge due to the implicit meaning embedded in memes, which is not…

Computation and Language · Computer Science 2024-01-25 Hongzhan Lin , Ziyang Luo , Wei Gao , Jing Ma , Bo Wang , Ruichao Yang

The rise in the number of social media users has led to an increase in the hateful content posted online. In countries like India, where multiple languages are spoken, these abhorrent posts are from an unusual blend of code-switched…

Machine Learning · Computer Science 2022-04-26 Kshitij Rajput , Raghav Kapoor , Kaushal Rai , Preeti Kaur

State-of-the-art image and text classification models, such as Convolutional Neural Networks and Transformers, have long been able to classify their respective unimodal reasoning satisfactorily with accuracy close to or exceeding human…

Machine Learning · Computer Science 2022-12-20 Weijun Jin , Lance Wilhelm

Hate speech is one type of harmful online content which directly attacks or promotes hate towards a group or an individual member based on their actual or perceived aspects of identity, such as ethnicity, religion, and sexual orientation.…

Computation and Language · Computer Science 2021-02-18 Wenjie Yin , Arkaitz Zubiaga

Hateful memes often require compositional multimodal reasoning: the image and text may appear benign in isolation, yet their interaction conveys harmful intent. Although thinking-based multimodal large language models (MLLMs) have recently…

Computation and Language · Computer Science 2026-03-03 Mohamed Bayan Kmainasi , Mucahid Kutlu , Ali Ezzat Shahroor , Abul Hasnat , Firoj Alam

Hateful meme classification is a challenging multimodal task that requires complex reasoning and contextual background knowledge. Ideally, we could leverage an explicit external knowledge base to supplement contextual and cultural…

Computation and Language · Computer Science 2023-02-09 Rui Cao , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

Although social media platforms are a prominent arena for users to engage in interpersonal discussions and express opinions, the facade and anonymity offered by social media may allow users to spew hate speech and offensive content. Given…

Computation and Language · Computer Science 2024-05-09 Ayushi Nirmal , Amrita Bhattacharjee , Paras Sheth , Huan Liu

The age of social media is rife with memes. Understanding and detecting harmful memes pose a significant challenge due to their implicit meaning that is not explicitly conveyed through the surface text and image. However, existing harmful…

Computation and Language · Computer Science 2023-12-12 Hongzhan Lin , Ziyang Luo , Jing Ma , Long Chen

Warning: This paper contains memes that may be offensive to some readers. Multimodal Internet Memes are now a ubiquitous fixture in online discourse. One strand of meme-based research is the classification of memes according to various…

Machine Learning · Computer Science 2025-07-04 Muzhaffar Hazman , Susan McKeever , Josephine Griffith

The spread of hate speech on social media space is currently a serious issue. The undemanding access to the enormous amount of information being generated on these platforms has led people to post and react with toxic content that…

Computation and Language · Computer Science 2022-09-13 Abhishek Velankar , Hrushikesh Patil , Raviraj Joshi

Hateful memes pose a unique challenge for current machine learning systems because their message is derived from both text- and visual-modalities. To this effect, Facebook released the Hateful Memes Challenge, a dataset of memes with…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Hannah Rose Kirk , Yennie Jun , Paulius Rauba , Gal Wachtel , Ruining Li , Xingjian Bai , Noah Broestl , Martin Doff-Sotta , Aleksandar Shtedritski , Yuki M. Asano

With the continuous growth of internet users and media content, it is very hard to track down hateful speech in audio and video. Converting video or audio into text does not detect hate speech accurately as human sometimes uses hateful…

Artificial Intelligence · Computer Science 2023-07-24 Fariha Tahosin Boishakhi , Ponkoj Chandra Shill , Md. Golam Rabiul Alam

In this work, we examine hateful memes from three complementary angles - how to detect them, how to explain their content and how to intervene them prior to being posted - by applying a range of strategies built on top of generative AI…

Computation and Language · Computer Science 2026-01-09 Naquee Rizwan , Subhankar Swain , Paramananda Bhaskar , Gagan Aryan , Shehryaar Shah Khan , Animesh Mukherjee

Hateful and offensive content detection has been extensively explored in a single modality such as text. However, such toxic information could also be communicated via multimodal content such as online memes. Therefore, detecting multimodal…

Information Retrieval · Computer Science 2021-08-16 Rui Cao , Ziqing Fan , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

The automatic identification of harmful content online is of major concern for social media platforms, policymakers, and society. Researchers have studied textual, visual, and audio content, but typically in isolation. Yet, harmful content…