English
Related papers

Related papers: Improving Multimodal Hateful Meme Detection Exploi…

200 papers

Memes often merge visuals with brief text to share humor or opinions, yet some memes contain harmful messages such as hate speech. In this paper, we introduces MemeBLIP2, a light weight multimodal system that detects harmful memes by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jiaqi Liu , Ran Tong , Aowei Shen , Shuzheng Li , Changlin Yang , Lisha Xu

Accurate detection and classification of online hate is a difficult task. Implicit hate is particularly challenging as such content tends to have unusual syntax, polysemic words, and fewer markers of prejudice (e.g., slurs). This problem is…

Computation and Language · Computer Science 2021-06-11 Austin Botelho , Bertie Vidgen , Scott A. Hale

There is a rapid increase in the use of multimedia content in current social media platforms. One of the highly popular forms of such multimedia content are memes. While memes have been primarily invented to promote funny and buoyant…

Computation and Language · Computer Science 2025-03-25 Naquee Rizwan , Paramananda Bhaskar , Mithun Das , Swadhin Satyaprakash Majhi , Punyajoy Saha , Animesh Mukherjee

Hateful meme classification is a challenging multimodal task that requires complex reasoning and contextual background knowledge. Ideally, we could leverage an explicit external knowledge base to supplement contextual and cultural…

Computation and Language · Computer Science 2023-02-09 Rui Cao , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

While significant progress has been made using machine learning algorithms to detect hate speech, important technical challenges still remain to be solved in order to bring their performance closer to human accuracy. We investigate several…

Machine Learning · Computer Science 2020-12-25 Vlad Sandulescu

Memes are a popular form of communicating trends and ideas in social media and on the internet in general, combining the modalities of images and text. They can express humor and sarcasm but can also have offensive content. Analyzing and…

Recent advances show that two-stream approaches have achieved outstanding performance in hateful meme detection. However, hateful memes constantly evolve as new memes emerge by fusing progressive cultural ideas, making existing methods…

Computation and Language · Computer Science 2025-01-22 Jinfa Huang , Jinsheng Pan , Zhongwei Wan , Hanjia Lyu , Jiebo Luo

The complexity of text-embedded images presents a formidable challenge in machine learning given the need for multimodal understanding of multiple aspects of expression conveyed by them. While previous research in multimodal analysis has…

Machine Learning · Computer Science 2024-10-29 Siddhant Bikram Shah , Shuvam Shiwakoti , Maheep Chaudhary , Haohan Wang

With growing role of social media in shaping public opinions and beliefs across the world, there has been an increased attention to identify and counter the problem of hate speech on social media. Hate speech on online spaces has serious…

Computation and Language · Computer Science 2021-03-03 Prashanth Vijayaraghavan , Hugo Larochelle , Deb Roy

Hate speech has emerged as a major problem plaguing our social spaces today. While there have been significant efforts to address this problem, existing methods are still significantly limited in effectively detecting hate speech online. A…

Computers and Society · Computer Science 2024-01-09 Keyan Guo , Alexander Hu , Jaden Mu , Ziheng Shi , Ziming Zhao , Nishant Vishwamitra , Hongxin Hu

Text-embedded images can serve as a means of spreading hate speech, propaganda, and extremist beliefs. Throughout the Russia-Ukraine war, both opposing factions heavily relied on text-embedded images as a vehicle for spreading propaganda…

Computation and Language · Computer Science 2023-07-27 Umitcan Sahin , Izzet Emre Kucukkaya , Oguzhan Ozcelik , Cagri Toraman

In this work we target the problem of hate speech detection in multimodal publications formed by a text and an image. We gather and annotate a large scale dataset from Twitter, MMHS150K, and propose different models that jointly analyze…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Raul Gomez , Jaume Gibert , Lluis Gomez , Dimosthenis Karatzas

Hateful content detection is one of the areas where deep learning can and should make a significant difference. The Hateful Memes Challenge from Facebook helps fulfill such potential by challenging the contestants to detect hateful speech…

Machine Learning · Computer Science 2021-06-23 Yang Li , Zinc Zhang , Hutchin Huang

Warning: This paper contains memes that may be offensive to some readers. Multimodal Internet Memes are now a ubiquitous fixture in online discourse. One strand of meme-based research is the classification of memes according to various…

Machine Learning · Computer Science 2025-07-04 Muzhaffar Hazman , Susan McKeever , Josephine Griffith

With the continuous growth of internet users and media content, it is very hard to track down hateful speech in audio and video. Converting video or audio into text does not detect hate speech accurately as human sometimes uses hateful…

Artificial Intelligence · Computer Science 2023-07-24 Fariha Tahosin Boishakhi , Ponkoj Chandra Shill , Md. Golam Rabiul Alam

Internet memes have emerged as an increasingly popular means of communication on the Web. Although typically intended to elicit humour, they have been increasingly used to spread hatred, trolling, and cyberbullying, as well as to target…

Computation and Language · Computer Science 2022-05-13 Shivam Sharma , Md. Shad Akhtar , Preslav Nakov , Tanmoy Chakraborty

Detecting harmful memes is crucial for safeguarding the integrity and harmony of online environments, yet existing detection methods are often resource-intensive, inflexible, and lacking explainability, limiting their applicability in…

Computation and Language · Computer Science 2026-01-29 Fengjun Pan , Xiaobao Wu , Tho Quan , Anh Tuan Luu

Large language models (LLMs) excel in many diverse applications beyond language generation, e.g., translation, summarization, and sentiment analysis. One intriguing application is in text classification. This becomes pertinent in the realm…

Computation and Language · Computer Science 2024-03-14 Tharindu Kumarage , Amrita Bhattacharjee , Joshua Garland

Detecting hate speech in online content is essential to ensuring safer digital spaces. While significant progress has been made in text and meme modalities, video-based hate speech detection remains under-explored, hindered by a lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Han Wang , Rui Yang Tan , Roy Ka-Wei Lee

In the past few years, the meme has become a new way of communication on the Internet. As memes are the images with embedded text, it can quickly spread hate, offence and violence. Classifying memes are very challenging because of their…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque