English
Related papers

Related papers: Detecting Hateful Memes Using a Multimodal Deep En…

200 papers

A significant challenge in automating hate speech detection on social media is distinguishing hate speech from regular and offensive language. These identify an essential category of content that web filters seek to remove. Only automated…

Computation and Language · Computer Science 2024-11-12 Faria Naznin , Md Touhidur Rahman , Shahran Rahman Alve

Hateful and offensive content detection has been extensively explored in a single modality such as text. However, such toxic information could also be communicated via multimodal content such as online memes. Therefore, detecting multimodal…

Information Retrieval · Computer Science 2021-08-16 Rui Cao , Ziqing Fan , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

Amidst the rise of Large Multimodal Models (LMMs) and their widespread application in generating and interpreting complex content, the risk of propagating biased and harmful memes remains significant. Current safety measures often fail to…

Artificial Intelligence · Computer Science 2025-05-01 Xuanyu Su , Yansong Li , Diana Inkpen , Nathalie Japkowicz

Large language models (LLMs) excel in many diverse applications beyond language generation, e.g., translation, summarization, and sentiment analysis. One intriguing application is in text classification. This becomes pertinent in the realm…

Computation and Language · Computer Science 2024-03-14 Tharindu Kumarage , Amrita Bhattacharjee , Joshua Garland

Memes act as cryptic tools for sharing sensitive ideas, often requiring contextual knowledge to interpret. This makes moderating multimodal memes challenging, as existing works either lack high-quality datasets on nuanced hate categories or…

Computation and Language · Computer Science 2024-12-31 Palash Nandi , Shivam Sharma , Tanmoy Chakraborty

In this work, we examine hateful memes from three complementary angles - how to detect them, how to explain their content and how to intervene them prior to being posted - by applying a range of strategies built on top of generative AI…

Computation and Language · Computer Science 2026-01-09 Naquee Rizwan , Subhankar Swain , Paramananda Bhaskar , Gagan Aryan , Shehryaar Shah Khan , Animesh Mukherjee

Hateful memes are widespread in social media and convey negative information. The main challenge of hateful memes detection is that the expressive meaning can not be well recognized by a single modality. In order to further integrate modal…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Weibo Zhang , Guihua Liu , Zhuohua Li , Fuqing Zhu

Memes are widely used for humor and cultural commentary, but they are increasingly exploited to spread hateful content. Due to their multimodal nature, hateful memes often evade traditional text-only or image-only detection systems,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Ali Anaissi , Junaid Akram , Kunal Chaturvedi , Ali Braytee

Accurate detection and classification of online hate is a difficult task. Implicit hate is particularly challenging as such content tends to have unusual syntax, polysemic words, and fewer markers of prejudice (e.g., slurs). This problem is…

Computation and Language · Computer Science 2021-06-11 Austin Botelho , Bertie Vidgen , Scott A. Hale

This work addresses the challenge of hate speech detection in Internet memes, and attempts using visual information to automatically detect hate speech, unlike any previous work of our knowledge. Memes are pixel-based multimedia documents…

Multimedia · Computer Science 2019-10-08 Benet Oriol Sabat , Cristian Canton Ferrer , Xavier Giro-i-Nieto

Hate speech is harmful content that directly attacks or promotes hatred against members of groups or individuals based on actual or perceived aspects of identity, such as racism, religion, or sexual orientation. This can affect social life…

Computation and Language · Computer Science 2024-03-19 Arijit Das , Somashree Nandy , Rupam Saha , Srijan Das , Diganta Saha

The exponential increase in the use of the Internet and social media over the last two decades has changed human interaction. This has led to many positive outcomes, but at the same time it has brought risks and harms. While the volume of…

Computation and Language · Computer Science 2020-12-23 Neeraj Vashistha , Arkaitz Zubiaga , Shanky Sharma

Hate speech detection has become an important research topic within the past decade. More private corporations are needing to regulate user generated content on different platforms across the globe. In this paper, we introduce a study of…

Computation and Language · Computer Science 2022-01-28 Neha Deshpande , Nicholas Farris , Vidhur Kumar

Hateful memes have emerged as a significant concern on the Internet. Detecting hateful memes requires the system to jointly understand the visual and textual modalities. Our investigation reveals that the embedding space of existing…

Computation and Language · Computer Science 2024-10-31 Jingbiao Mei , Jinghong Chen , Weizhe Lin , Bill Byrne , Marcus Tomalin

Multimodal image-text memes are prevalent on the internet, serving as a unique form of communication that combines visual and textual elements to convey humor, ideas, or emotions. However, some memes take a malicious turn, promoting hateful…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Giovanni Burbi , Alberto Baldrati , Lorenzo Agnolucci , Marco Bertini , Alberto Del Bimbo

In this work we target the problem of hate speech detection in multimodal publications formed by a text and an image. We gather and annotate a large scale dataset from Twitter, MMHS150K, and propose different models that jointly analyze…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Raul Gomez , Jaume Gibert , Lluis Gomez , Dimosthenis Karatzas

Despite the extensive communication benefits offered by social media platforms, numerous challenges must be addressed to ensure user safety. One of the most significant risks faced by users on these platforms is targeted hate speech. Social…

Computation and Language · Computer Science 2024-07-18 Sadar Jaf , Basel Barakat

Automatic detection of online hate speech serves as a crucial step in the detoxification of the online discourse. Moreover, accurate classification can promote a better understanding of the proliferation of hate as a social phenomenon.…

Computation and Language · Computer Science 2025-06-25 Tom Marzea , Abraham Israeli , Oren Tsur

This paper envisions a multi-agent system for detecting the presence of hate speech in online social media platforms such as Twitter and Facebook. We introduce a novel framework employing deep learning techniques to coordinate the channels…

Artificial Intelligence · Computer Science 2021-05-05 Gaurav Sahu , Robin Cohen , Olga Vechtomova

The phenomenal growth on the internet has helped in empowering individual's expressions, but the misuse of freedom of expression has also led to the increase of various cyber crimes and anti-social activities. Hate speech is one such issue…

Computation and Language · Computer Science 2020-06-01 Prashant Kapil , Asif Ekbal , Dipankar Das