English
Related papers

Related papers: The Hateful Memes Challenge: Detecting Hate Speech…

200 papers

Hateful content detection is one of the areas where deep learning can and should make a significant difference. The Hateful Memes Challenge from Facebook helps fulfill such potential by challenging the contestants to detect hateful speech…

Machine Learning · Computer Science 2021-06-23 Yang Li , Zinc Zhang , Hutchin Huang

Hateful and offensive content detection has been extensively explored in a single modality such as text. However, such toxic information could also be communicated via multimodal content such as online memes. Therefore, detecting multimodal…

Information Retrieval · Computer Science 2021-08-16 Rui Cao , Ziqing Fan , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

With growing role of social media in shaping public opinions and beliefs across the world, there has been an increased attention to identify and counter the problem of hate speech on social media. Hate speech on online spaces has serious…

Computation and Language · Computer Science 2021-03-03 Prashanth Vijayaraghavan , Hugo Larochelle , Deb Roy

Accurate detection and classification of online hate is a difficult task. Implicit hate is particularly challenging as such content tends to have unusual syntax, polysemic words, and fewer markers of prejudice (e.g., slurs). This problem is…

Computation and Language · Computer Science 2021-06-11 Austin Botelho , Bertie Vidgen , Scott A. Hale

Hate speech online targets individuals or groups based on identity attributes and spreads rapidly, posing serious social risks. Memes, which combine images and text, have emerged as a nuanced vehicle for disseminating hate speech, often…

Multiagent Systems · Computer Science 2026-03-26 Rui Xing , Qi Chai , Jie Ma , Jing Tao , Pinghui Wang , Shuming Zhang , Xinping Wang , Hao Wang

With the continuous growth of internet users and media content, it is very hard to track down hateful speech in audio and video. Converting video or audio into text does not detect hate speech accurately as human sometimes uses hateful…

Artificial Intelligence · Computer Science 2023-07-24 Fariha Tahosin Boishakhi , Ponkoj Chandra Shill , Md. Golam Rabiul Alam

Among the various modes of communication in social media, the use of Internet memes has emerged as a powerful means to convey political, psychological, and socio-cultural opinions. Although memes are typically humorous in nature, recent…

Computation and Language · Computer Science 2021-10-04 Shraman Pramanick , Dimitar Dimitrov , Rituparna Mukherjee , Shivam Sharma , Md. Shad Akhtar , Preslav Nakov , Tanmoy Chakraborty

Hateful meme detection presents a significant challenge as a multimodal task due to the complexity of interpreting implicit hate messages and contextual cues within memes. Previous approaches have fine-tuned pre-trained vision-language…

Computation and Language · Computer Science 2025-02-18 Ming Shan Hee , Roy Ka-Wei Lee

Hateful memes have become a significant concern on the Internet, necessitating robust automated detection systems. While Large Multimodal Models (LMMs) have shown promise in hateful meme detection, they face notable challenges like…

Computation and Language · Computer Science 2026-03-03 Jingbiao Mei , Jinghong Chen , Guangyu Yang , Weizhe Lin , Bill Byrne

The age of social media is flooded with Internet memes, necessitating a clear grasp and effective identification of harmful ones. This task presents a significant challenge due to the implicit meaning embedded in memes, which is not…

Computation and Language · Computer Science 2024-01-25 Hongzhan Lin , Ziyang Luo , Wei Gao , Jing Ma , Bo Wang , Ruichao Yang

Hate speech detection has become an important research topic within the past decade. More private corporations are needing to regulate user generated content on different platforms across the globe. In this paper, we introduce a study of…

Computation and Language · Computer Science 2022-01-28 Neha Deshpande , Nicholas Farris , Vidhur Kumar

With a surge in the usage of social media postings to express opinions, emotions, and ideologies, there has been a significant shift towards the calibration of social media as a rapid medium of conveying viewpoints and outlooks over the…

Computation and Language · Computer Science 2023-09-26 Mohammad Kashif , Mohammad Zohair , Saquib Ali

Moderation of social media content is currently a highly manual task, yet there is too much content posted daily to do so effectively. With the advent of a number of multimodal models, there is the potential to reduce the amount of manual…

Computation and Language · Computer Science 2023-05-11 Bryan Zhao , Andrew Zhang , Blake Watson , Gillian Kearney , Isaac Dale

The rapid evolution of social media has provided enhanced communication channels for individuals to create online content, enabling them to express their thoughts and opinions. Multimodal memes, often utilized for playful or humorous…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Minh-Hao Van , Xintao Wu

This work addresses the challenge of hate speech detection in Internet memes, and attempts using visual information to automatically detect hate speech, unlike any previous work of our knowledge. Memes are pixel-based multimedia documents…

Multimedia · Computer Science 2019-10-08 Benet Oriol Sabat , Cristian Canton Ferrer , Xavier Giro-i-Nieto

Hateful memes are a growing menace on social media. While the image and its corresponding text in a meme are related, they do not necessarily convey the same meaning when viewed individually. Hence, detecting hateful memes requires careful…

Computation and Language · Computer Science 2022-10-18 Gokul Karthik Kumar , Karthik Nandakumar

Amidst the rise of Large Multimodal Models (LMMs) and their widespread application in generating and interpreting complex content, the risk of propagating biased and harmful memes remains significant. Current safety measures often fail to…

Artificial Intelligence · Computer Science 2025-05-01 Xuanyu Su , Yansong Li , Diana Inkpen , Nathalie Japkowicz

Memes act as cryptic tools for sharing sensitive ideas, often requiring contextual knowledge to interpret. This makes moderating multimodal memes challenging, as existing works either lack high-quality datasets on nuanced hate categories or…

Computation and Language · Computer Science 2024-12-31 Palash Nandi , Shivam Sharma , Tanmoy Chakraborty

The age of social media is rife with memes. Understanding and detecting harmful memes pose a significant challenge due to their implicit meaning that is not explicitly conveyed through the surface text and image. However, existing harmful…

Computation and Language · Computer Science 2023-12-12 Hongzhan Lin , Ziyang Luo , Jing Ma , Long Chen

Hateful memes have emerged as a significant concern on the Internet. Detecting hateful memes requires the system to jointly understand the visual and textual modalities. Our investigation reveals that the embedding space of existing…

Computation and Language · Computer Science 2024-10-31 Jingbiao Mei , Jinghong Chen , Weizhe Lin , Bill Byrne , Marcus Tomalin