English
Related papers

Related papers: Towards a Robust Framework for Multimodal Hate Det…

200 papers

While hate speech detection (HSD) has been extensively studied in text, existing multi-modal approaches remain limited, particularly in videos. As modalities are not always individually informative, simple fusion methods fail to fully…

Hate speech has become one of the most significant issues in modern society, having implications in both the online and the offline world. Due to this, hate speech research has recently gained a lot of traction. However, most of the work…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Mithun Das , Rohit Raj , Punyajoy Saha , Binny Mathew , Manish Gupta , Animesh Mukherjee

With the continuous growth of internet users and media content, it is very hard to track down hateful speech in audio and video. Converting video or audio into text does not detect hate speech accurately as human sometimes uses hateful…

Artificial Intelligence · Computer Science 2023-07-24 Fariha Tahosin Boishakhi , Ponkoj Chandra Shill , Md. Golam Rabiul Alam

This paper delves into the formidable challenge of cross-domain generalization in multimodal hate meme detection, presenting compelling findings. We provide enough pieces of evidence supporting the hypothesis that only the textual component…

Computation and Language · Computer Science 2024-02-08 Piush Aggarwal , Jawar Mehrabanian , Weigang Huang , Özge Alacam , Torsten Zesch

In this work we target the problem of hate speech detection in multimodal publications formed by a text and an image. We gather and annotate a large scale dataset from Twitter, MMHS150K, and propose different models that jointly analyze…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Raul Gomez , Jaume Gibert , Lluis Gomez , Dimosthenis Karatzas

Multimodal image-text memes are prevalent on the internet, serving as a unique form of communication that combines visual and textual elements to convey humor, ideas, or emotions. However, some memes take a malicious turn, promoting hateful…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Giovanni Burbi , Alberto Baldrati , Lorenzo Agnolucci , Marco Bertini , Alberto Del Bimbo

Accurate detection and classification of online hate is a difficult task. Implicit hate is particularly challenging as such content tends to have unusual syntax, polysemic words, and fewer markers of prejudice (e.g., slurs). This problem is…

Computation and Language · Computer Science 2021-06-11 Austin Botelho , Bertie Vidgen , Scott A. Hale

Detecting hate speech in online content is essential to ensuring safer digital spaces. While significant progress has been made in text and meme modalities, video-based hate speech detection remains under-explored, hindered by a lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Han Wang , Rui Yang Tan , Roy Ka-Wei Lee

Social media has a significant impact on people's lives. Hate speech on social media has emerged as one of society's most serious issues in recent years. Text and pictures are two forms of multimodal data that are distributed within…

Computation and Language · Computer Science 2024-09-18 Anusha Chhabra , Dinesh Kumar Vishwakarma

Digital forensic investigations increasingly rely on heterogeneous evidence such as images, scanned documents, and contextual reports. These artifacts may contain explicit or implicit expressions of harm, hate, threat, violence, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Ponkoj Chandra Shill

This work proposes a new challenge set for multimodal classification, focusing on detecting hate speech in multimodal memes. It is constructed such that unimodal models struggle and only multimodal models can succeed: difficult examples…

Artificial Intelligence · Computer Science 2021-04-09 Douwe Kiela , Hamed Firooz , Aravind Mohan , Vedanuj Goswami , Amanpreet Singh , Pratik Ringshia , Davide Testuggine

The rise in harmful online content not only distorts public discourse but also poses significant challenges to maintaining a healthy digital environment. In response to this, we introduce a multimodal dataset uniquely crafted for…

The rapid growth of video content on platforms such as TikTok and YouTube has intensified the spread of multimodal hate speech, where harmful cues emerge subtly and asynchronously across visual, acoustic, and textual streams. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Qiyue Sun , Tailin Chen , Yinghui Zhang , Yuchen Zhang , Jiangbei Yue , Jianbo Jiao , Zeyu Fu

Hateful meme detection is a new multimodal task that has gained significant traction in academic and industry research communities. Recently, researchers have applied pre-trained visual-linguistic models to perform the multimodal…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Ming Shan Hee , Roy Ka-Wei Lee , Wen-Haw Chong

Hateful memes have emerged as a significant concern on the Internet. Detecting hateful memes requires the system to jointly understand the visual and textual modalities. Our investigation reveals that the embedding space of existing…

Computation and Language · Computer Science 2024-10-31 Jingbiao Mei , Jinghong Chen , Weizhe Lin , Bill Byrne , Marcus Tomalin

The rapid evolution of social media has provided enhanced communication channels for individuals to create online content, enabling them to express their thoughts and opinions. Multimodal memes, often utilized for playful or humorous…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Minh-Hao Van , Xintao Wu

Memes on the Internet are often harmless and sometimes amusing. However, by using certain types of images, text, or combinations of both, the seemingly harmless meme becomes a multimodal type of hate speech -- a hateful meme. The Hateful…

Artificial Intelligence · Computer Science 2020-12-25 Riza Velioglu , Jewgeni Rose

Detecting hateful content in multimodal memes presents unique challenges, as harmful messages often emerge from the complex interplay between benign images and text. We propose GatedCLIP, a Vision-Language model that enhances CLIP's…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yingying Guo , Ke Zhang , Zirong Zeng

Hateful Meme Challenge proposed by Facebook AI has attracted contestants around the world. The challenge focuses on detecting hateful speech in multimodal memes. Various state-of-the-art deep learning models have been applied to this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Aijing Gao , Bingjun Wang , Jiaqi Yin , Yating Tian

Hate speech detection in Devanagari-scripted social media memes presents compounded challenges: multimodal content structure, script-specific linguistic complexity, and extreme data scarcity in low-resource settings. This paper presents our…

Computation and Language · Computer Science 2026-04-17 Samir Wagle , Reewaj Khanal , Abiral Adhikari