中文
相关论文

相关论文: Hate-CLIPper: Multimodal Hateful Meme Classificati…

200 篇论文

Hateful Memes is a new challenge set for multimodal classification, focusing on detecting hate speech in multimodal memes. Difficult examples are added to the dataset to make it hard to rely on unimodal signals, which means only multimodal…

计算与语言 · 计算机科学 2020-12-03 Xiayu Zhong

Memes on the Internet are often harmless and sometimes amusing. However, by using certain types of images, text, or combinations of both, the seemingly harmless meme becomes a multimodal type of hate speech -- a hateful meme. The Hateful…

人工智能 · 计算机科学 2020-12-25 Riza Velioglu , Jewgeni Rose

Hateful Meme Challenge proposed by Facebook AI has attracted contestants around the world. The challenge focuses on detecting hateful speech in multimodal memes. Various state-of-the-art deep learning models have been applied to this…

计算机视觉与模式识别 · 计算机科学 2021-12-22 Aijing Gao , Bingjun Wang , Jiaqi Yin , Yating Tian

Hate speech detection in Devanagari-scripted social media memes presents compounded challenges: multimodal content structure, script-specific linguistic complexity, and extreme data scarcity in low-resource settings. This paper presents our…

计算与语言 · 计算机科学 2026-04-17 Samir Wagle , Reewaj Khanal , Abiral Adhikari

Anti-Muslim hate speech has emerged within memes, characterized by context-dependent and rhetorical messages using text and images that seemingly mimic humor but convey Islamophobic sentiments. This work presents a novel dataset and…

The recently introduced hateful meme challenge demonstrates the difficulty of determining whether a meme is hateful or not. Specifically, both unimodal language models and multimodal vision-language models cannot reach the human level of…

计算机视觉与模式识别 · 计算机科学 2021-09-23 Efrat Blaier , Itzik Malkiel , Lior Wolf

State-of-the-art image and text classification models, such as Convolutional Neural Networks and Transformers, have long been able to classify their respective unimodal reasoning satisfactorily with accuracy close to or exceeding human…

机器学习 · 计算机科学 2022-12-20 Weijun Jin , Lance Wilhelm

The rapid evolution of social media has provided enhanced communication channels for individuals to create online content, enabling them to express their thoughts and opinions. Multimodal memes, often utilized for playful or humorous…

计算机视觉与模式识别 · 计算机科学 2025-05-02 Minh-Hao Van , Xintao Wu

Internet memes are a central element of online culture, blending images and text. While substantial research has focused on either the visual or textual components of memes, little attention has been given to their interplay. This gap…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Aidos Konyspay , Pakizar Shamoi , Malika Ziyada , Zhusup Smambayev

Hateful meme detection presents a significant challenge as a multimodal task due to the complexity of interpreting implicit hate messages and contextual cues within memes. Previous approaches have fine-tuned pre-trained vision-language…

计算与语言 · 计算机科学 2025-02-18 Ming Shan Hee , Roy Ka-Wei Lee

Hate speech online targets individuals or groups based on identity attributes and spreads rapidly, posing serious social risks. Memes, which combine images and text, have emerged as a nuanced vehicle for disseminating hate speech, often…

多智能体系统 · 计算机科学 2026-03-26 Rui Xing , Qi Chai , Jie Ma , Jing Tao , Pinghui Wang , Shuming Zhang , Xinping Wang , Hao Wang

Detecting hate speech in online content is essential to ensuring safer digital spaces. While significant progress has been made in text and meme modalities, video-based hate speech detection remains under-explored, hindered by a lack of…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Han Wang , Rui Yang Tan , Roy Ka-Wei Lee

The rise in the number of social media users has led to an increase in the hateful content posted online. In countries like India, where multiple languages are spoken, these abhorrent posts are from an unusual blend of code-switched…

机器学习 · 计算机科学 2022-04-26 Kshitij Rajput , Raghav Kapoor , Kaushal Rai , Preeti Kaur

Hateful memes are an emerging method of spreading hate on the internet, relying on both images and text to convey a hateful message. We take an interpretable approach to hateful meme detection, using machine learning and simple heuristics…

机器学习 · 计算机科学 2021-08-24 Tanvi Deshpande , Nitya Mani

In the current context where online platforms have been effectively weaponized in a variety of geo-political events and social issues, Internet memes make fair content moderation at scale even more difficult. Existing work on meme…

Hateful memes have become a significant concern on the Internet, necessitating robust automated detection systems. While Large Multimodal Models (LMMs) have shown promise in hateful meme detection, they face notable challenges like…

计算与语言 · 计算机科学 2026-03-03 Jingbiao Mei , Jinghong Chen , Guangyu Yang , Weizhe Lin , Bill Byrne

This work addresses the challenge of hate speech detection in Internet memes, and attempts using visual information to automatically detect hate speech, unlike any previous work of our knowledge. Memes are pixel-based multimedia documents…

多媒体 · 计算机科学 2019-10-08 Benet Oriol Sabat , Cristian Canton Ferrer , Xavier Giro-i-Nieto

Memes often merge visuals with brief text to share humor or opinions, yet some memes contain harmful messages such as hate speech. In this paper, we introduces MemeBLIP2, a light weight multimodal system that detects harmful memes by…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Jiaqi Liu , Ran Tong , Aowei Shen , Shuzheng Li , Changlin Yang , Lisha Xu

Hateful and offensive content detection has been extensively explored in a single modality such as text. However, such toxic information could also be communicated via multimodal content such as online memes. Therefore, detecting multimodal…

信息检索 · 计算机科学 2021-08-16 Rui Cao , Ziqing Fan , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

This paper delves into the formidable challenge of cross-domain generalization in multimodal hate meme detection, presenting compelling findings. We provide enough pieces of evidence supporting the hypothesis that only the textual component…

计算与语言 · 计算机科学 2024-02-08 Piush Aggarwal , Jawar Mehrabanian , Weigang Huang , Özge Alacam , Torsten Zesch