English
Related papers

Related papers: Detecting Hate Speech in Multi-modal Memes

200 papers

This work proposes a new challenge set for multimodal classification, focusing on detecting hate speech in multimodal memes. It is constructed such that unimodal models struggle and only multimodal models can succeed: difficult examples…

Artificial Intelligence · Computer Science 2021-04-09 Douwe Kiela , Hamed Firooz , Aravind Mohan , Vedanuj Goswami , Amanpreet Singh , Pratik Ringshia , Davide Testuggine

An increasingly common expression of online hate speech is multimodal in nature and comes in the form of memes. Designing systems to automatically detect hateful content is of paramount importance if we are to mitigate its undesirable…

Memes are used for spreading ideas through social networks. Although most memes are created for humor, some memes become hateful under the combination of pictures and text. Automatically detecting the hateful memes can help reduce their…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Yi Zhou , Zhenhao Chen

Internet memes have become a dominant method of communication; at the same time, however, they are also increasingly being used to advocate extremism and foster derogatory beliefs. Nonetheless, we do not have a firm understanding as to…

Hateful Memes is a new challenge set for multimodal classification, focusing on detecting hate speech in multimodal memes. Difficult examples are added to the dataset to make it hard to rely on unimodal signals, which means only multimodal…

Computation and Language · Computer Science 2020-12-03 Xiayu Zhong

Hateful meme detection is a new multimodal task that has gained significant traction in academic and industry research communities. Recently, researchers have applied pre-trained visual-linguistic models to perform the multimodal…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Ming Shan Hee , Roy Ka-Wei Lee , Wen-Haw Chong

Memes on the Internet are often harmless and sometimes amusing. However, by using certain types of images, text, or combinations of both, the seemingly harmless meme becomes a multimodal type of hate speech -- a hateful meme. The Hateful…

Artificial Intelligence · Computer Science 2020-12-25 Riza Velioglu , Jewgeni Rose

The recently introduced hateful meme challenge demonstrates the difficulty of determining whether a meme is hateful or not. Specifically, both unimodal language models and multimodal vision-language models cannot reach the human level of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Efrat Blaier , Itzik Malkiel , Lior Wolf

Multimodal image-text memes are prevalent on the internet, serving as a unique form of communication that combines visual and textual elements to convey humor, ideas, or emotions. However, some memes take a malicious turn, promoting hateful…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Giovanni Burbi , Alberto Baldrati , Lorenzo Agnolucci , Marco Bertini , Alberto Del Bimbo

Memes are widely used for humor and cultural commentary, but they are increasingly exploited to spread hateful content. Due to their multimodal nature, hateful memes often evade traditional text-only or image-only detection systems,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Ali Anaissi , Junaid Akram , Kunal Chaturvedi , Ali Braytee

Hateful memes are widespread in social media and convey negative information. The main challenge of hateful memes detection is that the expressive meaning can not be well recognized by a single modality. In order to further integrate modal…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Weibo Zhang , Guihua Liu , Zhuohua Li , Fuqing Zhu

Hateful Meme Challenge proposed by Facebook AI has attracted contestants around the world. The challenge focuses on detecting hateful speech in multimodal memes. Various state-of-the-art deep learning models have been applied to this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Aijing Gao , Bingjun Wang , Jiaqi Yin , Yating Tian

In this work we target the problem of hate speech detection in multimodal publications formed by a text and an image. We gather and annotate a large scale dataset from Twitter, MMHS150K, and propose different models that jointly analyze…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Raul Gomez , Jaume Gibert , Lluis Gomez , Dimosthenis Karatzas

Memes have become a dominant form of communication in social media in recent years. Memes are typically humorous and harmless, however there are also memes that promote hate speech, being in this way harmful to individuals and groups based…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Maria Tzelepi , Vasileios Mezaris

This work addresses the challenge of hate speech detection in Internet memes, and attempts using visual information to automatically detect hate speech, unlike any previous work of our knowledge. Memes are pixel-based multimedia documents…

Multimedia · Computer Science 2019-10-08 Benet Oriol Sabat , Cristian Canton Ferrer , Xavier Giro-i-Nieto

With growing role of social media in shaping public opinions and beliefs across the world, there has been an increased attention to identify and counter the problem of hate speech on social media. Hate speech on online spaces has serious…

Computation and Language · Computer Science 2021-03-03 Prashanth Vijayaraghavan , Hugo Larochelle , Deb Roy

Social media platforms enable the propagation of hateful content across different modalities such as textual, auditory, and visual, necessitating effective detection methods. While recent approaches have shown promise in handling individual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Girish A. Koushik , Diptesh Kanojia , Helen Treharne

Hate speech online targets individuals or groups based on identity attributes and spreads rapidly, posing serious social risks. Memes, which combine images and text, have emerged as a nuanced vehicle for disseminating hate speech, often…

Multiagent Systems · Computer Science 2026-03-26 Rui Xing , Qi Chai , Jie Ma , Jing Tao , Pinghui Wang , Shuming Zhang , Xinping Wang , Hao Wang

Hate speech is a societal problem that has significantly grown through the Internet. New forms of digital content such as image memes have given rise to spread of hate using multimodal means, being far more difficult to analyse and detect…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Christos Koutlis , Manos Schinas , Symeon Papadopoulos

Hateful and offensive content detection has been extensively explored in a single modality such as text. However, such toxic information could also be communicated via multimodal content such as online memes. Therefore, detecting multimodal…

Information Retrieval · Computer Science 2021-08-16 Rui Cao , Ziqing Fan , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang
‹ Prev 1 2 3 10 Next ›