English
Related papers

Related papers: Multimodal and Explainable Internet Meme Classific…

200 papers

Dark humor often relies on subtle cultural nuances and implicit cues that require contextual reasoning to interpret, posing safety challenges that current static benchmarks fail to capture. To address this, we introduce a novel multimodal,…

Computation and Language · Computer Science 2026-03-20 Ahmed Sharshar , Hosam Elgendy , Saad El Dine Ahmed , Yasser Rohaim , Yuxia Wang

Recent technological advancements in the Internet and Social media usage have resulted in the evolution of faster and efficient platforms of communication. These platforms include visual, textual and speech mediums and have brought a unique…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Sunil Gundapu , Radhika Mamidi

Hateful meme detection is a new research area recently brought out that requires both visual, linguistic understanding of the meme and some background knowledge to performing well on the task. This technical report summarises the first…

Computation and Language · Computer Science 2020-12-16 Ron Zhu

Memes have emerged as a popular form of multimodal online communication, where their interpretation heavily depends on the specific context in which they appear. Current approaches predominantly focus on isolated meme analysis, either for…

Artificial Intelligence · Computer Science 2025-06-05 Zhengyi Zhao , Shubo Zhang , Yuxi Zhang , Yanxi Zhao , Yifan Zhang , Zezhong Wang , Huimin Wang , Yutian Zhao , Bin Liang , Yefeng Zheng , Binyang Li , Kam-Fai Wong , Xian Wu

This work examines the vulnerability of multimodal (image + text) models to adversarial threats similar to those discussed in previous literature on unimodal (image- or text-only) models. We introduce realistic assumptions of partial model…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Ivan Evtimov , Russel Howes , Brian Dolhansky , Hamed Firooz , Cristian Canton Ferrer

Classification of social media data is an important approach in understanding user behavior on the Web. Although information on social media can be of different modalities such as texts, images, audio or videos, traditional approaches in…

Computation and Language · Computer Science 2017-08-08 Chi Thang Duong , Remi Lebret , Karl Aberer

The rise in harmful online content not only distorts public discourse but also poses significant challenges to maintaining a healthy digital environment. In response to this, we introduce a multimodal dataset uniquely crafted for…

Meme is an interesting word. Internet memes offer unique insights into the changes in our perception of the world, the media and our own lives. If you surf the Internet for long enough, you will see it somewhere on the Internet. With the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Zhiyuan Liu , Chuanzheng Sun , Yuxin Jiang , Shiqi Jiang , Mei Ming

Large language models (LLMs) excel in many diverse applications beyond language generation, e.g., translation, summarization, and sentiment analysis. One intriguing application is in text classification. This becomes pertinent in the realm…

Computation and Language · Computer Science 2024-03-14 Tharindu Kumarage , Amrita Bhattacharjee , Joshua Garland

Hateful memes pose a unique challenge for current machine learning systems because their message is derived from both text- and visual-modalities. To this effect, Facebook released the Hateful Memes Challenge, a dataset of memes with…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Hannah Rose Kirk , Yennie Jun , Paulius Rauba , Gal Wachtel , Ruining Li , Xingjian Bai , Noah Broestl , Martin Doff-Sotta , Aleksandar Shtedritski , Yuki M. Asano

Detecting and classifying instances of hate in social media text has been a problem of interest in Natural Language Processing in the recent years. Our work leverages state of the art Transformer language models to identify hate speech in a…

Computation and Language · Computer Science 2021-01-12 Sayar Ghosh Roy , Ujwal Narayan , Tathagata Raha , Zubair Abid , Vasudeva Varma

This paper focuses on an important problem of detecting offensive analogy meme on online social media where the visual content and the texts/captions of the meme together make an analogy to convey the offensive information. Existing…

Machine Learning · Computer Science 2021-06-22 Lanyu Shang , Yang Zhang , Yuheng Zha , Yingxi Chen , Christina Youn , Dong Wang

Dark humor in online memes poses unique challenges due to its reliance on implicit, sensitive, and culturally contextual cues. To address the lack of resources and methods for detecting dark humor in multimodal content, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Sai Kartheek Reddy Kasu , Mohammad Zia Ur Rehman , Shahid Shafi Dar , Rishi Bharat Junghare , Dhanvin Sanjay Namboodiri , Nagendra Kumar

The rapid spread of memes makes harmful content detection increasingly crucial, as effective identification can curb the circulation of misinformation. However, existing methods rely heavily on high-volume annotated data, which leads to…

Machine Learning · Computer Science 2026-05-06 Zihan Ding , Ziyuan Yang , Yi Zhang

With the rapid rise of social media and Internet culture, memes have become a popular medium for expressing emotional tendencies. This has sparked growing interest in Meme Emotion Understanding (MEU), which aims to classify the emotional…

Computation and Language · Computer Science 2025-11-17 Yi Shi , Wenlong Meng , Zhenyuan Guo , Chengkun Wei , Wenzhi Chen

In recent years, monitoring hate speech and offensive language on social media platforms has become paramount due to its widespread usage among all age groups, races, and ethnicities. Consequently, there have been substantial research…

Machine Learning · Computer Science 2022-02-15 Aneri Rana , Sonali Jha

The spread of fake news, propaganda, misinformation, disinformation, and harmful content online raised concerns among social media platforms, government agencies, policymakers, and society as a whole. This is because such harmful or abusive…

Computation and Language · Computer Science 2022-05-10 Rabindra Nath Nandi , Firoj Alam , Preslav Nakov

With the increasing diversity of use cases of large language models, a more informative treatment of texts seems necessary. An argumentative analysis could foster a more reasoned usage of chatbots, text completion mechanisms or other…

Computation and Language · Computer Science 2023-06-06 Damián Furman , Pablo Torres , José A. Rodríguez , Diego Letzen , Vanina Martínez , Laura Alonso Alemany

Memes, which rapidly disseminate personal opinions and positions across the internet, also pose significant challenges in propagating social bias and prejudice. This study presents a novel approach to detecting harmful memes, particularly…

Artificial Intelligence · Computer Science 2024-06-17 Jingtao Cao , Zheng Zhang , Hongru Wang , Bin Liang , Hao Wang , Kam-Fai Wong

In the digital world, memes present a unique challenge for content moderation due to their potential to spread harmful content. Although detection methods have improved, proactive solutions such as intervention are still limited, with…

Computation and Language · Computer Science 2024-06-11 Prince Jha , Raghav Jain , Konika Mandal , Aman Chadha , Sriparna Saha , Pushpak Bhattacharyya