English
Related papers

Related papers: A Multimodal Memes Classification: A Survey and Op…

200 papers

Despite the increasingly important role played by image memes, we do not yet have a solid understanding of the elements that might make a meme go viral on social media. In this paper, we investigate what visual elements distinguish image…

Human-Computer Interaction · Computer Science 2021-01-19 Chen Ling , Ihab AbuHilal , Jeremy Blackburn , Emiliano De Cristofaro , Savvas Zannettou , Gianluca Stringhini

Online memes are a powerful yet challenging medium for content moderation, often masking harmful intent behind humor, irony, or cultural symbolism. Conventional moderation systems "especially those relying on explicit text" frequently fail…

Information Retrieval · Computer Science 2025-10-20 Sayantan Adak , Somnath Banerjee , Rajarshi Mandal , Avik Halder , Sayan Layek , Rima Hazra , Animesh Mukherjee

Disinformation has become a serious problem on social media. In particular, given their short format, visual attraction, and humorous nature, memes have a significant advantage in dissemination among online communities, making them an…

Computation and Language · Computer Science 2022-05-26 Jingnong Qu , Liunian Harold Li , Jieyu Zhao , Sunipa Dev , Kai-Wei Chang

Hateful memes pose a unique challenge for current machine learning systems because their message is derived from both text- and visual-modalities. To this effect, Facebook released the Hateful Memes Challenge, a dataset of memes with…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Hannah Rose Kirk , Yennie Jun , Paulius Rauba , Gal Wachtel , Ruining Li , Xingjian Bai , Noah Broestl , Martin Doff-Sotta , Aleksandar Shtedritski , Yuki M. Asano

Traditional online content moderation systems struggle to classify modern multimodal means of communication, such as memes, a highly nuanced and information-dense medium. This task is especially hard in a culturally diverse society like…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Cao Yuxuan , Wu Jiayang , Alistair Cheong Liang Chuen , Bryan Shan Guanrong , Theodore Lee Chong Jen , Sherman Chann Zhi Shen

The digital revolution and the advent of the world wide web have transformed human communication, notably through the emergence of memes. While memes are a popular and straightforward form of expression, they can also be used to spread…

Computation and Language · Computer Science 2024-07-19 Peter Grönquist

Hateful meme detection is a challenging multimodal task that requires comprehension of both vision and language, as well as cross-modal interactions. Recent studies have tried to fine-tune pre-trained vision-language models (PVLMs) for this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Rui Cao , Ming Shan Hee , Adriel Kuek , Wen-Haw Chong , Roy Ka-Wei Lee , Jing Jiang

Online hate remains a significant societal challenge, especially as multimodal content enables subtle, culturally grounded, and implicit forms of harm. Hateful memes embed hostility through text-image interactions and humor, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sahajpreet Singh , Kokil Jaidka , Subhayan Mukerjee

Recently, large language models (LLMs) have taken the spotlight in natural language processing. Further, integrating LLMs with vision enables the users to explore more emergent abilities in multimodality. Visual language models (VLMs), such…

Computation and Language · Computer Science 2023-11-14 Minh-Hao Van , Xintao Wu

Internet memes are powerful tools for communication, capable of spreading political, psychological, and sociocultural ideas. However, they can be harmful and can be used to disseminate hate toward targeted individuals or groups. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Felix Breiteneder , Mohammad Belal , Muhammad Saad Saeed , Shahed Masoudian , Usman Naseem , Kulshrestha Juhi , Markus Schedl , Shah Nawaz

The dissemination of hateful memes online has adverse effects on social media platforms and the real world. Detecting hateful memes is challenging, one of the reasons being the evolutionary nature of memes; new hateful memes can emerge by…

Social and Information Networks · Computer Science 2023-07-10 Yiting Qu , Xinlei He , Shannon Pierson , Michael Backes , Yang Zhang , Savvas Zannettou

A model for the spreading of online information or "memes" on multiplex networks is introduced and analyzed using branching-process methods. The model generalizes that of [Gleeson et al., Phys.Rev. X., 2016] in two ways. First, even for a…

Physics and Society · Physics 2019-03-01 Joseph D. O'Brien , Ioannis K. Dassios , James P. Gleeson

Memes are one of the most popular types of content used in an online disinformation campaign. They are primarily effective on social media platforms since they can easily reach many users. Memes in a disinformation campaign achieve their…

Computation and Language · Computer Science 2024-04-09 Shreenaga Chikoti , Shrey Mehta , Ashutosh Modi

Humor, deeply rooted in societal meanings and cultural details, poses a unique challenge for machines. While advances have been made in natural language processing, real-world humor often thrives in a multi-modal context, encapsulated…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Yuyan Chen , Songzhou Yan , Zhihong Zhu , Zhixu Li , Yanghua Xiao

Image memes and specifically their widely-known variation image macros, is a special new media type that combines text with images and is used in social media to playfully or subtly express humour, irony, sarcasm and even hate. It is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Christos Koutlis , Manos Schinas , Symeon Papadopoulos

In the past decade, social media platforms have been used for information dissemination and consumption. While a major portion of the content is posted to promote citizen journalism and public awareness, some content is posted to mislead…

Computation and Language · Computer Science 2024-10-08 Firoj Alam , Md. Rafiul Biswas , Uzair Shah , Wajdi Zaghouani , Georgios Mikros

The rise of social media platforms has brought about a new digital culture called memes. Memes, which combine visuals and text, can strongly influence public opinions on social and cultural issues. As a result, people have become interested…

Computation and Language · Computer Science 2023-12-12 Ming Shan Hee , Aditi Kumaresan , Nguyen Khoi Hoang , Nirmalendu Prakash , Rui Cao , Roy Ka-Wei Lee

Current evaluation paradigms for large language models (LLMs) characterize models and datasets separately, yielding coarse descriptions: items in datasets are treated as pre-labeled entries, and models are summarized by overall scores such…

Computation and Language · Computer Science 2026-03-06 Luzhou Peng , Zhengxin Yang , Honglu Ji , Yikang Yang , Fanda Fan , Wanling Gao , Jiayuan Ge , Yilin Han , Jianfeng Zhan

Puns are a common form of rhetorical wordplay that exploits polysemy and phonetic similarity to create humor. In multimodal puns, visual and textual elements synergize to ground the literal sense and evoke the figurative meaning…

Computation and Language · Computer Science 2026-04-08 Naen Xu , Jiayi Sheng , Changjiang Li , Chunyi Zhou , Yuyuan Li , Tianyu Du , Jun Wang , Zhihui Fu , Jinbao Li , Shouling Ji

Hateful memes often require compositional multimodal reasoning: the image and text may appear benign in isolation, yet their interaction conveys harmful intent. Although thinking-based multimodal large language models (MLLMs) have recently…

Computation and Language · Computer Science 2026-03-03 Mohamed Bayan Kmainasi , Mucahid Kutlu , Ali Ezzat Shahroor , Abul Hasnat , Firoj Alam