English
Related papers

Related papers: MemeBLIP2: A novel lightweight multimodal system t…

200 papers

The proliferation of multimodal content on social media presents significant challenges in understanding and moderating complex, context-dependent issues such as misinformation, hate speech, and propaganda. While efforts have been made to…

Computation and Language · Computer Science 2026-03-03 Mohamed Bayan Kmainasi , Abul Hasnat , Md Arid Hasan , Ali Ezzat Shahroor , Firoj Alam

The detection of offensive, hateful content on social media is a challenging problem that affects many online users on a daily basis. Hateful content is often used to target a group of people based on ethnicity, gender, religion and other…

Computation and Language · Computer Science 2022-04-14 Sherzod Hakimov , Gullal S. Cheema , Ralph Ewerth

Online memes are a powerful yet challenging medium for content moderation, often masking harmful intent behind humor, irony, or cultural symbolism. Conventional moderation systems "especially those relying on explicit text" frequently fail…

Information Retrieval · Computer Science 2025-10-20 Sayantan Adak , Somnath Banerjee , Rajarshi Mandal , Avik Halder , Sayan Layek , Rima Hazra , Animesh Mukherjee

The automatic identification of harmful content online is of major concern for social media platforms, policymakers, and society. Researchers have studied textual, visual, and audio content, but typically in isolation. Yet, harmful content…

Memes convey meaning through the interaction of visual and textual signals, often combining humor, irony, and offense in subtle ways. Detecting harmful or sensitive content in memes requires accurate modeling of these multimodal cues.…

Computation and Language · Computer Science 2026-04-29 Qiyuan Jin

Anti-Muslim hate speech has emerged within memes, characterized by context-dependent and rhetorical messages using text and images that seemingly mimic humor but convey Islamophobic sentiments. This work presents a novel dataset and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 S M Jishanul Islam , Sahid Hossain Mustakim , Sadia Ahmmed , Md. Faiyaz Abdullah Sayeedi , Swapnil Khandoker , Syed Tasdid Azam Dhrubo , Nahid Hossain

Among the various modes of communication in social media, the use of Internet memes has emerged as a powerful means to convey political, psychological, and socio-cultural opinions. Although memes are typically humorous in nature, recent…

Computation and Language · Computer Science 2021-10-04 Shraman Pramanick , Dimitar Dimitrov , Rituparna Mukherjee , Shivam Sharma , Md. Shad Akhtar , Preslav Nakov , Tanmoy Chakraborty

Hateful memes have emerged as a significant concern on the Internet. Detecting hateful memes requires the system to jointly understand the visual and textual modalities. Our investigation reveals that the embedding space of existing…

Computation and Language · Computer Science 2024-10-31 Jingbiao Mei , Jinghong Chen , Weizhe Lin , Bill Byrne , Marcus Tomalin

Hateful meme detection presents a significant challenge as a multimodal task due to the complexity of interpreting implicit hate messages and contextual cues within memes. Previous approaches have fine-tuned pre-trained vision-language…

Computation and Language · Computer Science 2025-02-18 Ming Shan Hee , Roy Ka-Wei Lee

Memes, which rapidly disseminate personal opinions and positions across the internet, also pose significant challenges in propagating social bias and prejudice. This study presents a novel approach to detecting harmful memes, particularly…

Artificial Intelligence · Computer Science 2024-06-17 Jingtao Cao , Zheng Zhang , Hongru Wang , Bin Liang , Hao Wang , Kam-Fai Wong

The dissemination of hateful memes online has adverse effects on social media platforms and the real world. Detecting hateful memes is challenging, one of the reasons being the evolutionary nature of memes; new hateful memes can emerge by…

Social and Information Networks · Computer Science 2023-07-10 Yiting Qu , Xinlei He , Shannon Pierson , Michael Backes , Yang Zhang , Savvas Zannettou

Social media platforms enable the propagation of hateful content across different modalities such as textual, auditory, and visual, necessitating effective detection methods. While recent approaches have shown promise in handling individual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Girish A. Koushik , Diptesh Kanojia , Helen Treharne

Multimodal hateful content detection is a challenging task that requires complex reasoning across visual and textual modalities. Therefore, creating a meaningful multimodal representation that effectively captures the interplay between…

Computation and Language · Computer Science 2024-02-16 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque , Sarah M. Preum

Internet memes are powerful tools for communication, capable of spreading political, psychological, and sociocultural ideas. However, they can be harmful and can be used to disseminate hate toward targeted individuals or groups. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Felix Breiteneder , Mohammad Belal , Muhammad Saad Saeed , Shahed Masoudian , Usman Naseem , Kulshrestha Juhi , Markus Schedl , Shah Nawaz

The online community has increasingly been inundated by a toxic wave of harmful comments. In response to this growing challenge, we introduce a two-stage ultra-low-cost multimodal harmful behavior detection method designed to identify…

Multiagent Systems · Computer Science 2024-03-26 Albert Lu , Stephen Cranefield

Online hate remains a significant societal challenge, especially as multimodal content enables subtle, culturally grounded, and implicit forms of harm. Hateful memes embed hostility through text-image interactions and humor, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sahajpreet Singh , Kokil Jaidka , Subhayan Mukerjee

Moderation of social media content is currently a highly manual task, yet there is too much content posted daily to do so effectively. With the advent of a number of multimodal models, there is the potential to reduce the amount of manual…

Computation and Language · Computer Science 2023-05-11 Bryan Zhao , Andrew Zhang , Blake Watson , Gillian Kearney , Isaac Dale

Internet memes have emerged as a popular multimodal medium, yet they are increasingly weaponized to convey harmful opinions through subtle rhetorical devices like irony and metaphor. Existing detection approaches, including Multimodal Large…

Machine Learning · Computer Science 2026-04-17 Wenshuo Wang , Ziyou Jiang , Junjie Wang , Mingyang Li , Jie Huang , Yuekai Huang , Zhiyuan Chang , Feiyan Duan , Qing Wang

Hateful memes are an emerging method of spreading hate on the internet, relying on both images and text to convey a hateful message. We take an interpretable approach to hateful meme detection, using machine learning and simple heuristics…

Machine Learning · Computer Science 2021-08-24 Tanvi Deshpande , Nitya Mani

In the current context where online platforms have been effectively weaponized in a variety of geo-political events and social issues, Internet memes make fair content moderation at scale even more difficult. Existing work on meme…

Artificial Intelligence · Computer Science 2023-04-10 Abhinav Kumar Thakur , Filip Ilievski , Hông-Ân Sandlin , Zhivar Sourati , Luca Luceri , Riccardo Tommasini , Alain Mermoud