English
Related papers

Related papers: Improving Multimodal Hateful Meme Detection Exploi…

200 papers

With the rise of digital communication, memes have become a significant medium for cultural and political expression that is often used to mislead audiences. Identification of such misleading and persuasive multimodal content has become…

Computation and Language · Computer Science 2024-10-08 Firoj Alam , Abul Hasnat , Fatema Ahmed , Md Arid Hasan , Maram Hasanain

Large vision-language models (LVLMs) are increasingly used for tasks where detecting multimodal harmful content is crucial, such as online content moderation. However, real-world harmful content is often camouflaged, relying on nuanced…

Multimedia · Computer Science 2025-12-04 Yanhui Li , Qi Zhou , Zhihong Xu , Huizhong Guo , Wenhai Wang , Dongxia Wang

The proliferation of harmful memes on online media poses significant risks to public health and stability. Existing detection methods heavily rely on large-scale labeled data for training, which necessitates substantial manual annotation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Jian Lang , Rongpei Hong , Ting Zhong , Leiting Chen , Qiang Gao , Fan Zhou

The phenomenal growth on the internet has helped in empowering individual's expressions, but the misuse of freedom of expression has also led to the increase of various cyber crimes and anti-social activities. Hate speech is one such issue…

Computation and Language · Computer Science 2020-06-01 Prashant Kapil , Asif Ekbal , Dipankar Das

Detecting hateful content in multimodal memes presents unique challenges, as harmful messages often emerge from the complex interplay between benign images and text. We propose GatedCLIP, a Vision-Language model that enhances CLIP's…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yingying Guo , Ke Zhang , Zirong Zeng

With the continuous emergence of various social media platforms frequently used in daily life, the multimodal meme understanding (MMU) task has been garnering increasing attention. MMU aims to explore and comprehend the meanings of memes…

Computation and Language · Computer Science 2025-03-18 Li Zheng , Hao Fei , Ting Dai , Zuquan Peng , Fei Li , Huisheng Ma , Chong Teng , Donghong Ji

Internet Memes remain a challenging form of user-generated content for automated sentiment classification. The availability of labelled memes is a barrier to developing sentiment classifiers of multimodal memes. To address the shortage of…

Computation and Language · Computer Science 2025-08-08 Muzhaffar Hazman , Susan McKeever , Josephine Griffith

Memes have emerged as a popular form of multimodal online communication, where their interpretation heavily depends on the specific context in which they appear. Current approaches predominantly focus on isolated meme analysis, either for…

Artificial Intelligence · Computer Science 2025-06-05 Zhengyi Zhao , Shubo Zhang , Yuxi Zhang , Yanxi Zhao , Yifan Zhang , Zezhong Wang , Huimin Wang , Yutian Zhao , Bin Liang , Yefeng Zheng , Binyang Li , Kam-Fai Wong , Xian Wu

Social media influence campaigns pose significant challenges to public discourse and democracy. Traditional detection methods fall short due to the complexity and dynamic nature of social media. Addressing this, we propose a novel detection…

Social and Information Networks · Computer Science 2023-11-15 Luca Luceri , Eric Boniardi , Emilio Ferrara

Hate speech in social media is a growing phenomenon, and detecting such toxic content has recently gained significant traction in the research community. Existing studies have explored fine-tuning language models (LMs) to perform hate…

Computation and Language · Computer Science 2023-03-07 Md Rabiul Awal , Roy Ka-Wei Lee , Eshaan Tanwar , Tanmay Garg , Tanmoy Chakraborty

The rapid expansion of memes on social media has highlighted the urgent need for effective approaches to detect harmful content. However, traditional data-driven approaches struggle to detect new memes due to their evolving nature and the…

Computation and Language · Computer Science 2025-07-10 Ziyan Liu , Chunxiao Fan , Haoran Lou , Yuexin Wu , Kaiwei Deng

Hate speech has become one of the most significant issues in modern society, having implications in both the online and the offline world. Due to this, hate speech research has recently gained a lot of traction. However, most of the work…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Mithun Das , Rohit Raj , Punyajoy Saha , Binny Mathew , Manish Gupta , Animesh Mukherjee

In the evolving landscape of online communication, hate speech detection remains a formidable challenge, further compounded by the diversity of digital platforms. This study investigates the effectiveness and adaptability of pre-trained and…

Computation and Language · Computer Science 2025-05-01 Ahmad Nasir , Aadish Sharma , Kokil Jaidka , Saifuddin Ahmed

Image memes and specifically their widely-known variation image macros, is a special new media type that combines text with images and is used in social media to playfully or subtly express humour, irony, sarcasm and even hate. It is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Christos Koutlis , Manos Schinas , Symeon Papadopoulos

Internet memes are characterised by the interspersing of text amongst visual elements. State-of-the-art multimodal meme classifiers do not account for the relative positions of these elements across the two modalities, despite the latent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Muzhaffar Hazman , Susan McKeever , Josephine Griffith

Nowadays, misinformation is widely spreading over various social media platforms and causes extremely negative impacts on society. To combat this issue, automatically identifying misinformation, especially those containing multimodal…

Computation and Language · Computer Science 2024-07-30 Bing Wang , Shengsheng Wang , Changchun Li , Renchu Guan , Ximing Li

Cultural context profoundly shapes how people interpret online content, yet vision-language models (VLMs) remain predominantly trained through Western or English-centric lenses. This limits their fairness and cross-cultural robustness in…

Computation and Language · Computer Science 2026-02-13 Mo Wang , Kaixuan Ren , Pratik Jalan , Ahmed Ashraf , Tuong Vy Vu , Rahul Seetharaman , Shah Nawaz , Usman Naseem

Memes have become a distinctive and effective form of communication in the digital era, attracting online communities and cutting across cultural barriers. Even though memes are frequently linked with humor, they have an amazing capacity to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Kazi Toufique Elahi , Tasnuva Binte Rahman , Shakil Shahriar , Samir Sarker , Sajib Kumar Saha Joy , Faisal Muhammad Shah

Multimodal hateful content detection is a challenging task that requires complex reasoning across visual and textual modalities. Therefore, creating a meaningful multimodal representation that effectively captures the interplay between…

Computation and Language · Computer Science 2024-02-16 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque , Sarah M. Preum

Internet memes have become pervasive carriers of digital culture on social platforms. However, their heavy reliance on metaphors and sociocultural context also makes them subtle vehicles for harmful content, posing significant challenges…

Computation and Language · Computer Science 2026-01-30 Yaocong Li , Leihan Zhang , Le Zhang , Qiang Yan