English
Related papers

Related papers: Robust Harmful Meme Detection under Missing Modali…

200 papers

The missing modality problem poses a fundamental challenge in multimodal sentiment analysis, significantly degrading model accuracy and generalization in real world scenarios. Existing approaches primarily improve robustness through prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Rongfei Chen , Tingting Zhang , Xiaoyu Shen , Wei Zhang

The recently introduced hateful meme challenge demonstrates the difficulty of determining whether a meme is hateful or not. Specifically, both unimodal language models and multimodal vision-language models cannot reach the human level of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Efrat Blaier , Itzik Malkiel , Lior Wolf

Propaganda can be defined as a form of communication that aims to influence the opinions or the actions of people towards a specific goal; this is achieved by means of well-defined rhetorical and psychological devices. Propaganda, in the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Dimitar Dimitrov , Bishr Bin Ali , Shaden Shaar , Firoj Alam , Fabrizio Silvestri , Hamed Firooz , Preslav Nakov , Giovanni Da San Martino

A common assumption in multimodal learning is the completeness of training data, i.e., full modalities are available in all training examples. Although there exists research endeavor in developing novel methods to tackle the incompleteness…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Mengmeng Ma , Jian Ren , Long Zhao , Sergey Tulyakov , Cathy Wu , Xi Peng

With a surge in the usage of social media postings to express opinions, emotions, and ideologies, there has been a significant shift towards the calibration of social media as a rapid medium of conveying viewpoints and outlooks over the…

Computation and Language · Computer Science 2023-09-26 Mohammad Kashif , Mohammad Zohair , Saquib Ali

Nowadays, misinformation is widely spreading over various social media platforms and causes extremely negative impacts on society. To combat this issue, automatically identifying misinformation, especially those containing multimodal…

Computation and Language · Computer Science 2024-07-30 Bing Wang , Shengsheng Wang , Changchun Li , Renchu Guan , Ximing Li

Today, the internet is an integral part of our daily lives, enabling people to be more connected than ever before. However, this greater connectivity and access to information increase exposure to harmful content such as cyber-bullying and…

Social and Information Networks · Computer Science 2023-10-31 Lanqin Yuan , Tianyu Wang , Gabriela Ferraro , Hanna Suominen , Marian-Andrei Rizoiu

The emoticons are symbolic representations that generally accompany the textual content to visually enhance or summarize the true intention of a written message. Although widely utilized in the realm of social media, the core semantics of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Ananya Pandey , Dinesh Kumar Vishwakarma

Multimodal hateful content detection is a challenging task that requires complex reasoning across visual and textual modalities. Therefore, creating a meaningful multimodal representation that effectively captures the interplay between…

Computation and Language · Computer Science 2024-02-16 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque , Sarah M. Preum

In recent years, monitoring hate speech and offensive language on social media platforms has become paramount due to its widespread usage among all age groups, races, and ethnicities. Consequently, there have been substantial research…

Machine Learning · Computer Science 2022-02-15 Aneri Rana , Sonali Jha

In this study, we propose feature extraction for multimodal meme classification using Deep Learning approaches. A meme is usually a photo or video with text shared by the young generation on social media platforms that expresses a…

Artificial Intelligence · Computer Science 2022-07-08 Sofiane Ouaari , Tsegaye Misikir Tashu , Tomas Horvath

The dynamic expansion of social media has led to an inundation of hateful memes on media platforms, accentuating the growing need for efficient identification and removal. Acknowledging the constraints of conventional multimodal hateful…

Computation and Language · Computer Science 2025-03-06 Junxi Liu , Yanyan Feng , Jiehai Chen , Yun Xue , Fenghuan Li

The exponential rise of social media networks has allowed the production, distribution, and consumption of data at a phenomenal rate. Moreover, the social media revolution has brought a unique phenomenon to social media platforms called…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Sunil Gundapu , Radhika Mamidi

Recent studies have proposed models that yielded promising performance for the hateful meme classification task. Nevertheless, these proposed models do not generate interpretable explanations that uncover the underlying meaning and support…

Computation and Language · Computer Science 2023-06-21 Ming Shan Hee , Wen-Haw Chong , Roy Ka-Wei Lee

Visible-Infrared person re-identification (VI-ReID) is an important and challenging task in intelligent video surveillance. Existing methods mainly focus on learning a shared feature space to reduce the modality discrepancy between visible…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Haichao Shi , Mandi Luo , Xiao-Yu Zhang , Ran He

Research on harmful meme detection has garnered significant attention, resulting in the development of numerous datasets and methods. However, progress in detecting Chinese harmful memes lags considerably, primarily due to two challenges:…

Computation and Language · Computer Science 2026-05-26 Weiming Wang , Junyu Lu , Han Wang , Xiaokun Zhang , Zewen Bai , Bo Xu , Liang Yang , Hongfei Lin

Detecting false information on social media is critical in mitigating its negative societal impacts. To reduce the propagation of false information, automated detection provide scalable, unbiased, and cost-effective methods. However, there…

Social and Information Networks · Computer Science 2024-09-09 Sarah Condran

Preventing the spread of misinformation is challenging. The detection of misleading content presents a significant hurdle due to its extreme linguistic and domain variability. Content-based models have managed to identify deceptive language…

Computation and Language · Computer Science 2024-01-30 Flavio Merenda , José Manuel Gómez-Pérez

The proliferation of online hate speech poses a significant threat to the harmony of the web. While explicit hate is easily recognized through overt slurs, implicit hate speech is often conveyed through sarcasm, irony, stereotypes, or coded…

Computation and Language · Computer Science 2026-02-04 Chengshuai Zhao , Shu Wan , Paras Sheth , Karan Patwa , K. Selçuk Candan , Huan Liu

Memes have emerged as a powerful form of communication, integrating visual and textual elements to convey humor, satire, and cultural messages. Existing research has focused primarily on aspects such as emotion classification, meme…

Machine Learning · Computer Science 2025-01-24 Shiling Deng , Serge Belongie , Peter Ebert Christensen