English
Related papers

Related papers: MemeCLIP: Leveraging CLIP Representations for Mult…

200 papers

Hate speech detection has become an important research topic within the past decade. More private corporations are needing to regulate user generated content on different platforms across the globe. In this paper, we introduce a study of…

Computation and Language · Computer Science 2022-01-28 Neha Deshpande , Nicholas Farris , Vidhur Kumar

Hateful and offensive content detection has been extensively explored in a single modality such as text. However, such toxic information could also be communicated via multimodal content such as online memes. Therefore, detecting multimodal…

Information Retrieval · Computer Science 2021-08-16 Rui Cao , Ziqing Fan , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

The rapid evolution of social media has provided enhanced communication channels for individuals to create online content, enabling them to express their thoughts and opinions. Multimodal memes, often utilized for playful or humorous…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Minh-Hao Van , Xintao Wu

Hate speech is a societal problem that has significantly grown through the Internet. New forms of digital content such as image memes have given rise to spread of hate using multimodal means, being far more difficult to analyse and detect…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Christos Koutlis , Manos Schinas , Symeon Papadopoulos

Hateful Meme Challenge proposed by Facebook AI has attracted contestants around the world. The challenge focuses on detecting hateful speech in multimodal memes. Various state-of-the-art deep learning models have been applied to this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Aijing Gao , Bingjun Wang , Jiaqi Yin , Yating Tian

The prevalence of memes on social media has created the need to sentiment analyze their underlying meanings for censoring harmful content. Meme censoring systems by machine learning raise the need for a semi-supervised learning solution to…

Machine Learning · Computer Science 2023-05-17 Pham Thai Hoang Tung , Nguyen Tan Viet , Ngo Tien Anh , Phan Duy Hung

The recently introduced hateful meme challenge demonstrates the difficulty of determining whether a meme is hateful or not. Specifically, both unimodal language models and multimodal vision-language models cannot reach the human level of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Efrat Blaier , Itzik Malkiel , Lior Wolf

Anti-Muslim hate speech has emerged within memes, characterized by context-dependent and rhetorical messages using text and images that seemingly mimic humor but convey Islamophobic sentiments. This work presents a novel dataset and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 S M Jishanul Islam , Sahid Hossain Mustakim , Sadia Ahmmed , Md. Faiyaz Abdullah Sayeedi , Swapnil Khandoker , Syed Tasdid Azam Dhrubo , Nahid Hossain

Memes are one of the most popular types of content used in an online disinformation campaign. They are primarily effective on social media platforms since they can easily reach many users. Memes in a disinformation campaign achieve their…

Computation and Language · Computer Science 2024-04-09 Shreenaga Chikoti , Shrey Mehta , Ashutosh Modi

Multimodal contrastive learning (MCL) has shown remarkable advances in zero-shot classification by learning from millions of image-caption pairs crawled from the Internet. However, this reliance poses privacy risks, as hackers may…

Multimedia · Computer Science 2024-07-29 Xinwei Liu , Xiaojun Jia , Yuan Xun , Siyuan Liang , Xiaochun Cao

In recent years, monitoring hate speech and offensive language on social media platforms has become paramount due to its widespread usage among all age groups, races, and ethnicities. Consequently, there have been substantial research…

Machine Learning · Computer Science 2022-02-15 Aneri Rana , Sonali Jha

Memes have emerged as a powerful form of communication, integrating visual and textual elements to convey humor, satire, and cultural messages. Existing research has focused primarily on aspects such as emotion classification, meme…

Machine Learning · Computer Science 2025-01-24 Shiling Deng , Serge Belongie , Peter Ebert Christensen

Multimodal hateful content detection is a challenging task that requires complex reasoning across visual and textual modalities. Therefore, creating a meaningful multimodal representation that effectively captures the interplay between…

Computation and Language · Computer Science 2024-02-16 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque , Sarah M. Preum

Women are twice as likely as men to face online harassment due to their gender. Despite recent advances in multimodal content moderation, most approaches still overlook the social dynamics behind this phenomenon, where perpetrators…

Artificial Intelligence · Computer Science 2026-01-14 Paolo Italiani , David Gimeno-Gomez , Luca Ragazzi , Gianluca Moro , Paolo Rosso

Internet memes have gained significant influence in communicating political, psychological, and sociocultural ideas. While memes are often humorous, there has been a rise in the use of memes for trolling and cyberbullying. Although a wide…

Computation and Language · Computer Science 2024-01-19 Prince Jha , Krishanu Maity , Raghav Jain , Apoorv Verma , Sriparna Saha , Pushpak Bhattacharyya

In recent times, the detection of hate-speech, offensive, or abusive language in online media has become an important topic in NLP research due to the exponential growth of social media and the propagation of such messages, as well as their…

Computation and Language · Computer Science 2022-05-31 Andrei Paraschiv , Mihai Dascalu , Dumitru-Clementin Cercel

Online hate speech is an important issue that breaks the cohesiveness of online social communities and even raises public safety concerns in our societies. Motivated by this rising issue, researchers have developed many traditional machine…

Computation and Language · Computer Science 2021-03-23 Rui Cao , Roy Ka-Wei Lee , Tuan-Anh Hoang

The rapid growth of video content on platforms such as TikTok and YouTube has intensified the spread of multimodal hate speech, where harmful cues emerge subtly and asynchronously across visual, acoustic, and textual streams. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Qiyue Sun , Tailin Chen , Yinghui Zhang , Yuchen Zhang , Jiangbei Yue , Jianbo Jiao , Zeyu Fu

Recent advancements in image-text matching have been notable, yet prevailing models predominantly cater to broad queries and struggle with accommodating fine-grained query intention. In this paper, we work towards the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yaxiong Wang , Yujiao Wu , Lianwei Wu , Lechao Cheng , Zhun Zhong , Meng Wang

The rise in the number of social media users has led to an increase in the hateful content posted online. In countries like India, where multiple languages are spoken, these abhorrent posts are from an unusual blend of code-switched…

Machine Learning · Computer Science 2022-04-26 Kshitij Rajput , Raghav Kapoor , Kaushal Rai , Preeti Kaur