English
Related papers

Related papers: MemeFier: Dual-stage Modality Fusion for Image Mem…

200 papers

While memes are often humorous, they are frequently used to disseminate hate, causing serious harm to individuals and society. Current approaches to hateful meme detection mainly rely on pre-trained language models. However, less focus has…

Computation and Language · Computer Science 2025-10-14 Weibin Cai , Jiayu Li , Reza Zafarani

Hateful memes pose a unique challenge for current machine learning systems because their message is derived from both text- and visual-modalities. To this effect, Facebook released the Hateful Memes Challenge, a dataset of memes with…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Hannah Rose Kirk , Yennie Jun , Paulius Rauba , Gal Wachtel , Ruining Li , Xingjian Bai , Noah Broestl , Martin Doff-Sotta , Aleksandar Shtedritski , Yuki M. Asano

Recent advances show that two-stream approaches have achieved outstanding performance in hateful meme detection. However, hateful memes constantly evolve as new memes emerge by fusing progressive cultural ideas, making existing methods…

Computation and Language · Computer Science 2025-01-22 Jinfa Huang , Jinsheng Pan , Zhongwei Wan , Hanjia Lyu , Jiebo Luo

Our work advances an approach for predicting hate speech in social media, drawing out the critical need to consider the discussions that follow a post to successfully detect when hateful discourse may arise. Using graph transformer…

Machine Learning · Computer Science 2023-05-02 Liam Hebert , Hong Yi Chen , Robin Cohen , Lukasz Golab

Hateful and Toxic content has become a significant concern in today's world due to an exponential rise in social media. The increase in hate speech and harmful content motivated researchers to dedicate substantial efforts to the challenging…

Computation and Language · Computer Science 2021-01-25 Suman Dowlagar , Radhika Mamidi

Current multimodal toxicity benchmarks typically use a single binary hatefulness label. This coarse approach conflates two fundamentally different characteristics of expression: tone and content. Drawing on communication science theory, we…

Computation and Language · Computer Science 2026-03-25 Nils A. Herrmann , Tobias Eder , Jingyi He , Georg Groh

Joint embedding (JE) is a way to encode multi-modal data into a vector space where text remains as the grounding key and other modalities like image are to be anchored with such keys. Meme is typically an image with embedded text onto it.…

Machine Learning · Computer Science 2021-12-06 Nethra Gunti , Sathyanarayanan Ramamoorthy , Parth Patwa , Amitava Das

Recent developments in image classification and natural language processing, coupled with the rapid growth in social media usage, have enabled fundamental advances in detecting breaking events around the world in real-time. Emergency…

Machine Learning · Computer Science 2020-04-13 Mahdi Abavisani , Liwei Wu , Shengli Hu , Joel Tetreault , Alejandro Jaimes

Memes have gained popularity as a means to share visual ideas through the Internet and social media by mixing text, images and videos, often for humorous purposes. Research enabling automated analysis of memes has gained attention in recent…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Xiaoyu Guo , Jing Ma , Arkaitz Zubiaga

Hateful memes often require compositional multimodal reasoning: the image and text may appear benign in isolation, yet their interaction conveys harmful intent. Although thinking-based multimodal large language models (MLLMs) have recently…

Computation and Language · Computer Science 2026-03-03 Mohamed Bayan Kmainasi , Mucahid Kutlu , Ali Ezzat Shahroor , Abul Hasnat , Firoj Alam

The prevalence of multi-modal content on social media complicates automated moderation strategies. This calls for an enhancement in multi-modal classification and a deeper understanding of understated meanings in images and memes. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Rongxin Ouyang , Kokil Jaidka , Subhayan Mukerjee , Guangyu Cui

Numerous machine learning (ML) and deep learning (DL)-based approaches have been proposed to utilize textual data from social media for anti-social behavior analysis like cyberbullying, fake news detection, and identification of hate speech…

Computation and Language · Computer Science 2022-12-22 Md. Rezaul Karim , Sumon Kanti Dey , Tanhim Islam , Md. Shajalal , Bharathi Raja Chakravarthi

Hate speech in social media is a growing phenomenon, and detecting such toxic content has recently gained significant traction in the research community. Existing studies have explored fine-tuning language models (LMs) to perform hate…

Computation and Language · Computer Science 2023-03-07 Md Rabiul Awal , Roy Ka-Wei Lee , Eshaan Tanwar , Tanmay Garg , Tanmoy Chakraborty

Online hate speech on social media has become a fast-growing problem in recent times. Nefarious groups have developed large content delivery networks across several main-stream (Twitter and Facebook) and fringe (Gab, 4chan, 8chan, etc.)…

Computation and Language · Computer Science 2020-11-04 Joshua Melton , Arunkumar Bagavathi , Siddharth Krishnan

Hate speech, offensive language, aggression, racism, sexism, and other abusive language are common phenomena in social media. There is a need for Artificial Intelligence(AI)based intervention which can filter hate content at scale. Most…

Computation and Language · Computer Science 2024-11-13 Prashant Kapil , Asif Ekbal

Hate speech has grown into a pervasive phenomenon, intensifying during times of crisis, elections, and social unrest. Multiple approaches have been developed to detect hate speech using artificial intelligence, but a generalized model is…

Computation and Language · Computer Science 2024-10-10 Gautam Kishore Shahi , Tim A. Majchrzak

Internet memes have become a powerful means for individuals to express emotions, thoughts, and perspectives on social media. While often considered as a source of humor and entertainment, memes can also disseminate hateful content targeting…

Computation and Language · Computer Science 2024-09-24 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque , Sarah M. Preum

Humor, deeply rooted in societal meanings and cultural details, poses a unique challenge for machines. While advances have been made in natural language processing, real-world humor often thrives in a multi-modal context, encapsulated…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Yuyan Chen , Songzhou Yan , Zhihong Zhu , Zhixu Li , Yanghua Xiao

The age of social media is flooded with Internet memes, necessitating a clear grasp and effective identification of harmful ones. This task presents a significant challenge due to the implicit meaning embedded in memes, which is not…

Computation and Language · Computer Science 2024-01-25 Hongzhan Lin , Ziyang Luo , Wei Gao , Jing Ma , Bo Wang , Ruichao Yang

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong