English
Related papers

Related papers: MER-Bench: A Comprehensive Benchmark for Multimoda…

200 papers

Memes are used for spreading ideas through social networks. Although most memes are created for humor, some memes become hateful under the combination of pictures and text. Automatically detecting the hateful memes can help reduce their…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Yi Zhou , Zhenhao Chen

The proliferation of memes on social media necessitates the capabilities of multimodal Large Language Models (mLLMs) to effectively understand multimodal harmfulness. Existing evaluation approaches predominantly focus on mLLMs' detection…

Computation and Language · Computer Science 2025-11-03 Zixin Chen , Hongzhan Lin , Kaixin Li , Ziyang Luo , Yayue Deng , Jing Ma

An increasingly common expression of online hate speech is multimodal in nature and comes in the form of memes. Designing systems to automatically detect hateful content is of paramount importance if we are to mitigate its undesirable…

Memes act as cryptic tools for sharing sensitive ideas, often requiring contextual knowledge to interpret. This makes moderating multimodal memes challenging, as existing works either lack high-quality datasets on nuanced hate categories or…

Computation and Language · Computer Science 2024-12-31 Palash Nandi , Shivam Sharma , Tanmoy Chakraborty

Memes have become an ubiquitous social media entity and the processing and analysis of suchmultimodal data is currently an active area of research. This paper presents our work on theMemotion Analysis shared task of SemEval 2020, which…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Pradyumna Gupta , Himanshu Gupta , Aman Sinha

Memes have emerged as a powerful form of communication, integrating visual and textual elements to convey humor, satire, and cultural messages. Existing research has focused primarily on aspects such as emotion classification, meme…

Machine Learning · Computer Science 2025-01-24 Shiling Deng , Serge Belongie , Peter Ebert Christensen

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

Multimedia · Computer Science 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

Hate speech online targets individuals or groups based on identity attributes and spreads rapidly, posing serious social risks. Memes, which combine images and text, have emerged as a nuanced vehicle for disseminating hate speech, often…

Multiagent Systems · Computer Science 2026-03-26 Rui Xing , Qi Chai , Jie Ma , Jing Tao , Pinghui Wang , Shuming Zhang , Xinping Wang , Hao Wang

Memes have evolved as a prevalent medium for diverse communication, ranging from humour to propaganda. With the rising popularity of image-focused content, there is a growing need to explore its potential harm from different aspects.…

Computation and Language · Computer Science 2024-05-21 Siddhant Agarwal , Shivam Sharma , Preslav Nakov , Tanmoy Chakraborty

Memes have become a dominant form of communication in social media in recent years. Memes are typically humorous and harmless, however there are also memes that promote hate speech, being in this way harmful to individuals and groups based…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Maria Tzelepi , Vasileios Mezaris

Memes are popular in the modern world and are distributed primarily for entertainment. However, harmful ideologies such as misogyny can be propagated through innocent-looking memes. The detection and understanding of why a meme is…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Kushal Kanwar , Dushyant Singh Chauhan , Gopendra Vikram Singh , Asif Ekbal

The rise of social media platforms has brought about a new digital culture called memes. Memes, which combine visuals and text, can strongly influence public opinions on social and cultural issues. As a result, people have become interested…

Computation and Language · Computer Science 2023-12-12 Ming Shan Hee , Aditi Kumaresan , Nguyen Khoi Hoang , Nirmalendu Prakash , Rui Cao , Roy Ka-Wei Lee

Internet memes represent a popular form of multimodal online communication and often use figurative elements to convey layered meaning through the combination of text and images. However, it remains largely unclear how multimodal large…

Computation and Language · Computer Science 2026-03-25 Shijia Zhou , Saif M. Mohammad , Barbara Plank , Diego Frassinelli

Memes are a popular form of communicating trends and ideas in social media and on the internet in general, combining the modalities of images and text. They can express humor and sarcasm but can also have offensive content. Analyzing and…

Recent technological advancements in the Internet and Social media usage have resulted in the evolution of faster and efficient platforms of communication. These platforms include visual, textual and speech mediums and have brought a unique…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Sunil Gundapu , Radhika Mamidi

The furnishing of multi-modal large language models (MLLMs) has led to the emergence of numerous benchmark studies, particularly those evaluating their perception and understanding capabilities. Among these, understanding image-evoked…

Multimedia · Computer Science 2025-09-18 Lancheng Gao , Ziheng Jia , Yunhao Zeng , Wei Sun , Yiming Zhang , Wei Zhou , Guangtao Zhai , Xiongkuo Min

Memes are one of the most popular types of content used to spread information online. They can influence a large number of people through rhetorical and psychological techniques. The task, Detection of Persuasion Techniques in Texts and…

Computation and Language · Computer Science 2021-06-02 Kshitij Gupta , Devansh Gautam , Radhika Mamidi

Artificial Intelligence (AI) has demonstrated significant capabilities in various fields, and in areas such as human-computer interaction (HCI), embodied intelligence, and the design and animation of virtual digital humans, both…

Computation and Language · Computer Science 2024-11-19 Yingjie Zhou , Zicheng Zhang , Jiezhang Cao , Jun Jia , Yanwei Jiang , Farong Wen , Xiaohong Liu , Xiongkuo Min , Guangtao Zhai

The rapid integration of Large Vision-Language Models (LVLMs) into critical domains necessitates comprehensive moral evaluation to ensure their alignment with human values. While extensive research has addressed moral evaluation in LLMs,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Bei Yan , Jie Zhang , Zhiyuan Chen , Shiguang Shan , Xilin Chen

Image-with-text memes combine text with imagery to achieve comedy, but in today's world, they also play a pivotal role in online communication, influencing politics, marketing, and social norms. A "meme template" is a preexisting layout or…

Computers and Society · Computer Science 2024-08-16 Levente Murgás , Marcell Nagy , Kate Barnes , Roland Molontay