English
Related papers

Related papers: MemeBLIP2: A novel lightweight multimodal system t…

200 papers

Internet memes have become a powerful means for individuals to express emotions, thoughts, and perspectives on social media. While often considered as a source of humor and entertainment, memes can also disseminate hateful content targeting…

Computation and Language · Computer Science 2024-09-24 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque , Sarah M. Preum

Internet Memes remain a challenging form of user-generated content for automated sentiment classification. The availability of labelled memes is a barrier to developing sentiment classifiers of multimodal memes. To address the shortage of…

Computation and Language · Computer Science 2025-08-08 Muzhaffar Hazman , Susan McKeever , Josephine Griffith

The dynamic expansion of social media has led to an inundation of hateful memes on media platforms, accentuating the growing need for efficient identification and removal. Acknowledging the constraints of conventional multimodal hateful…

Computation and Language · Computer Science 2025-03-06 Junxi Liu , Yanyan Feng , Jiehai Chen , Yun Xue , Fenghuan Li

Sarcasm detection identifies natural language expressions whose intended meaning is different from what is implied by its surface meaning. It finds applications in many NLP tasks such as opinion mining, sentiment analysis, etc. Today,…

Multimedia · Computer Science 2021-10-04 Sundesh Gupta , Aditya Shah , Miten Shah , Laribok Syiemlieh , Chandresh Maurya

Traditional online content moderation systems struggle to classify modern multimodal means of communication, such as memes, a highly nuanced and information-dense medium. This task is especially hard in a culturally diverse society like…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Cao Yuxuan , Wu Jiayang , Alistair Cheong Liang Chuen , Bryan Shan Guanrong , Theodore Lee Chong Jen , Sherman Chann Zhi Shen

Toxicity detection in multimodal text-image content faces growing challenges, especially with multimodal implicit toxicity, where each modality appears benign on its own but conveys hazard when combined. Multimodal implicit toxicity appears…

Multimedia · Computer Science 2025-05-21 Shiyao Cui , Qinglin Zhang , Xuan Ouyang , Renmiao Chen , Zhexin Zhang , Yida Lu , Hongning Wang , Han Qiu , Minlie Huang

We describe our approach for SemEval-2021 task 6 on detection of persuasion techniques in multimodal content (memes). Our system combines pretrained multimodal models (CLIP) and chained classifiers. Also, we propose to enrich the data by a…

Computation and Language · Computer Science 2021-06-01 Erfan Ghadery , Damien Sileo , Marie-Francine Moens

This paper has been accepted in the NeurIPS 2024 D & B Track. Harmful memes have proliferated on the Chinese Internet, while research on detecting Chinese harmful memes significantly lags behind due to the absence of reliable datasets and…

Computation and Language · Computer Science 2024-10-04 Junyu Lu , Bo Xu , Xiaokun Zhang , Hongbo Wang , Haohao Zhu , Dongyu Zhang , Liang Yang , Hongfei Lin

Social media platforms are increasingly dominated by long-form multimodal content, where harmful narratives are constructed through a complex interplay of audio, visual, and textual cues. While automated systems can flag hate speech with…

Artificial Intelligence · Computer Science 2026-05-29 Girish A. Koushik , Helen Treharne , Diptesh Kanojia

Social media memes are a challenging domain for hate detection because they intertwine visual and textual cues into culturally nuanced messages. To tackle these challenges, we introduce TRACE, a hierarchical multimodal framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Girish A. Koushik , Helen Treharne , Aditya Joshi , Diptesh Kanojia

Multi-Modal Language Models (MLLMs) have transformed artificial intelligence by combining visual and text data, making applications like image captioning, visual question answering, and multi-modal content creation possible. This ability to…

Cryptography and Security · Computer Science 2024-11-11 Pete Janowczyk , Linda Laurier , Ave Giulietta , Arlo Octavia , Meade Cleti

Meme is an interesting word. Internet memes offer unique insights into the changes in our perception of the world, the media and our own lives. If you surf the Internet for long enough, you will see it somewhere on the Internet. With the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Zhiyuan Liu , Chuanzheng Sun , Yuxin Jiang , Shiqi Jiang , Mei Ming

Warning: This paper contains memes that may be offensive to some readers. Multimodal Internet Memes are now a ubiquitous fixture in online discourse. One strand of meme-based research is the classification of memes according to various…

Machine Learning · Computer Science 2025-07-04 Muzhaffar Hazman , Susan McKeever , Josephine Griffith

Recent technological advancements in the Internet and Social media usage have resulted in the evolution of faster and efficient platforms of communication. These platforms include visual, textual and speech mediums and have brought a unique…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Sunil Gundapu , Radhika Mamidi

Hateful meme detection is a new research area recently brought out that requires both visual, linguistic understanding of the meme and some background knowledge to performing well on the task. This technical report summarises the first…

Computation and Language · Computer Science 2020-12-16 Ron Zhu

The spread of fake news, propaganda, misinformation, disinformation, and harmful content online raised concerns among social media platforms, government agencies, policymakers, and society as a whole. This is because such harmful or abusive…

Computation and Language · Computer Science 2022-05-10 Rabindra Nath Nandi , Firoj Alam , Preslav Nakov

Accurate detection and classification of online hate is a difficult task. Implicit hate is particularly challenging as such content tends to have unusual syntax, polysemic words, and fewer markers of prejudice (e.g., slurs). This problem is…

Computation and Language · Computer Science 2021-06-11 Austin Botelho , Bertie Vidgen , Scott A. Hale

In the past decade, social media platforms have been used for information dissemination and consumption. While a major portion of the content is posted to promote citizen journalism and public awareness, some content is posted to mislead…

Computation and Language · Computer Science 2024-10-08 Firoj Alam , Md. Rafiul Biswas , Uzair Shah , Wajdi Zaghouani , Georgios Mikros

Vision-language pre-training like CLIP has shown promising performance on various downstream tasks such as zero-shot image classification and image-text retrieval. Most of the existing CLIP-alike works usually adopt relatively large image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Ying Nie , Wei He , Kai Han , Yehui Tang , Tianyu Guo , Fanyi Du , Yunhe Wang

This paper describes our two-stage system for the Euphemism Detection shared task hosted by the 3rd Workshop on Figurative Language Processing in conjunction with EMNLP 2022. Euphemisms tone down expressions about sensitive or unpleasant…

Computation and Language · Computer Science 2022-11-10 İlker Kesen , Aykut Erdem , Erkut Erdem , Iacer Calixto