English
Related papers

Related papers: ExPO-HM: Learning to Explain-then-Detect for Hatef…

200 papers

Multimodal hateful content detection is a challenging task that requires complex reasoning across visual and textual modalities. Therefore, creating a meaningful multimodal representation that effectively captures the interplay between…

Computation and Language · Computer Science 2024-02-16 Eftekhar Hossain , Omar Sharif , Mohammed Moshiul Hoque , Sarah M. Preum

Reinforcement learning with verifiable rewards (RLVR) has become a powerful paradigm for improving language models on reasoning-intensive tasks, but its effectiveness is often limited by exploration. For example, models often fail on hard…

Machine Learning · Computer Science 2026-05-26 Ruitao Liu , Qinghao Hu , Alex Hu , Yecheng Wu , Shang Yang , Luke J. Huang , Zhuoyang Zhang , Han Cai , Song Han

In the past few years, there has been a surge of interest in multi-modal problems, from image captioning to visual question answering and beyond. In this paper, we focus on hate speech detection in multi-modal memes wherein memes pose an…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Abhishek Das , Japsimar Singh Wahi , Siyao Li

Hateful memes are widespread in social media and convey negative information. The main challenge of hateful memes detection is that the expressive meaning can not be well recognized by a single modality. In order to further integrate modal…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Weibo Zhang , Guihua Liu , Zhuohua Li , Fuqing Zhu

The proliferation of Internet memes in the age of social media necessitates effective identification of harmful ones. Due to the dynamic nature of memes, existing data-driven models may struggle in low-resource scenarios where only a few…

Computation and Language · Computer Science 2024-11-11 Jianzhao Huang , Hongzhan Lin , Ziyan Liu , Ziyang Luo , Guang Chen , Jing Ma

Hateful Meme Challenge proposed by Facebook AI has attracted contestants around the world. The challenge focuses on detecting hateful speech in multimodal memes. Various state-of-the-art deep learning models have been applied to this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Aijing Gao , Bingjun Wang , Jiaqi Yin , Yating Tian

Technological advances in the Internet and online social networks have brought many benefits to humanity. At the same time, this growth has led to an increase in hate speech, the main global threat. To improve the reliability of black-box…

Computation and Language · Computer Science 2026-01-21 Ghislain Dorian Tchuente Mondjo

Among the various modes of communication in social media, the use of Internet memes has emerged as a powerful means to convey political, psychological, and socio-cultural opinions. Although memes are typically humorous in nature, recent…

Computation and Language · Computer Science 2021-10-04 Shraman Pramanick , Dimitar Dimitrov , Rituparna Mukherjee , Shivam Sharma , Md. Shad Akhtar , Preslav Nakov , Tanmoy Chakraborty

Hateful content on social media increasingly appears as multimodal memes that combine images and text to convey harmful narratives. In low-resource languages such as Bengali, automated detection remains challenging due to limited annotated…

Computation and Language · Computer Science 2026-02-24 Raihan Tanvir , Md. Golam Rabiul Alam

Multimodal hate detection, which aims to identify harmful content online such as memes, is crucial for building a wholesome internet environment. Previous work has made enlightening exploration in detecting explicit hate remarks. However,…

Computation and Language · Computer Science 2023-04-25 Linhao Zhang , Li Jin , Xian Sun , Guangluan Xu , Zequn Zhang , Xiaoyu Li , Nayu Liu , Qing Liu , Shiyao Yan

As a multimodal medium combining images and text, memes frequently convey implicit harmful content through metaphors and humor, rendering the detection of harmful memes a complex and challenging task. Although recent studies have made…

Computation and Language · Computer Science 2026-04-02 Hexiang Gu , Qifan Yu , Yuan Liu , Zikang Li , Saihui Hou , Jian Zhao , Zhaofeng He

Hateful meme detection is a new research area recently brought out that requires both visual, linguistic understanding of the meme and some background knowledge to performing well on the task. This technical report summarises the first…

Computation and Language · Computer Science 2020-12-16 Ron Zhu

Large Language Models (LLMs), representing a significant achievement in artificial intelligence (AI) research, have demonstrated their ability in a multitude of tasks. This project aims to explore the capabilities of GPT-3.5, a leading…

Computation and Language · Computer Science 2023-11-02 Jingjing Wang , Joshua Luo , Grace Yang , Allen Hong , Feng Luo

Internet memes are powerful tools for communication, capable of spreading political, psychological, and sociocultural ideas. However, they can be harmful and can be used to disseminate hate toward targeted individuals or groups. Although…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Felix Breiteneder , Mohammad Belal , Muhammad Saad Saeed , Shahed Masoudian , Usman Naseem , Kulshrestha Juhi , Markus Schedl , Shah Nawaz

Internet memes have gained significant influence in communicating political, psychological, and sociocultural ideas. While memes are often humorous, there has been a rise in the use of memes for trolling and cyberbullying. Although a wide…

Computation and Language · Computer Science 2024-01-19 Prince Jha , Krishanu Maity , Raghav Jain , Apoorv Verma , Sriparna Saha , Pushpak Bhattacharyya

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, whose explanation quality can be…

Machine Learning · Computer Science 2020-11-10 Gregory Plumb , Maruan Al-Shedivat , Angel Alexander Cabrera , Adam Perer , Eric Xing , Ameet Talwalkar

Implicit hate speech has recently emerged as a critical challenge for social media platforms. While much of the research has traditionally focused on harmful speech in general, the need for generalizable techniques to detect veiled and…

Computation and Language · Computer Science 2025-06-23 Saad Almohaimeed , Saleh Almohaimeed , Damla Turgut , Ladislau Bölöni

Hate speech is a challenging issue plaguing the online social media. While better models for hate speech detection are continuously being developed, there is little research on the bias and interpretability aspects of hate speech. In this…

Computation and Language · Computer Science 2022-04-13 Binny Mathew , Punyajoy Saha , Seid Muhie Yimam , Chris Biemann , Pawan Goyal , Animesh Mukherjee

Supervised fine-tuning (SFT) is the standard approach for binary classification tasks such as toxicity detection, factuality verification, and causal inference. However, SFT often performs poorly in real-world settings with label noise,…

Machine Learning · Computer Science 2026-02-04 Punya Syon Pandey , Zhijing Jin

Internet memes have emerged as an increasingly popular means of communication on the Web. Although typically intended to elicit humour, they have been increasingly used to spread hatred, trolling, and cyberbullying, as well as to target…

Computation and Language · Computer Science 2022-05-13 Shivam Sharma , Md. Shad Akhtar , Preslav Nakov , Tanmoy Chakraborty