English
Related papers

Related papers: Align before Attend: Aligning Visual and Textual F…

200 papers

Digital platforms have an ever-expanding user base, and act as a hub for communication, business, and connectivity. However, this has also allowed for the spread of hate speech and misogyny. Artificial intelligence models have emerged as an…

Artificial Intelligence · Computer Science 2026-01-14 Sargam Yadav , Abhishek Kaushik , Kevin Mc Daid

Hateful content detection is one of the areas where deep learning can and should make a significant difference. The Hateful Memes Challenge from Facebook helps fulfill such potential by challenging the contestants to detect hateful speech…

Machine Learning · Computer Science 2021-06-23 Yang Li , Zinc Zhang , Hutchin Huang

Hateful Memes is a new challenge set for multimodal classification, focusing on detecting hate speech in multimodal memes. Difficult examples are added to the dataset to make it hard to rely on unimodal signals, which means only multimodal…

Computation and Language · Computer Science 2020-12-03 Xiayu Zhong

Weakly supervised violence detection refers to the technique of training models to identify violent segments in videos using only video-level labels. Among these approaches, multimodal violence detection, which integrates modalities such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Wenping Jin , Li Zhu , Jing Sun

Warning: this paper contains content that may be offensive or upsetting Hate speech moderation on global platforms poses unique challenges due to the multimodal and multilingual nature of content, along with the varying cultural…

Computation and Language · Computer Science 2025-02-18 Minh Duc Bui , Katharina von der Wense , Anne Lauscher

The automatic identification of offensive language such as hate speech is important to keep discussions civil in online communities. Identifying hate speech in multimodal content is a particularly challenging task because offensiveness can…

Computation and Language · Computer Science 2024-02-20 Amrita Ganguly , Al Nahian Bin Emran , Sadiya Sayara Chowdhury Puspo , Md Nishat Raihan , Dhiman Goswami , Marcos Zampieri

Due to the wide adoption of social media platforms like Facebook, Twitter, etc., there is an emerging need of detecting online posts that can go against the community acceptance standards. The hostility detection task has been well explored…

Computation and Language · Computer Science 2021-01-14 Arkadipta De , Venkatesh E , Kaushal Kumar Maurya , Maunendra Sankar Desarkar

Internet memes have become a dominant form of expression on social media, including within the Bengali-speaking community. While often humorous, memes can also be exploited to spread offensive, harmful, and inflammatory content targeting…

Computation and Language · Computer Science 2026-02-27 Rakib Ullah , Mominul islam , Md Sanjid Hossain , Md Ismail Hossain

Memes act as cryptic tools for sharing sensitive ideas, often requiring contextual knowledge to interpret. This makes moderating multimodal memes challenging, as existing works either lack high-quality datasets on nuanced hate categories or…

Computation and Language · Computer Science 2024-12-31 Palash Nandi , Shivam Sharma , Tanmoy Chakraborty

The detection of offensive, hateful content on social media is a challenging problem that affects many online users on a daily basis. Hateful content is often used to target a group of people based on ethnicity, gender, religion and other…

Computation and Language · Computer Science 2022-04-14 Sherzod Hakimov , Gullal S. Cheema , Ralph Ewerth

Social media platforms are increasingly dominated by long-form multimodal content, where harmful narratives are constructed through a complex interplay of audio, visual, and textual cues. While automated systems can flag hate speech with…

Artificial Intelligence · Computer Science 2026-05-29 Girish A. Koushik , Helen Treharne , Diptesh Kanojia

With the continuous emergence of various social media platforms frequently used in daily life, the multimodal meme understanding (MMU) task has been garnering increasing attention. MMU aims to explore and comprehend the meanings of memes…

Computation and Language · Computer Science 2025-03-18 Li Zheng , Hao Fei , Ting Dai , Zuquan Peng , Fei Li , Huisheng Ma , Chong Teng , Donghong Ji

Online hate remains a significant societal challenge, especially as multimodal content enables subtle, culturally grounded, and implicit forms of harm. Hateful memes embed hostility through text-image interactions and humor, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sahajpreet Singh , Kokil Jaidka , Subhayan Mukerjee

Memes convey meaning through the interaction of visual and textual signals, often combining humor, irony, and offense in subtle ways. Detecting harmful or sensitive content in memes requires accurate modeling of these multimodal cues.…

Computation and Language · Computer Science 2026-04-29 Qiyuan Jin

Memes have become a dominant form of communication in social media in recent years. Memes are typically humorous and harmless, however there are also memes that promote hate speech, being in this way harmful to individuals and groups based…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Maria Tzelepi , Vasileios Mezaris

This paper introduces a novel multimodal framework for hate speech detection in deepfake audio, excelling even in zero-shot scenarios. Unlike previous approaches, our method uses contrastive learning to jointly align audio and text…

Sound · Computer Science 2025-06-11 Rishabh Ranjan , Likhith Ayinala , Mayank Vatsa , Richa Singh

Hate speech is a pressing issue in modern society, with significant effects both online and offline. Recent research in hate speech detection has primarily centered on text-based media, largely overlooking multimodal content such as videos.…

Multimedia · Computer Science 2024-08-13 Han Wang , Tan Rui Yang , Usman Naseem , Roy Ka-Wei Lee

Text-embedded images can serve as a means of spreading hate speech, propaganda, and extremist beliefs. Throughout the Russia-Ukraine war, both opposing factions heavily relied on text-embedded images as a vehicle for spreading propaganda…

Computation and Language · Computer Science 2023-07-27 Umitcan Sahin , Izzet Emre Kucukkaya , Oguzhan Ozcelik , Cagri Toraman

Despite growing efforts to halt distasteful content on social media, multilingualism has added a new dimension to this problem. The scarcity of resources makes the challenge even greater when it comes to low-resource languages. This work…

Social and Information Networks · Computer Science 2024-10-30 Mohammad Zia Ur Rehman , Somya Mehta , Kuldeep Singh , Kunal Kaushik , Nagendra Kumar

Digital forensic investigations increasingly rely on heterogeneous evidence such as images, scanned documents, and contextual reports. These artifacts may contain explicit or implicit expressions of harm, hate, threat, violence, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Ponkoj Chandra Shill