中文
相关论文

相关论文: Align before Attend: Aligning Visual and Textual F…

200 篇论文

The proliferation of multimodal content on social media presents significant challenges in understanding and moderating complex, context-dependent issues such as misinformation, hate speech, and propaganda. While efforts have been made to…

计算与语言 · 计算机科学 2026-03-03 Mohamed Bayan Kmainasi , Abul Hasnat , Md Arid Hasan , Ali Ezzat Shahroor , Firoj Alam

This research introduces a novel approach to textual and multimodal Hate Speech Detection (HSD), using Large Language Models (LLMs) as dynamic knowledge bases to generate background context and incorporate it into the input of HSD…

计算与语言 · 计算机科学 2025-10-20 Joshua Wolfe Brook , Ilia Markov

Social media memes are a challenging domain for hate detection because they intertwine visual and textual cues into culturally nuanced messages. To tackle these challenges, we introduce TRACE, a hierarchical multimodal framework that…

计算机视觉与模式识别 · 计算机科学 2025-11-10 Girish A. Koushik , Helen Treharne , Aditya Joshi , Diptesh Kanojia

Detecting hate speech in online content is essential to ensuring safer digital spaces. While significant progress has been made in text and meme modalities, video-based hate speech detection remains under-explored, hindered by a lack of…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Han Wang , Rui Yang Tan , Roy Ka-Wei Lee

The widespread presence of hate speech on the internet, including formats such as text-based tweets and vision-language memes, poses a significant challenge to digital platform safety. Recent research has developed detection models tailored…

计算与语言 · 计算机科学 2024-10-10 Ming Shan Hee , Aditi Kumaresan , Roy Ka-Wei Lee

Hateful memes often require compositional multimodal reasoning: the image and text may appear benign in isolation, yet their interaction conveys harmful intent. Although thinking-based multimodal large language models (MLLMs) have recently…

计算与语言 · 计算机科学 2026-03-03 Mohamed Bayan Kmainasi , Mucahid Kutlu , Ali Ezzat Shahroor , Abul Hasnat , Firoj Alam

Hate speech detection on social media faces challenges in both accuracy and explainability, especially for underexplored Indic languages. We propose a novel explainability-guided training framework, X-MuTeST (eXplainable Multilingual haTe…

Multimodal hate detection, which aims to identify harmful content online such as memes, is crucial for building a wholesome internet environment. Previous work has made enlightening exploration in detecting explicit hate remarks. However,…

计算与语言 · 计算机科学 2023-04-25 Linhao Zhang , Li Jin , Xian Sun , Guangluan Xu , Zequn Zhang , Xiaoyu Li , Nayu Liu , Qing Liu , Shiyao Yan

Internet memes have become a dominant method of communication; at the same time, however, they are also increasingly being used to advocate extremism and foster derogatory beliefs. Nonetheless, we do not have a firm understanding as to…

The automated detection of sexism in memes is a challenging task due to multimodal ambiguity, cultural nuance, and the use of humor to provide plausible deniability. Content-only models often fail to capture the complexity of human…

人机交互 · 计算机科学 2026-03-02 Iván Arcos , Paolo Rosso , Elena Gomis-Vicent

The detection of offensive, hateful and profane language has become a critical challenge since many users in social networks are exposed to cyberbullying activities on a daily basis. In this paper, we present an analysis of combining…

计算与语言 · 计算机科学 2021-12-10 Sherzod Hakimov , Ralph Ewerth

The prevalence of multi-modal content on social media complicates automated moderation strategies. This calls for an enhancement in multi-modal classification and a deeper understanding of understated meanings in images and memes. Although…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Rongxin Ouyang , Kokil Jaidka , Subhayan Mukerjee , Guangyu Cui

With growing role of social media in shaping public opinions and beliefs across the world, there has been an increased attention to identify and counter the problem of hate speech on social media. Hate speech on online spaces has serious…

计算与语言 · 计算机科学 2021-03-03 Prashanth Vijayaraghavan , Hugo Larochelle , Deb Roy

Hate speech detection is a challenging natural language processing task that requires capturing linguistic and contextual nuances. Pre-trained language models (PLMs) offer rich semantic representations of text that can improve this task.…

计算与语言 · 计算机科学 2023-10-10 Mohammad Aflah Khan , Neemesh Yadav , Mohit Jain , Sanyam Goyal

Hate speech is a societal problem that has significantly grown through the Internet. New forms of digital content such as image memes have given rise to spread of hate using multimodal means, being far more difficult to analyse and detect…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Christos Koutlis , Manos Schinas , Symeon Papadopoulos

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

计算与语言 · 计算机科学 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

In this work we target the problem of hate speech detection in multimodal publications formed by a text and an image. We gather and annotate a large scale dataset from Twitter, MMHS150K, and propose different models that jointly analyze…

计算机视觉与模式识别 · 计算机科学 2019-10-10 Raul Gomez , Jaume Gibert , Lluis Gomez , Dimosthenis Karatzas

Multi-modal learning has emerged as a crucial research direction, as integrating textual and visual information can substantially enhance performance in tasks such as classification, retrieval, and scene understanding. Despite advances with…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Md. Mithun Hossain , Md. Shakil Hossain , Sudipto Chaki , M. F. Mridha

Detecting hate speech in memes is challenging due to their multimodal nature and subtle, culturally grounded cues such as sarcasm and context. While recent vision-language models (VLMs) enable joint reasoning over text and images,…

计算与语言 · 计算机科学 2026-04-29 Ivo Bueno , Lea Hirlimann , Enkelejda Kasneci

Combating hate speech on social media is critical for securing cyberspace, yet relies heavily on the efficacy of automated detection systems. As content formats evolve, hate speech is transitioning from solely plain text to complex…

计算与语言 · 计算机科学 2026-04-22 Runze Sun , Yu Zheng , Zexuan Xiong , Zhongjin Qu , Lei Chen , Jie Zhou , Jiwen Lu