中文
相关论文

相关论文: Exploring the Limits of Zero Shot Vision Language …

200 篇论文

Hateful memes often require compositional multimodal reasoning: the image and text may appear benign in isolation, yet their interaction conveys harmful intent. Although thinking-based multimodal large language models (MLLMs) have recently…

计算与语言 · 计算机科学 2026-03-03 Mohamed Bayan Kmainasi , Mucahid Kutlu , Ali Ezzat Shahroor , Abul Hasnat , Firoj Alam

The age of social media is rife with memes. Understanding and detecting harmful memes pose a significant challenge due to their implicit meaning that is not explicitly conveyed through the surface text and image. However, existing harmful…

计算与语言 · 计算机科学 2023-12-12 Hongzhan Lin , Ziyang Luo , Jing Ma , Long Chen

Vision-Language Models (VLMs) have gained considerable prominence in recent years due to their remarkable capability to effectively integrate and process both textual and visual information. This integration has significantly enhanced…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Aobotao Dai , Xinyu Ma , Lei Chen , Songze Li , Lin Wang

In the evolving landscape of online communication, hate speech detection remains a formidable challenge, further compounded by the diversity of digital platforms. This study investigates the effectiveness and adaptability of pre-trained and…

计算与语言 · 计算机科学 2025-05-01 Ahmad Nasir , Aadish Sharma , Kokil Jaidka , Saifuddin Ahmed

Internet memes have emerged as a popular multimodal medium, yet they are increasingly weaponized to convey harmful opinions through subtle rhetorical devices like irony and metaphor. Existing detection approaches, including Multimodal Large…

机器学习 · 计算机科学 2026-04-17 Wenshuo Wang , Ziyou Jiang , Junjie Wang , Mingyang Li , Jie Huang , Yuekai Huang , Zhiyuan Chang , Feiyan Duan , Qing Wang

The prevalence of multi-modal content on social media complicates automated moderation strategies. This calls for an enhancement in multi-modal classification and a deeper understanding of understated meanings in images and memes. Although…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Rongxin Ouyang , Kokil Jaidka , Subhayan Mukerjee , Guangyu Cui

Toxicity identification in online multimodal environments remains a challenging task due to the complexity of contextual connections across modalities (e.g., textual and visual). In this paper, we propose a novel framework that integrates…

机器学习 · 计算机科学 2026-02-18 Rahul Garg , Trilok Padhi , Hemang Jain , Ugur Kursuncu , Ponnurangam Kumaraguru

The rise in the number of social media users has led to an increase in the hateful content posted online. In countries like India, where multiple languages are spoken, these abhorrent posts are from an unusual blend of code-switched…

机器学习 · 计算机科学 2022-04-26 Kshitij Rajput , Raghav Kapoor , Kaushal Rai , Preeti Kaur

Warning: this paper contains content that may be offensive or upsetting Hate speech moderation on global platforms poses unique challenges due to the multimodal and multilingual nature of content, along with the varying cultural…

计算与语言 · 计算机科学 2025-02-18 Minh Duc Bui , Katharina von der Wense , Anne Lauscher

The proliferation of hate speech on social media platforms has necessitated the development of effective detection and moderation tools. This study evaluates the efficacy of various machine learning models in identifying hate speech and…

计算与语言 · 计算机科学 2026-02-25 Saurabh Mishra , Shivani Thakur , Radhika Mamidi

Despite growing interest in automated hate speech detection, most existing approaches overlook the linguistic diversity of online content. Multilingual instruction-tuned large language models such as LLaMA, Aya, Qwen, and BloomZ offer…

计算与语言 · 计算机科学 2025-05-27 Faeze Ghorbanpour , Daryna Dementieva , Alexander Fraser

Memes have emerged as a popular form of multimodal online communication, where their interpretation heavily depends on the specific context in which they appear. Current approaches predominantly focus on isolated meme analysis, either for…

The proliferation of multimodal content on social media presents significant challenges in understanding and moderating complex, context-dependent issues such as misinformation, hate speech, and propaganda. While efforts have been made to…

计算与语言 · 计算机科学 2026-03-03 Mohamed Bayan Kmainasi , Abul Hasnat , Md Arid Hasan , Ali Ezzat Shahroor , Firoj Alam

Hate speech in social media is a growing phenomenon, and detecting such toxic content has recently gained significant traction in the research community. Existing studies have explored fine-tuning language models (LMs) to perform hate…

计算与语言 · 计算机科学 2023-03-07 Md Rabiul Awal , Roy Ka-Wei Lee , Eshaan Tanwar , Tanmay Garg , Tanmoy Chakraborty

Image memes and specifically their widely-known variation image macros, is a special new media type that combines text with images and is used in social media to playfully or subtly express humour, irony, sarcasm and even hate. It is…

计算机视觉与模式识别 · 计算机科学 2023-01-23 Christos Koutlis , Manos Schinas , Symeon Papadopoulos

Detecting hate speech in online content is essential to ensuring safer digital spaces. While significant progress has been made in text and meme modalities, video-based hate speech detection remains under-explored, hindered by a lack of…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Han Wang , Rui Yang Tan , Roy Ka-Wei Lee

The automatic identification of harmful content online is of major concern for social media platforms, policymakers, and society. Researchers have studied textual, visual, and audio content, but typically in isolation. Yet, harmful content…

The prevalence of harmful content on social media platforms poses significant risks to users and society, necessitating more effective and scalable content moderation strategies. Current approaches rely on human moderators, supervised…

计算与语言 · 计算机科学 2025-01-27 Akash Bonagiri , Lucen Li , Rajvardhan Oak , Zeerak Babar , Magdalena Wojcieszak , Anshuman Chhabra

The contemporary phenomenon of deepfakes, utilizing GAN or diffusion models for face swapping, presents a substantial and evolving threat in digital media, identity verification, and a multitude of other systems. The majority of existing…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Viacheslav Pirogov

Meme-based social abuse detection is challenging because harmful intent often relies on implicit cultural symbolism and subtle cross-modal incongruence. Prior approaches, from fusion-based methods to in-context learning with Large…

计算与语言 · 计算机科学 2026-02-04 Sahil Tripathi , Gautam Siddharth Kashyap , Mehwish Nasim , Jian Yang , Jiechao Gao , Usman Naseem