中文
相关论文

相关论文: Robust Adaptation of Large Multimodal Models for R…

200 篇论文

With growing role of social media in shaping public opinions and beliefs across the world, there has been an increased attention to identify and counter the problem of hate speech on social media. Hate speech on online spaces has serious…

计算与语言 · 计算机科学 2021-03-03 Prashanth Vijayaraghavan , Hugo Larochelle , Deb Roy

Hate speech in social media is a growing phenomenon, and detecting such toxic content has recently gained significant traction in the research community. Existing studies have explored fine-tuning language models (LMs) to perform hate…

计算与语言 · 计算机科学 2023-03-07 Md Rabiul Awal , Roy Ka-Wei Lee , Eshaan Tanwar , Tanmay Garg , Tanmoy Chakraborty

Hate speech in online videos is posing an increasingly serious threat to digital platforms, especially as video content becomes increasingly multimodal and context-dependent. Existing methods often struggle to effectively fuse the complex…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Shuonan Yang , Tailin Chen , Jiangbei Yue , Guangliang Cheng , Jianbo Jiao , Zeyu Fu

A substantial portion of offensive content on social media is directed towards women. Since the approaches for general offensive content detection face a challenge in detecting misogynistic content, it requires solutions tailored to address…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Mohammad Zia Ur Rehman , Sufyaan Zahoor , Areeb Manzoor , Musharaf Maqbool , Nagendra Kumar

Recent advances in instruction tuning have led to the development of State-of-the-Art Large Multimodal Models (LMMs). Given the novelty of these models, the impact of visual adversarial attacks on LMMs has not been thoroughly examined. We…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Xuanming Cui , Alejandro Aparcedo , Young Kyun Jang , Ser-Nam Lim

Hate speech online targets individuals or groups based on identity attributes and spreads rapidly, posing serious social risks. Memes, which combine images and text, have emerged as a nuanced vehicle for disseminating hate speech, often…

多智能体系统 · 计算机科学 2026-03-26 Rui Xing , Qi Chai , Jie Ma , Jing Tao , Pinghui Wang , Shuming Zhang , Xinping Wang , Hao Wang

Modern large language models become multimodal, analyzing various data formats like text and images. While fine-tuning is effective for adapting these multimodal language models (MLMs) to downstream tasks, full fine-tuning is…

计算与语言 · 计算机科学 2025-12-01 Alexander Sergeev , Evgeny Kotelnikov

Traditional online content moderation systems struggle to classify modern multimodal means of communication, such as memes, a highly nuanced and information-dense medium. This task is especially hard in a culturally diverse society like…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Cao Yuxuan , Wu Jiayang , Alistair Cheong Liang Chuen , Bryan Shan Guanrong , Theodore Lee Chong Jen , Sherman Chann Zhi Shen

This research introduces a novel approach to textual and multimodal Hate Speech Detection (HSD), using Large Language Models (LLMs) as dynamic knowledge bases to generate background context and incorporate it into the input of HSD…

计算与语言 · 计算机科学 2025-10-20 Joshua Wolfe Brook , Ilia Markov

The advent of social media has given rise to numerous ethical challenges, with hate speech among the most significant concerns. Researchers are attempting to tackle this problem by leveraging hate-speech detection and employing language…

计算与语言 · 计算机科学 2023-05-31 Pranath Reddy Kumbam , Sohaib Uddin Syed , Prashanth Thamminedi , Suhas Harish , Ian Perera , Bonnie J. Dorr

Existing self-supervised learning strategies are constrained to either a limited set of objectives or generic downstream tasks that predominantly target uni-modal applications. This has isolated progress for imperative multi-modal…

计算与语言 · 计算机科学 2022-09-30 Shivam Sharma , Mohd Khizir Siddiqui , Md. Shad Akhtar , Tanmoy Chakraborty

With the widespread online social networks, hate speeches are spreading faster and causing more damage than ever before. Existing hate speech detection methods have limitations in several aspects, such as handling data insufficiency,…

计算与语言 · 计算机科学 2024-09-27 Guanyi Mou , Kyumin Lee

Large Language Models (LLMs) have raised increasing concerns about their misuse in generating hate speech. Among all the efforts to address this issue, hate speech detectors play a crucial role. However, the effectiveness of different…

密码学与安全 · 计算机科学 2025-01-29 Xinyue Shen , Yixin Wu , Yiting Qu , Michael Backes , Savvas Zannettou , Yang Zhang

Accurate detection and classification of online hate is a difficult task. Implicit hate is particularly challenging as such content tends to have unusual syntax, polysemic words, and fewer markers of prejudice (e.g., slurs). This problem is…

计算与语言 · 计算机科学 2021-06-11 Austin Botelho , Bertie Vidgen , Scott A. Hale

Hateful meme classification is a challenging multimodal task that requires complex reasoning and contextual background knowledge. Ideally, we could leverage an explicit external knowledge base to supplement contextual and cultural…

计算与语言 · 计算机科学 2023-02-09 Rui Cao , Roy Ka-Wei Lee , Wen-Haw Chong , Jing Jiang

Detecting hate speech in online content is essential to ensuring safer digital spaces. While significant progress has been made in text and meme modalities, video-based hate speech detection remains under-explored, hindered by a lack of…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Han Wang , Rui Yang Tan , Roy Ka-Wei Lee

Large Language Models (LLMs) remain vulnerable to multi-turn jailbreak attacks. We introduce HarmNet, a modular framework comprising ThoughtNet, a hierarchical semantic network; a feedback-driven Simulator for iterative query refinement;…

密码学与安全 · 计算机科学 2025-10-22 Sidhant Narula , Javad Rafiei Asl , Mohammad Ghasemigol , Eduardo Blanco , Daniel Takabi

There is a rapid increase in the use of multimedia content in current social media platforms. One of the highly popular forms of such multimedia content are memes. While memes have been primarily invented to promote funny and buoyant…

Hateful content on social media increasingly appears as multimodal memes that combine images and text to convey harmful narratives. In low-resource languages such as Bengali, automated detection remains challenging due to limited annotated…

计算与语言 · 计算机科学 2026-02-24 Raihan Tanvir , Md. Golam Rabiul Alam

With the continuous emergence of various social media platforms frequently used in daily life, the multimodal meme understanding (MMU) task has been garnering increasing attention. MMU aims to explore and comprehend the meanings of memes…

计算与语言 · 计算机科学 2025-03-18 Li Zheng , Hao Fei , Ting Dai , Zuquan Peng , Fei Li , Huisheng Ma , Chong Teng , Donghong Ji