中文
相关论文

相关论文: Robust Adaptation of Large Multimodal Models for R…

200 篇论文

State-of-the-art image and text classification models, such as Convolutional Neural Networks and Transformers, have long been able to classify their respective unimodal reasoning satisfactorily with accuracy close to or exceeding human…

机器学习 · 计算机科学 2022-12-20 Weijun Jin , Lance Wilhelm

As Large Multimodal Models (LMMs) become integral to daily digital life, understanding their safety architectures is a critical problem for AI Alignment. This paper presents a systematic analysis of OpenAI's GPT-4o mini, a globally deployed…

机器学习 · 计算机科学 2026-05-26 Niruthiha Selvanayagam , Ted Kurti

Supervised fine-tuning (SFT) plays a crucial role in adapting large language models (LLMs) to specific domains or tasks. However, as demonstrated by empirical experiments, the collected data inevitably contains noise in practical…

计算与语言 · 计算机科学 2024-12-20 Junyu Luo , Xiao Luo , Kaize Ding , Jingyang Yuan , Zhiping Xiao , Ming Zhang

In the digital world, memes present a unique challenge for content moderation due to their potential to spread harmful content. Although detection methods have improved, proactive solutions such as intervention are still limited, with…

计算与语言 · 计算机科学 2024-06-11 Prince Jha , Raghav Jain , Konika Mandal , Aman Chadha , Sriparna Saha , Pushpak Bhattacharyya

Large language models (LLMs) offer promising opportunities for organizational research. However, their built-in moderation systems can create problems when researchers try to analyze harmful content, often refusing to follow certain…

人工智能 · 计算机科学 2025-06-23 Mustafa Akben , Aaron Satko

The increasing deployment of Large Language Models (LLMs) in various applications necessitates a rigorous evaluation of their robustness against adversarial attacks. In this paper, we present a comprehensive study on the robustness of GPT…

计算与语言 · 计算机科学 2024-12-24 Yiyi Tao , Yixian Shen , Hang Zhang , Yanxin Shen , Lun Wang , Chuanqi Shi , Shaoshuai Du

With the continuous growth of internet users and media content, it is very hard to track down hateful speech in audio and video. Converting video or audio into text does not detect hate speech accurately as human sometimes uses hateful…

人工智能 · 计算机科学 2023-07-24 Fariha Tahosin Boishakhi , Ponkoj Chandra Shill , Md. Golam Rabiul Alam

Hate speech detection on Chinese social networks presents distinct challenges, particularly due to the widespread use of cloaking techniques designed to evade conventional text-based detection systems. Although large language models (LLMs)…

计算与语言 · 计算机科学 2025-08-04 Qiyao Xue , Yuchen Dou , Ryan Shi , Xiang Lorraine Li , Wei Gao

This paper delves into the formidable challenge of cross-domain generalization in multimodal hate meme detection, presenting compelling findings. We provide enough pieces of evidence supporting the hypothesis that only the textual component…

计算与语言 · 计算机科学 2024-02-08 Piush Aggarwal , Jawar Mehrabanian , Weigang Huang , Özge Alacam , Torsten Zesch

In this paper, we explore the feasibility of leveraging large language models (LLMs) to automate or otherwise assist human raters with identifying harmful content including hate speech, harassment, violent extremism, and election…

Automatic hate speech detection is hampered by the scarcity of labeled datasetd, leading to poor generalization. We employ pretrained language models (LMs) to alleviate this data bottleneck. We utilize the GPT LM for generating large…

计算与语言 · 计算机科学 2021-09-03 Tomer Wullach , Amir Adler , Einat Minkov

The detection of hate speech has become increasingly important in combating online hostility and its real-world consequences. Despite recent advancements, there is limited research addressing hate speech detection in Devanagari-scripted…

计算与语言 · 计算机科学 2024-12-30 Rushendra Sidibomma , Pransh Patwa , Parth Patwa , Aman Chadha , Vinija Jain , Amitava Das

Large language models (LLMs) have exhibited remarkable fluency across various tasks. However, their unethical applications, such as disseminating disinformation, have become a growing concern. Although recent works have proposed a number of…

计算与语言 · 计算机科学 2024-10-07 James Wang , Ran Li , Junfeng Yang , Chengzhi Mao

Large language models (LLMs) excel in diverse applications but face dual challenges: generating harmful content under jailbreak attacks and over-refusal of benign queries due to rigid safety mechanisms. These issues are further complicated…

人工智能 · 计算机科学 2025-11-04 Yifan Xia , Guorui Chen , Wenqian Yu , Zhijiang Li , Philip Torr , Jindong Gu

Multimodal large language models (MLLMs) excel in vision-language tasks but also pose significant risks of generating harmful content, particularly through jailbreak attacks. Jailbreak attacks refer to intentional manipulations that bypass…

密码学与安全 · 计算机科学 2025-07-18 Yi Nian , Shenzhe Zhu , Yuehan Qin , Li Li , Ziyi Wang , Chaowei Xiao , Yue Zhao

The rise of social media and online communication platforms has led to the spread of Arabic textual posts and memes as a key form of digital expression. While these contents can be humorous and informative, they are also increasingly being…

计算与语言 · 计算机科学 2025-08-25 Nouar AlDahoul , Yasir Zaki

Hateful meme detection is a challenging multimodal task that requires comprehension of both vision and language, as well as cross-modal interactions. Recent studies have tried to fine-tune pre-trained vision-language models (PVLMs) for this…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Rui Cao , Ming Shan Hee , Adriel Kuek , Wen-Haw Chong , Roy Ka-Wei Lee , Jing Jiang

The proliferation of hate speech on Chinese social media poses urgent societal risks, yet traditional systems struggle to decode context-dependent rhetorical strategies and evolving slang. To bridge this gap, we propose a novel three-stage…

计算与语言 · 计算机科学 2025-12-11 Binglin Wu , Jiaxiu Zou , Xianneng Li

The proliferation of large language models (LLMs) has sparked widespread and general interest due to their strong language generation capabilities, offering great potential for both industry and research. While previous research delved into…

人工智能 · 计算机科学 2024-07-09 Lukas Struppek , Minh Hieu Le , Dominik Hintersdorf , Kristian Kersting

Multimodal Large Language Models (MLLMs) have demonstrated exceptional performance in artificial intelligence by facilitating integrated understanding across diverse modalities, including text, images, video, audio, and speech. However,…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Chengze Jiang , Zhuangzhuang Wang , Minjing Dong , Jie Gui