English
Related papers

Related papers: Evolving Contextual Safety in Multi-Modal Large La…

200 papers

Extended interaction with large language models (LLMs) has been linked to the reinforcement of delusional beliefs, a phenomenon attracting growing clinical and public concern. Yet most empirical work evaluates model safety in brief…

Human-Computer Interaction · Computer Science 2026-04-24 Luke Nicholls , Robert Hutto , Zephrah Soto , Hamilton Morrin , Thomas Pollak , Raj Korpan , Cheryl Carmichael

While safety mechanisms have significantly progressed in filtering harmful text inputs, MLLMs remain vulnerable to multimodal jailbreaks that exploit their cross-modal reasoning capabilities. We present MIRAGE, a novel multimodal jailbreak…

Computation and Language · Computer Science 2025-03-26 Wenhao You , Bryan Hooi , Yiwei Wang , Youke Wang , Zong Ke , Ming-Hsuan Yang , Zi Huang , Yujun Cai

The last two years have seen a rapid growth in concerns around the safety of large language models (LLMs). Researchers and practitioners have met these concerns by creating an abundance of datasets for evaluating and improving LLM safety.…

Computation and Language · Computer Science 2025-01-13 Paul Röttger , Fabio Pernisi , Bertie Vidgen , Dirk Hovy

Current Large Language Models (LLMs) safety approaches focus on explicitly harmful content while overlooking a critical vulnerability: the inability to understand context and recognize user intent. This creates exploitable vulnerabilities…

Artificial Intelligence · Computer Science 2026-04-28 Ahmed M. Hussain , Salahuddin Salahuddin

Large audio-language models (LALMs) extend text-based LLMs with auditory understanding, offering new opportunities for multimodal applications. While their perception, reasoning, and task performance have been widely studied, their safety…

Ensuring the safety of Large Language Models (LLMs) is critical for real-world deployment. However, current safety measures often fail to address implicit, domain-specific risks. To investigate this gap, we introduce a dataset of 3,000…

Artificial Intelligence · Computer Science 2026-01-09 Liang Shan , Kaicheng Shen , Wen Wu , Zhenyu Ying , Chaochao Lu , Yan Teng , Jingqi Huang , Guangze Ye , Guoqing Wang , Liang He

Large language models (LLMs) are evolving into agentic systems that reason, plan, and operate external tools. The Model Context Protocol (MCP) is a key enabler of this transition, offering a standardized interface for connecting LLMs with…

Computation and Language · Computer Science 2026-03-06 Xuanjun Zong , Zhiqi Shen , Lei Wang , Yunshi Lan , Chao Yang

Recently, multimodal large language models (MLLMs) have emerged as a unified paradigm for language and image generation. Compared with diffusion models, MLLMs possess a much stronger capability for semantic understanding, enabling them to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Ye Leng , Junjie Chu , Mingjie Li , Chenhao Lin , Chao Shen , Michael Backes , Yun Shen , Yang Zhang

With the widespread deployment of Multimodal Large Language Models (MLLMs) for visual-reasoning tasks, improving their safety has become crucial. Recent research indicates that despite training-time safety alignment, these models remain…

Multimodal large language models (MLLMs) have achieved remarkable progress, yet remain critically vulnerable to adversarial attacks that exploit weaknesses in cross-modal processing. We present a systematic study of multimodal jailbreaks…

Cryptography and Security · Computer Science 2025-10-24 Divyanshu Kumar , Shreyas Jena , Nitin Aravind Birur , Tanay Baswa , Sahil Agarwal , Prashanth Harshangi

Recent benchmarks reveal that despite strong reasoning capabilities, large language models (LLMs) still struggle to faithfully apply complex contextual knowledge. These failures are often not wholesale reasoning collapses: in context-rich…

Computation and Language · Computer Science 2026-05-27 Hongbo Jin , Chi Wang , Haoran Tang , Zhongjing Du , Xu Jiang , Jingqi Tian , Qiaoman Zhang , Jiayu Ding

Jailbreak attacks reveal critical vulnerabilities in Large Language Models (LLMs) by causing them to generate harmful or unethical content. Evaluating these threats is particularly challenging due to the evolving nature of LLMs and the…

Machine Learning · Computer Science 2025-07-11 Peiyan Zhang , Haibo Jin , Liying Kang , Haohan Wang

As Large Language Models (LLMs) become increasingly sophisticated and ubiquitous in natural language processing (NLP) applications, ensuring their robustness, trustworthiness, and alignment with human values has become a critical challenge.…

Computation and Language · Computer Science 2024-08-09 Wrick Talukdar , Anjanava Biswas

Large Language Models (LLMs) increasingly use persistent memory from past interactions to enhance personalization and task performance. However, this memory introduces critical risks when sensitive information is revealed in inappropriate…

As the influence of large language models (LLMs) spans across global communities, their safety challenges in multilingual settings become paramount for alignment research. This paper examines the variations in safety challenges faced by…

Computation and Language · Computer Science 2024-01-25 Lingfeng Shen , Weiting Tan , Sihao Chen , Yunmo Chen , Jingyu Zhang , Haoran Xu , Boyuan Zheng , Philipp Koehn , Daniel Khashabi

While safety alignment for Multimodal Large Language Models (MLLMs) has gained significant attention, current paradigms primarily target malicious intent or situational violations. We propose shifting the safety frontier toward…

Artificial Intelligence · Computer Science 2026-03-11 Ming Wen , Kun Yang , Jingyu Zhang , Yuxuan Liu , shiwen cui , Shouling Ji , Xingjun Ma

Embodied agents powered by large language models (LLMs) inherit advanced planning capabilities; however, their direct interaction with the physical world exposes them to safety vulnerabilities. In this work, we identify four key reasoning…

Artificial Intelligence · Computer Science 2025-10-01 Ruolin Chen , Yinqian Sun , Jihang Wang , Mingyang Lv , Qian Zhang , Yi Zeng

Safety lies at the core of developing and deploying large language models (LLMs). However, previous safety benchmarks only concern the safety in one language, e.g. the majority language in the pretraining data such as English. In this work,…

Computation and Language · Computer Science 2024-06-21 Wenxuan Wang , Zhaopeng Tu , Chang Chen , Youliang Yuan , Jen-tse Huang , Wenxiang Jiao , Michael R. Lyu

Multimodal Large Language Models (MLLMs) are susceptible to the implicit reasoning risk, wherein innocuous unimodal inputs synergistically assemble into risky multimodal data that produce harmful outputs. We attribute this vulnerability to…

Artificial Intelligence · Computer Science 2025-09-17 Wei Cai , Shujuan Liu , Jian Zhao , Ziyan Shi , Yusheng Zhao , Yuchen Yuan , Tianle Zhang , Chi Zhang , Xuelong Li

Understanding context is key to understanding human language, an ability which Large Language Models (LLMs) have been increasingly seen to demonstrate to an impressive extent. However, though the evaluation of LLMs encompasses various…

Computation and Language · Computer Science 2024-02-02 Yilun Zhu , Joel Ruben Antony Moniz , Shruti Bhargava , Jiarui Lu , Dhivya Piraviperumal , Site Li , Yuan Zhang , Hong Yu , Bo-Hsiang Tseng
‹ Prev 1 4 5 6 7 8 10 Next ›