中文
相关论文

相关论文: DREAM: Disentangling Risks to Enhance Safety Align…

200 篇论文

Malicious attackers can exploit large language models (LLMs) by engaging them in multi-turn dialogues to achieve harmful objectives, posing significant safety risks to society. To address this challenge, we propose a novel defense…

As Multimodal Large Language Models (MLLMs) acquire stronger reasoning capabilities to handle complex, multi-image instructions, this advancement may pose new safety risks. We study this problem by introducing MIR-SafetyBench, the first…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Renmiao Chen , Yida Lu , Shiyao Cui , Xuan Ouyang , Victor Shea-Jay Huang , Shumin Zhang , Chengwei Pan , Han Qiu , Minlie Huang

Vision Large Language Models (VLLMs) represent a significant advancement in artificial intelligence by integrating image-processing capabilities with textual understanding, thereby enhancing user interactions and expanding application…

计算与语言 · 计算机科学 2025-05-09 Madhur Jindal , Saurabh Deshpande

Recently, large language models (LLMs) have demonstrated impressive capabilities in dealing with new tasks with the help of in-context learning (ICL). In the study of Large Vision-Language Models (LVLMs), when implementing ICL, researchers…

计算与语言 · 计算机科学 2024-12-11 Ellen Yi-Ge , Jiechao Gao , Wei Han , Wei Zhu

Fine-tuning a general-purpose large language model (LLM) for a specific domain or task has become a routine procedure for ordinary users. However, fine-tuning is known to remove the safety alignment features of the model, even when the…

计算与语言 · 计算机科学 2025-06-23 Kathleen C. Fraser , Hillary Dawkins , Isar Nejadgholi , Svetlana Kiritchenko

The advent of Large Language Models (LLMs) has revolutionized various applications by providing advanced natural language processing capabilities. However, this innovation introduces new cybersecurity challenges. This paper explores the…

密码学与安全 · 计算机科学 2024-06-18 Stephen Burabari Tete

Large language models (LLMs) have been used in many application domains, including cyber security. The application of LLMs in the cyber security domain presents significant opportunities, such as for enhancing threat analysis and malware…

密码学与安全 · 计算机科学 2025-09-18 Adel ElZemity , Budi Arief , Shujun Li

Multimodal large language models (MLLMs) enable interaction over both text and images, but their safety behavior can be driven by unimodal shortcuts instead of true joint intent understanding. We introduce CSR-Bench, a benchmark for…

人工智能 · 计算机科学 2026-02-04 Yuxuan Liu , Yuntian Shi , Kun Wang , Haoting Shen , Kun Yang

While multimodal large language models (MLLMs) have achieved remarkable success in recent advancements, their susceptibility to jailbreak attacks has come to light. In such attacks, adversaries exploit carefully crafted prompts to coerce…

密码学与安全 · 计算机科学 2025-02-04 Ziyi Yin , Yuanpu Cao , Han Liu , Ting Wang , Jinghui Chen , Fenhlong Ma

Large language models (LLMs) have achieved remarkable success across many applications, but their ability to generate harmful content raises serious safety concerns. Although safety alignment techniques are often applied during pre-training…

机器学习 · 计算机科学 2026-04-24 Chengcan Wu , Zhixin Zhang , Zeming Wei , Yihao Zhang , Xiaokun Luan , Meng Sun

The deployment of multimodal large language models (MLLMs) has demonstrated remarkable success in engaging in conversations involving visual inputs, thanks to the superior power of large language models (LLMs). Those MLLMs are typically…

计算与语言 · 计算机科学 2024-10-10 Jiahui Gao , Renjie Pi , Tianyang Han , Han Wu , Lanqing Hong , Lingpeng Kong , Xin Jiang , Zhenguo Li

With the rapid development of multimodal large language models (MLLMs), they are increasingly deployed as autonomous computer-use agents capable of accomplishing complex computer tasks. However, a pressing issue arises: Can the safety risk…

人工智能 · 计算机科学 2025-06-23 Jingyi Yang , Shuai Shao , Dongrui Liu , Jing Shao

Large Vision-Language Models (LVLMs) bridge the gap between visual and linguistic modalities, demonstrating strong potential across a variety of domains. However, despite significant progress, LVLMs still suffer from severe hallucination…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Ruiqi Ma , Yu Yan , Chunhong Zhang , Minghao Yin , XinChao Liu , Zhihong Jin , Zheng Hu

Real-time multi-robot coordination in hazardous and adversarial environments requires fast, reliable adaptation to dynamic threats. While Large Language Models (LLMs) offer strong high-level reasoning capabilities, the lack of safety…

机器人学 · 计算机科学 2025-11-19 Yuwei Wu , Yuezhan Tao , Peihan Li , Guangyao Shi , Gaurav S. Sukhatme , Vijay Kumar , Lifeng Zhou

Large Language Models (LLMs) are currently being integrated into industrial software applications to help users perform more complex tasks in less time. However, these LLM-Integrated Applications (LIA) expand the attack surface and…

密码学与安全 · 计算机科学 2025-04-28 Felix Viktor Jedrzejewski , Davide Fucci , Oleksandr Adamov

While the wide adoption of refusal training in large language models (LLMs) has showcased improvements in model safety, recent works have highlighted shortcomings due to the shallow nature of these alignment methods. To this end, the work…

机器学习 · 计算机科学 2026-04-17 Pankayaraj Pathmanathan , Furong Huang

Reinforcement learning struggles in the face of long-horizon tasks and sparse goals due to the difficulty in manual reward specification. While existing methods address this by adding intrinsic rewards, they may fail to provide meaningful…

人工智能 · 计算机科学 2024-06-12 Zeyuan Liu , Ziyu Huan , Xiyao Wang , Jiafei Lyu , Jian Tao , Xiu Li , Furong Huang , Huazhe Xu

The trustworthiness of Multimodal Large Language Models (MLLMs) remains an intense concern despite the significant progress in their capabilities. Existing evaluation and mitigation approaches often focus on narrow aspects and overlook…

Traditional security protection methods struggle to address sophisticated attack vectors in large-scale distributed systems, particularly when balancing detection accuracy with data privacy concerns. This paper presents a novel distributed…

密码学与安全 · 计算机科学 2025-02-26 Yuqing Wang , Xiao Yang

Large Vision-Language Models (LVLMs) have achieved impressive progress across various applications but remain vulnerable to malicious queries that exploit the visual modality. Existing alignment approaches typically fail to resist malicious…

密码学与安全 · 计算机科学 2025-11-18 Yitong Zhang , Jia Li , Liyi Cai , Ge Li