中文
相关论文

相关论文: Multi-Level Safety Continual Projection for Fine-T…

200 篇论文

Large Language Models (LLMs) are increasingly attracting attention in various applications. Nonetheless, there is a growing concern as some users attempt to exploit these models for malicious purposes, including the synthesis of controlled…

人工智能 · 计算机科学 2026-01-22 Chongwen Zhao , Yutong Ke , Kaizhu Huang

Reinforcement learning based post-training paradigms for Video Large Language Models (VideoLLMs) have achieved significant success by optimizing for visual-semantic tasks such as captioning or VideoQA. However, while these approaches…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Xiaokun Sun , Zezhong Wu , Zewen Ding , Linli Xu

Multimodal large language models (MLLMs) face safety misalignment, where visual inputs enable harmful outputs. To address this, existing methods require explicit safety labels or contrastive data; yet, threat-related concepts are concrete…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Qishun Yang , Shu Yang , Lijie Hu , Di Wang

Recent research on large language model (LLM) jailbreaks has primarily focused on techniques that bypass safety mechanisms to elicit overtly harmful outputs. However, such efforts often overlook attacks that exploit the model's capacity for…

计算与语言 · 计算机科学 2025-12-01 Zhaoxin Zhang , Borui Chen , Yiming Hu , Youyang Qu , Tianqing Zhu , Longxiang Gao

Harmful fine-tuning attacks pose a major threat to the security of large language models (LLMs), allowing adversaries to compromise safety guardrails with minimal harmful data. While existing defenses attempt to reinforce LLM alignment,…

机器学习 · 计算机科学 2026-03-03 Yuhui Wang , Rongyi Zhu , Ting Wang

The Model Context Protocol (MCP) standardizes tool use for LLM-based agents and enable third-party servers. This openness introduces a security misalignment: agents implicitly trust tools exposed by potentially untrusted MCP servers.…

密码学与安全 · 计算机科学 2026-02-25 Zhenhong Zhou , Yuanhe Zhang , Hongwei Cai , Moayad Aloqaily , Ouns Bouachir , Linsey Pang , Prakhar Mehrotra , Kun Wang , Qingsong Wen

Recent advancements in Large Language Models (LLMs) have sparked widespread concerns about their safety. Recent work demonstrates that safety alignment of LLMs can be easily removed by fine-tuning with a few adversarially chosen…

计算与语言 · 计算机科学 2025-03-03 Samuele Poppi , Zheng-Xin Yong , Yifei He , Bobbie Chern , Han Zhao , Aobo Yang , Jianfeng Chi

In real-world deployments, Vision-Language Large Models (VLLMs) face critical challenges from multilingual and multimodal composite attacks: harmful images paired with low-resource language texts can easily bypass defenses designed for…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Enyi Shi , Fei Shen , Shuyi Miao , Linxia Zhu , Pengyang Shao , Jinhui Tang , Tat-Seng Chua

Safety-critical task planning in robotic systems remains challenging: classical planners suffer from poor scalability, Reinforcement Learning (RL)-based methods generalize poorly, and base Large Language Models (LLMs) cannot guarantee…

机器人学 · 计算机科学 2026-03-11 Jialiang Fan , Weizhe Xu , Mengyu Liu , Oleg Sokolsky , Insup Lee , Fanxin Kong

Large Language Models (LLMs) exhibit significant safety disparities across languages, with low-resource languages (LRLs) often bypassing safety guardrails established for high-resource languages (HRLs) like English. Existing solutions, such…

机器学习 · 计算机科学 2026-02-27 Jiaming Liang , Zhaoxin Wang , Handing Wang

Recent developments in Large Language Models (LLMs) have manifested significant advancements. To facilitate safeguards against malicious exploitation, a body of research has concentrated on aligning LLMs with human preferences and…

密码学与安全 · 计算机科学 2024-06-11 Yuanpu Cao , Bochuan Cao , Jinghui Chen

Large Language Models (LLMs) show potential as sequential decision-making agents, but their application is often limited due to a reliance on large, computationally expensive models. This creates a need to improve smaller models, yet…

计算与语言 · 计算机科学 2025-08-15 Jim Dilkes , Vahid Yazdanpanah , Sebastian Stein

Multimodal Large Language Models (MLLMs) rely on strong linguistic reasoning inherited from their base language models. However, multimodal instruction fine-tuning paradoxically degrades this text's reasoning capability, undermining…

Continual Learning (CL) is essential for enabling self-evolving large language models (LLMs) to adapt and remain effective amid rapid knowledge growth. Yet, despite its importance, little attention has been given to establishing statistical…

机器学习 · 计算机科学 2025-10-29 Xiaofan Zhou , Lu Cheng

Large Vision-Language Models (LVLMs) have achieved impressive performance across multimodal understanding and reasoning tasks, yet their internal safety mechanisms remain opaque and poorly controlled. In this work, we present a…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Jinhu Fu , Yihang Lou , Qingyi Si , Shudong Zhang , Yan Bai , Sen Su

Generating semantically coherent text requires a robust internal representation of linguistic structures, which traditional embedding techniques often fail to capture adequately. A novel approach, Latent Lexical Projection (LLP), is…

计算与语言 · 计算机科学 2025-03-26 Ziad Shaker , Brendan Ashdown , Hugo Fitzalan , Alistair Heathcote , Jocasta Huntington

Multimodal Large Language Models (MLLMs) pose critical safety challenges, as they are susceptible not only to adversarial attacks such as jailbreaking but also to inadvertently generating harmful content for benign users. While internal…

机器学习 · 计算机科学 2026-03-17 Ming Wen , Kun Yang , Xin Chen , Jingyu Zhang , Dingding Han , Shiwen Cui , Yuedong Xu

Large Language Models (LLMs) demonstrate strong capabilities in solving complex tasks when integrated with external tools. The Model Context Protocol (MCP) has become a standard interface for enabling such tool-based interactions. However,…

密码学与安全 · 计算机科学 2026-01-23 Jiayi Fu , Yuansen Zhang , Yinggui Wang

Safety post-training can improve the harmfulness and policy compliance of Large Language Models (LLMs), but it may also reduce general utility, a phenomenon often described as the \emph{alignment tax}. We study this trade-off through the…

机器学习 · 计算机科学 2026-05-13 Guanglong Sun , Siyuan Zhang , Liyuan Wang , Jun Zhu , Hang Su , Yi Zhong

Vision-language pre-training like CLIP has shown promising performance on various downstream tasks such as zero-shot image classification and image-text retrieval. Most of the existing CLIP-alike works usually adopt relatively large image…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Ying Nie , Wei He , Kai Han , Yehui Tang , Tianyu Guo , Fanyi Du , Yunhe Wang