中文
相关论文

相关论文: MCP Safety Training: Learning to Refuse Falsely Be…

200 篇论文

The Model Context Protocol (MCP) enables Large Language Models (LLMs) to interact with external tools via tool descriptors, thereby extending their capabilities for task execution, autonomous decision-making, and multi-agent coordination.…

密码学与安全 · 计算机科学 2026-05-22 Saeid Jamshidi , Arghavan Moradi Dakhel , Kawser Wazed Nafi , Foutse Khomh

This work studies the problem of large language model (LLM) unlearning, aiming to remove unwanted data influences (e.g., copyrighted or harmful content) while preserving model utility. Despite the increasing demand for unlearning, a…

计算与语言 · 计算机科学 2025-10-21 Chongyu Fan , Jiancheng Liu , Licong Lin , Jinghan Jia , Ruiqi Zhang , Song Mei , Sijia Liu

The Model Context Protocol (MCP) has rapidly emerged as a universal standard for connecting AI assistants to external tools and data sources. While MCP simplifies integration between AI applications and various services, it introduces…

密码学与安全 · 计算机科学 2026-03-25 Charoes Huang , Xin Huang , Ngoc Phu Tran , Amin Milani Fard

The Model Context Protocol (MCP) is an emerging standard designed to enable seamless interaction between Large Language Model (LLM) applications and external tools or resources. Within a short period, thousands of MCP services have been…

密码学与安全 · 计算机科学 2025-09-16 Hao Song , Yiming Shen , Wenxuan Luo , Leixin Guo , Ting Chen , Jiashui Wang , Beibei Li , Xiaosong Zhang , Jiachi Chen

Large language models (LLMs) are evolving into agentic systems that reason, plan, and operate external tools. The Model Context Protocol (MCP) is a key enabler of this transition, offering a standardized interface for connecting LLMs with…

计算与语言 · 计算机科学 2026-03-06 Xuanjun Zong , Zhiqi Shen , Lei Wang , Yunshi Lan , Chao Yang

Large Language Models (LLMs) demonstrate strong capabilities in solving complex tasks when integrated with external tools. The Model Context Protocol (MCP) has become a standard interface for enabling such tool-based interactions. However,…

密码学与安全 · 计算机科学 2026-01-23 Jiayi Fu , Yuansen Zhang , Yinggui Wang

The Model Context Protocol (MCP) has emerged as a standardized interface enabling seamless integration between Large Language Models (LLMs) and external data sources and tools. While MCP significantly reduces development complexity and…

密码学与安全 · 计算机科学 2025-10-29 Bin Wang , Zexin Liu , Hao Yu , Ao Yang , Yenan Huang , Jing Guo , Huangsheng Cheng , Hui Li , Huiyu Wu

Federated Learning (FL) has become increasingly popular to perform data-driven analysis in cyber-physical critical infrastructures. Since the FL process may involve the client's confidential information, Differential Privacy (DP) has been…

密码学与安全 · 计算机科学 2024-10-28 Md Tamjid Hossain , Shahriar Badsha , Hung La , Haoting Shen , Shafkat Islam , Ibrahim Khalil , Xun Yi

Large Language Models (LLMs) have become pivotal in advancing natural language processing, yet their potential to perpetuate biases poses significant concerns. This paper introduces a new framework employing Direct Preference Optimization…

计算与语言 · 计算机科学 2024-07-22 Ahmed Allam

The Model Context Protocol (MCP) is a recently proposed interoperability standard that unifies how AI agents connect with external tools and data sources. By defining a set of common client-server message exchange clauses, MCP replaces…

密码学与安全 · 计算机科学 2026-03-12 Nanzi Yang , Weiheng Bai , Kangjie Lu

In Large Language Models, Retrieval-Augmented Generation (RAG) systems can significantly enhance the performance of large language models by integrating external knowledge. However, RAG also introduces new security risks. Existing research…

机器学习 · 计算机科学 2025-06-16 Linlin Wang , Tianqing Zhu , Laiqiao Qin , Longxiang Gao , Wanlei Zhou

Recent generative models have significantly advanced speech restoration tasks, yet their training objectives often misalign with human perceptual preferences, resulting in suboptimal quality. While post-training alignment has proven…

声音 · 计算机科学 2025-11-18 Junan Zhang , Xueyao Zhang , Jing Yang , Yuancheng Wang , Fan Fan , Zhizheng Wu

Efficient preference optimization algorithms such as Direct Preference Optimization (DPO) have become a popular approach in aligning large language models (LLMs) with human preferences. These algorithms implicitly treat the LLM as a reward…

计算与语言 · 计算机科学 2025-07-29 Tong Liu , Xiao Yu , Wenxuan Zhou , Jindong Gu , Volker Tresp

Safety guardrails in large language models(LLMs) are developed to prevent malicious users from generating toxic content at a large scale. However, these measures can inadvertently introduce or reflect new biases, as LLMs may refuse to…

计算与语言 · 计算机科学 2025-11-03 Adel Khorramrouz , Sharon Levy

Large language models(LLMs) are increasingly integrated with external systems through the Model Context Protocol(MCP),which standardizes tool invocation and has rapidly become a backbone for LLM-powered applications. While this paradigm…

密码学与安全 · 计算机科学 2026-05-04 Shuli Zhao , Qinsheng Hou , Zihan Zhan , Yanhao Wang , Yuchong Xie , Yu Guo , Libo Chen , Shenghong Li , Zhi Xue

Large Language Model (LLM) training often optimizes for preference alignment, rewarding outputs that are perceived as helpful and interaction-friendly. However, this preference-oriented objective can be exploited: manipulative prompts can…

密码学与安全 · 计算机科学 2026-01-13 Hongjun An , Yiliang Song , Jiangan Chen , Jiawei Shao , Chi Zhang , Xuelong Li

Multi-preference optimization enriches language-model alignment beyond pairwise preferences by contrasting entire sets of helpful and undesired responses, thereby enabling richer training signals for large language models. During self-play…

机器学习 · 计算机科学 2025-06-10 Taneesh Gupta , Rahul Madhavan , Xuchao Zhang , Chetan Bansal , Saravan Rajmohan

The Model Context Protocol (MCP), introduced by Anthropic, provides a standardized framework for artificial intelligence (AI) systems to interact with external data sources and tools in real-time. While MCP offers significant advantages for…

密码学与安全 · 计算机科学 2025-05-06 Vineeth Sai Narajala , Idan Habler

Multimodal large language models (MLLMs) have achieved remarkable success across various tasks. However, separate training of visual and textual encoders often results in a misalignment of the modality. Such misalignment may lead models to…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Songtao Jiang , Yan Zhang , Ruizhe Chen , Tianxiang Hu , Yeying Jin , Qinglin He , Yang Feng , Jian Wu , Zuozhu Liu

Preference learning extends the performance of Code LLMs beyond traditional supervised fine-tuning by leveraging relative quality comparisons. In existing approaches, a set of n candidate solutions is evaluated based on test case success…

计算与语言 · 计算机科学 2025-10-10 Jie Wu , Haoling Li , Xin Zhang , Xiao Liu , Yangyu Huang , Jianwen Luo , Yizhen Zhang , Zuchao Li , Ruihang Chu , Yujiu Yang , Scarlett Li