English
Related papers

Related papers: MCPSecBench: A Systematic Security Benchmark and P…

200 papers

Model Context Protocol (MCP) is a rapidly adopted standard for defining and invoking external tools in LLM applications. The multi-layered architecture of MCP introduces new attack surfaces such as tool poisoning, in addition to traditional…

Cryptography and Security · Computer Science 2026-04-21 İpek Abasıkeleş Turgut , Edip Gümüş

The Model Context Protocol (MCP) has rapidly become a de facto standard for connecting LLM-based agents with external tools via reusable MCP servers. In practice, however, server selection and onboarding rely heavily on free-text tool…

Software Engineering · Computer Science 2026-02-24 Peiran Wang , Ying Li , Yuqiang Sun , Chengwei Liu , Yang Liu , Yuan Tian

We introduce LiveSecBench, a continuously updated safety benchmark specifically for Chinese-language LLM application scenarios. LiveSecBench constructs a high-quality and unique dataset through a pipeline that combines automated generation…

Since the introduction of the Model Context Protocol (MCP), the number of available tools for Large Language Models (LLMs) has increased significantly. These task-specific tool sets offer an alternative to general-purpose tools such as web…

Computation and Language · Computer Science 2025-12-12 Reza Esfandiarpoor , Vishwas Suryanarayanan , Stephen H. Bach , Vishal Chowdhary , Anthony Aue

This paper introduces v0.5 of the AI Safety Benchmark, which has been created by the MLCommons AI Safety Working Group. The AI Safety Benchmark has been designed to assess the safety risks of AI systems that use chat-tuned language models.…

Computation and Language · Computer Science 2024-05-15 Bertie Vidgen , Adarsh Agrawal , Ahmed M. Ahmed , Victor Akinwande , Namir Al-Nuaimi , Najla Alfaraj , Elie Alhajjar , Lora Aroyo , Trupti Bavalatti , Max Bartolo , Borhane Blili-Hamelin , Kurt Bollacker , Rishi Bomassani , Marisa Ferrara Boston , Siméon Campos , Kal Chakra , Canyu Chen , Cody Coleman , Zacharie Delpierre Coudert , Leon Derczynski , Debojyoti Dutta , Ian Eisenberg , James Ezick , Heather Frase , Brian Fuller , Ram Gandikota , Agasthya Gangavarapu , Ananya Gangavarapu , James Gealy , Rajat Ghosh , James Goel , Usman Gohar , Sujata Goswami , Scott A. Hale , Wiebke Hutiri , Joseph Marvin Imperial , Surgan Jandial , Nick Judd , Felix Juefei-Xu , Foutse Khomh , Bhavya Kailkhura , Hannah Rose Kirk , Kevin Klyman , Chris Knotz , Michael Kuchnik , Shachi H. Kumar , Srijan Kumar , Chris Lengerich , Bo Li , Zeyi Liao , Eileen Peters Long , Victor Lu , Sarah Luger , Yifan Mai , Priyanka Mary Mammen , Kelvin Manyeki , Sean McGregor , Virendra Mehta , Shafee Mohammed , Emanuel Moss , Lama Nachman , Dinesh Jinenhally Naganna , Amin Nikanjam , Besmira Nushi , Luis Oala , Iftach Orr , Alicia Parrish , Cigdem Patlak , William Pietri , Forough Poursabzi-Sangdeh , Eleonora Presani , Fabrizio Puletti , Paul Röttger , Saurav Sahay , Tim Santos , Nino Scherrer , Alice Schoenauer Sebag , Patrick Schramowski , Abolfazl Shahbazi , Vin Sharma , Xudong Shen , Vamsi Sistla , Leonard Tang , Davide Testuggine , Vithursan Thangarasa , Elizabeth Anne Watkins , Rebecca Weiss , Chris Welty , Tyler Wilbers , Adina Williams , Carole-Jean Wu , Poonam Yadav , Xianjun Yang , Yi Zeng , Wenhui Zhang , Fedor Zhdanov , Jiacheng Zhu , Percy Liang , Peter Mattson , Joaquin Vanschoren

Large Language Model (LLM) systems are inherently compositional, with individual LLM serving as the core foundation with additional layers of objects such as plugins, sandbox, and so on. Along with the great potential, there are also…

Cryptography and Security · Computer Science 2024-03-01 Fangzhou Wu , Ning Zhang , Somesh Jha , Patrick McDaniel , Chaowei Xiao

Existing benchmarks for evaluating the security risks and capabilities (e.g., vulnerability detection) of code-generating large language models (LLMs) face several key limitations: (1) limited coverage of risk and capabilities; (2) reliance…

Cryptography and Security · Computer Science 2025-09-22 Yuzhou Nie , Zhun Wang , Yu Yang , Ruizhe Jiang , Yuheng Tang , Xander Davies , Yarin Gal , Bo Li , Wenbo Guo , Dawn Song

In this work, we study security of Model Context Protocol (MCP) agent toolchains and their applications in smart homes. We introduce AegisMCP, a protocol-level intrusion detector. Our contributions are: (i) a minimal attack suite spanning…

Cryptography and Security · Computer Science 2025-10-28 Zhonghao Zhan , Amir Al Sadi , Krinos Li , Hamed Haddadi

In recent years, blockchain has experienced widespread adoption across various industries, becoming integral to numerous enterprise applications. Concurrently, the rise of generative AI and LLMs has transformed human-computer interactions,…

While fine-tuning services drive the rapid expansion of task capabilities in large language models (LLMs), they are often accompanied by the degradation and reorganization of safety-aligned representations, making models more prone to…

Machine Learning · Computer Science 2026-02-02 Bing Han , Feifei Zhao , Dongcheng Zhao , Guobin Shen , Ping Wu , Yu Shi , Yi Zeng

The increased adoption of the Model Context Protocol (MCP) for AI Agents necessitates robust security for Enterprise integrations. This paper introduces the MCP Gateway to simplify self-hosted MCP server integration. The proposed…

Cryptography and Security · Computer Science 2025-04-29 Ivo Brett

Industrial automation increasingly requires flexible control strategies that can adapt to changing tasks and environments. Agents based on Large Language Models (LLMs) offer potential for such adaptive planning and execution but lack…

Artificial Intelligence · Computer Science 2025-12-04 Niklas Jobs , Luis Miguel Vieira da Silva , Jayanth Somashekaraiah , Maximilian Weigand , David Kube , Felix Gehlhoff

The widespread adoption of Large Language Models (LLMs) has revolutionized AI deployment, enabling autonomous and semi-autonomous applications across industries through intuitive language interfaces and continuous improvements in model…

Cryptography and Security · Computer Science 2025-10-20 Adam Swanda , Amy Chang , Alexander Chen , Fraser Burch , Paul Kassianik , Konstantin Berlin

The increasing deployment of large language models in security-sensitive domains necessitates rigorous evaluation of their resilience against adversarial prompt-based attacks. While previous benchmarks have focused on security evaluations…

Cryptography and Security · Computer Science 2025-09-22 Huining Cui , Wei Liu

The code generation capabilities of large language models(LLMs) have emerged as a critical dimension in evaluating their overall performance. However, prior research has largely overlooked the security risks inherent in the generated code.…

Cryptography and Security · Computer Science 2025-06-23 Xinghang Li , Jingzhe Ding , Chao Peng , Bing Zhao , Xiang Gao , Hongwan Gao , Xinchen Gu

The MCP Solver bridges Large Language Models (LLMs) with symbolic solvers through the Model Context Protocol (MCP), an open-source standard for AI system integration. Providing LLMs access to formal solving and reasoning capabilities…

Artificial Intelligence · Computer Science 2025-04-08 Stefan Szeider

This paper studies the integration off Large Language Models into cybersecurity tools and protocols. The main issue discussed in this paper is how traditional rule-based and signature based security systems are not enough to deal with…

Cryptography and Security · Computer Science 2025-11-07 Raunak Somani , Aswani Kumar Cherukuri

Model Context Protocol (MCP) have quickly become the interface layer between LLM agents and external tools, yet they also introduce unsafe data flows that existing analyzers handle poorly. Vulnerabilities manifest in two directions:…

Software Engineering · Computer Science 2026-05-11 Xinyi Hou , Yanjie Zhao , Haoyu Wang

Large language models (LLMs) and LLM-based agents have been widely deployed in a wide range of applications in the real world, including healthcare diagnostics, financial analysis, customer support, robotics, and autonomous driving,…

Cryptography and Security · Computer Science 2025-05-20 Wenrui Xu , Keshab K. Parhi

Model Context Protocol (MCP) enables agents to interact with external tools, yet empirical research on MCP is hindered by the lack of large-scale, accessible datasets. We present MCPZoo, the largest and most comprehensive dataset of MCP…

Cryptography and Security · Computer Science 2025-12-29 Mengying Wu , Pei Chen , Geng Hong , Baichao An , Jinsong Chen , Binwang Wan , Xudong Pan , Jiarun Dai , Min Yang
‹ Prev 1 4 5 6 7 8 10 Next ›