English
Related papers

Related papers: ShieldNet: Network-Level Guardrails against Emergi…

200 papers

Existing agent safety benchmarks report binary accuracy, conflating early intervention with post-mortem analysis. A detector that flags a violation at step 8 enables intervention; one that reports it at step 48 provides only forensic value.…

The rise of AI agents introduces complex safety and security challenges arising from autonomous tool use and environmental interactions. Current guardrail models lack agentic risk awareness and transparency in risk diagnosis. To introduce…

We present SHIELD, a novel methodology for automated and integrated safety signal detection in clinical trials. SHIELD combines disproportionality analysis with semantic clustering of adverse event (AE) terms applied to MedDRA term…

Computation and Language · Computer Science 2026-02-24 Francois Vandenhende , Anna Georgiou , Theodoros Psaras , Ellie Karekla

Large language models (LLMs) have evolved from simple chatbots into autonomous agents capable of performing complex tasks such as editing production code, orchestrating workflows, and taking higher-stakes actions based on untrusted inputs…

With the rapid evolution of Large Language Model (LLM) agent ecosystems, centralized skill marketplaces have emerged as pivotal infrastructure for augmenting agent capabilities. However, these marketplaces face unprecedented security…

Cryptography and Security · Computer Science 2026-03-24 Zihan Guo , Zhiyu Chen , Xiaohang Nie , Jianghao Lin , Yuanjian Zhou , Weinan Zhang

Technology evolves quickly. Low-cost and ready-to-connect devices are designed to provide new services and applications. Smart grids or smart healthcare systems are some examples of these applications, all of which are in the context of…

Cryptography and Security · Computer Science 2021-12-07 Roberto Magán-Carrión , José Camacho , Gabriel Maciá-Fernández , Ángel Ruíz-Zafra

Prompt injection attacks pose a critical threat to large language models (LLMs), enabling goal hijacking and data leakage. Prompt guard models, though effective in defense, suffer from over-defense -- falsely flagging benign inputs as…

Computation and Language · Computer Science 2025-04-01 Hao Li , Xiaogeng Liu

Existing AI agent safety benchmarks focus on generic criminal harm (cybercrime, harassment, weapon synthesis), leaving a systematic blind spot for a distinct and commercially consequential threat category: agents harming their own…

Cryptography and Security · Computer Science 2026-04-22 Dongcheng Zhang , Yiqing Jiang

Large language models are becoming pervasive core components in many real-world applications. As a consequence, security alignment represents a critical requirement for their safe deployment. Although previous related works focused…

Cryptography and Security · Computer Science 2026-03-24 Marco Arazzi , Vignesh Kumar Kembu , Antonino Nocera

The generalization capabilities of Large Language Models (LLMs) have led to their widespread deployment across various applications. However, this increased adoption has introduced several security threats, notably in the forms of…

Cryptography and Security · Computer Science 2025-08-04 Francesco Panebianco , Stefano Bonfanti , Francesco Trovò , Michele Carminati

This paper proposes a novel architectural framework aimed at enhancing security and reliability in multi-agent systems (MAS). A central component of this framework is a network of Sentinel Agents, functioning as a distributed security layer…

Artificial Intelligence · Computer Science 2025-09-19 Diego Gosmar , Deborah A. Dahl

Search agents connect LLMs to the Internet, enabling them to access broader and more up-to-date information. However, this also introduces a new threat surface: unreliable search results can mislead agents into producing unsafe outputs.…

Artificial Intelligence · Computer Science 2026-05-29 Jianshuo Dong , Sheng Guo , Hao Wang , Xun Chen , Zhuotao Liu , Tianwei Zhang , Ke Xu , Minlie Huang , Han Qiu

Agentic AI systems, specifically LLM-driven agents that plan, invoke tools, maintain persistent memory, and delegate tasks to peer agents via protocols such as MCP and A2A, introduce a threat surface that differs materially from standalone…

Cryptography and Security · Computer Science 2026-05-08 Javad Forough , Marios Kogias , Hamed Haddadi

The non-intrusive nature and high accuracy of face recognition algorithms have led to their successful deployment across multiple applications ranging from border access to mobile unlocking and digital payments. However, their vulnerability…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Nilay Sanghvi , Sushant Kumar Singh , Akshay Agarwal , Mayank Vatsa , Richa Singh

Large Language Models (LLMs) are vulnerable to adversarial prompt based injects. These injects could jailbreak or exploit vulnerabilities within these models with explicit prompt requests leading to undesired responses. In the context of…

Cryptography and Security · Computer Science 2025-02-18 Jonathan Pan , Swee Liang Wong , Yidi Yuan , Xin Wei Chia

Advanced software supply chain (SSC) attacks are increasingly runtime-only and leave fragmented evidence across hosts, services, and build/dependency layers, so any single telemetry stream is inherently insufficient to reconstruct full…

Cryptography and Security · Computer Science 2026-03-18 Zhuoran Tan , Wenbo Guo , Taylor Brierley , Jiewen Luo , Jeremy Singer , Christos Anagnostopoulos

Intel SGX and hypervisors isolate non-privileged programs from other software, ensuring confidentiality and integrity. However, side-channel attacks continue to threaten Intel SGX's security, enabling malicious OS to manipulate PTE present…

Cryptography and Security · Computer Science 2025-09-05 Gang Liu , Ningjie Li , Cen Chen

Traditional cybersecurity methodologies target deterministic systems and fail to address the probabilistic nature of AI, leaving systems vulnerable to attack vectors such as model inversion, data poisoning, and prompt injection. Recent…

Cryptography and Security · Computer Science 2026-05-19 Tsafac Nkombong Regine Cyrille , Franziska Schwarz

The Model Context Protocol (MCP) has emerged as a de facto standard for integrating Large Language Models with external tools, yet no formal security analysis of the protocol specification exists. We present the first rigorous security…

Cryptography and Security · Computer Science 2026-01-27 Narek Maloyan , Dmitry Namiot

Large language models (LLMs) have convincing performance in a variety of downstream tasks. However, these systems are prone to generating undesirable outputs such as harmful and biased text. In order to remedy such generations, the…

Computation and Language · Computer Science 2025-08-08 Manish Nagireddy , Inkit Padhi , Soumya Ghosh , Prasanna Sattigeri