English
Related papers

Related papers: Automatic Red Teaming LLM-based Agents with Model …

200 papers

Large Language Models (LLMs) are increasingly being used as autonomous agents capable of performing complicated tasks. However, they lack the ability to perform reliable long-horizon planning on their own. This paper bridges this gap by…

Artificial Intelligence · Computer Science 2025-09-17 Yarin Benyamin , Argaman Mordoch , Shahaf S. Shperberg , Roni Stern

In the era of (multi-modal) large language models, most operational processes can be reformulated and reproduced using LLM agents. The LLM agents can perceive, control, and get feedback from the environment so as to accomplish the given…

Artificial Intelligence · Computer Science 2024-12-31 Yingxuan Yang , Qiuying Peng , Jun Wang , Ying Wen , Weinan Zhang

With the rapid advancement of large models (LMs), the development of general-purpose intelligent agents powered by LMs has become a reality. It is foreseeable that in the near future, LM-driven general AI agents will serve as essential…

Artificial Intelligence · Computer Science 2025-06-03 Yuntao Wang , Yanghe Pan , Zhou Su , Yi Deng , Quan Zhao , Linkang Du , Tom H. Luan , Jiawen Kang , Dusit Niyato

The Model Context Protocol (MCP) enables large language models (LLMs) to dynamically discover and invoke third-party tools, significantly expanding agent capabilities while introducing a distinct security landscape. Unlike prompt-only…

Cryptography and Security · Computer Science 2026-04-10 Mehrdad Rostamzadeh , Sidhant Narula , Nahom Birhan , Mohammad Ghasemigol , Daniel Takabi

Large language models (LLMs) are rapidly evolving into autonomous agents that cooperate across organizational boundaries, enabling joint disaster response, supply-chain optimization, and other tasks that demand decentralized expertise…

Cryptography and Security · Computer Science 2025-07-16 Ronny Ko , Jiseong Jeong , Shuyuan Zheng , Chuan Xiao , Tae-Wan Kim , Makoto Onizuka , Won-Yong Shin

Ensuring the safety of large language models (LLMs) is paramount, yet identifying potential vulnerabilities is challenging. While manual red teaming is effective, it is time-consuming, costly and lacks scalability. Automated red teaming…

Cryptography and Security · Computer Science 2024-12-24 Bojian Jiang , Yi Jing , Tianhao Shen , Tong Wu , Qing Yang , Deyi Xiong

The Model Context Protocol (MCP) enables large language models (LLMs) to access external resources on demand. While commonly assumed to enhance performance, how LLMs actually leverage this capability remains poorly understood. We introduce…

Artificial Intelligence · Computer Science 2025-08-19 Wei Song , Haonan Zhong , Ziqi Ding , Jingling Xue , Yuekang Li

Applying reinforcement learning (RL) to real-world tasks requires converting informal descriptions into a formal Markov decision process (MDP), implementing an executable environment, and training a policy agent. Automating this process is…

Artificial Intelligence · Computer Science 2025-12-15 Hong Je-Gal , Chan-Bin Yi , Hyun-Suk Lee

The Large Language Model agent workflow enables the LLM to invoke tool functions to increase the performance on specific scientific domain questions. To tackle large scale of scientific research, it requires access to computing resource and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-19 Heng Ma , Alexander Brace , Carlo Siebenschuh , Greg Pauloski , Ian Foster , Arvind Ramanathan

Augmenting large language models (LLMs) with external tools has emerged as a promising approach to extend their utility, enabling them to solve practical tasks. Previous methods manually parse tool documentation and create in-context…

Computation and Language · Computer Science 2025-03-05 Zhengliang Shi , Shen Gao , Lingyong Yan , Yue Feng , Xiuyi Chen , Zhumin Chen , Dawei Yin , Suzan Verberne , Zhaochun Ren

VLMs (Vision-Language Models) extend the capabilities of LLMs (Large Language Models) to accept multimodal inputs. Since it has been verified that LLMs can be induced to generate harmful or inaccurate content through specific test cases…

Artificial Intelligence · Computer Science 2024-01-24 Mukai Li , Lei Li , Yuwei Yin , Masood Ahmed , Zhenguang Liu , Qi Liu

AutoML has advanced in handling complex tasks using the integration of LLMs, yet its efficiency remains limited by dependence on specific underlying tools. In this paper, we introduce LightAutoDS-Tab, a multi-AutoML agentic system for tasks…

The era of intelligent agents is upon us, driven by revolutionary advancements in large language models. Large Language Model (LLM) agents, with goal-driven behaviors and dynamic adaptation capabilities, potentially represent a critical…

Rapid advancements in large language models (LLMs) have revitalized in LLM-based agents, exhibiting impressive human-like behaviors and cooperative capabilities in various scenarios. However, these agents also bring some exclusive risks,…

Computation and Language · Computer Science 2024-02-05 Yu Tian , Xiao Yang , Jingyuan Zhang , Yinpeng Dong , Hang Su

Large language model powered autonomous agents demand robust, standardized protocols to integrate tools, share contextual data, and coordinate tasks across heterogeneous systems. Ad-hoc integrations are difficult to scale, secure, and…

Artificial Intelligence · Computer Science 2025-05-26 Abul Ehtesham , Aditi Singh , Gaurav Kumar Gupta , Saket Kumar

As Large Language Models (LLMs) evolve from passive text generators to active reasoning agents capable of interacting with external tools, the Model Context Protocol (MCP) has emerged as a key standardized framework for dynamic tool…

Artificial Intelligence · Computer Science 2025-10-14 Xuanqi Gao , Siyi Xie , Juan Zhai , Shiqing Ma , Chao Shen

The Model Context Protocol (MCP), introduced by Anthropic in November 2024 and now governed by the Linux Foundation's Agentic AI Foundation, has rapidly become the de facto standard for connecting large language model (LLM)-based agents to…

Cryptography and Security · Computer Science 2026-04-08 Nirajan Acharya , Gaurav Kumar Gupta

Large Language Models (LLMs), especially their compact efficiency-oriented variants, remain susceptible to jailbreak attacks that can elicit harmful outputs despite extensive alignment efforts. Existing adversarial prompt generation…

The Observational Medical Outcomes Partnership (OMOP) common data model (CDM) provides a standardized representation of heterogeneous health data to support large-scale, multi-institutional research. One critical step in data…

Artificial Intelligence · Computer Science 2025-09-05 Jaerong Ahn , Andrew Wen , Nan Wang , Heling Jia , Zhiyi Yue , Sunyang Fu , Hongfang Liu

The integration of tool use into large language models (LLMs) enables agentic systems with real-world impact. In the meantime, unlike standalone LLMs, compromised agents can execute malicious workflows with more consequential impact,…

Cryptography and Security · Computer Science 2025-02-17 Jizhou Chen , Samuel Lee Cong