English
Related papers

Related papers: SkillProbe: Security Auditing for Emerging Agent S…

200 papers

As LLM agents are increasingly built around reusable skills, a central challenge is no longer only whether agents can use provided skills, but whether they can generate correct, reusable, and executable skills from repositories and…

Artificial Intelligence · Computer Science 2026-05-19 Yifan Zhou , Zhentao Zhang , Ziming Cheng , Shuo Zhang , Qizhen Lan , Zhangquan Chen , Zhi Yang , QianyuXu , Ronghao Chen , Huacan Wang , Sen Hu

Agentic systems increasingly rely on reusable procedural capabilities, \textit{a.k.a., agentic skills}, to execute long-horizon workflows reliably. These capabilities are callable modules that package procedural knowledge with explicit…

Cryptography and Security · Computer Science 2026-02-25 Yanna Jiang , Delong Li , Haiyu Deng , Baihe Ma , Xu Wang , Qin Wang , Guangsheng Yu

Agent Skills are structured packages of procedural knowledge that augment LLM agents at inference time. Despite rapid adoption, there is no standard way to measure whether they actually help. We present SkillsBench, a benchmark of 86 tasks…

In recent years, a variety of powerful LLM-based agentic systems have been applied to automate complex tasks through task orchestration. However, existing orchestration methods still face key challenges, including strategy collapse under…

Artificial Intelligence · Computer Science 2026-05-15 Mingda Zhang , Tiesunlong Shen , Haoran Luo , Wenjin Liu , Zikai Xiao , Erik Cambria , Xiaoying Tang

Skills, i.e., structured workflow instructions distilled for large language models (LLMs), are becoming an increasingly important mechanism for improving agent performance on real-world downstream tasks. However, as the open-source skill…

Computation and Language · Computer Science 2026-05-29 Jiahao Ying , Boxian Ai , Wei Tang , Siyuan Liu , Yixin Cao

As LLM agents are increasingly deployed with large libraries of reusable skills, selecting the right skill for a user request has become a critical systems challenge. In small libraries, users may invoke skills explicitly by name, but this…

Artificial Intelligence · Computer Science 2026-05-08 Hongcheol Cho , Ryangkyung Kang , Youngeun Kim

We analyzed 3,984 AI agent skills from major marketplaces and found 76 confirmed malicious payloads, including credential theft, backdoor installation, and data exfiltration. 13.4% of all skills contain at least one critical-level security…

Cryptography and Security · Computer Science 2026-05-28 Luca Beurer-Kellner , Aleksei Kudrinskii , Marco Milanta , Kristian Bonde Nielsen , Hemang Sarkar , Liran Tal

Large language model (LLM) agents are increasingly deployed to automate productivity tasks (e.g., email, scheduling, document management), but evaluating them on live services is risky due to potentially irreversible changes. Existing…

Large Language Model (LLM) agents have shown stunning results in complex tasks, yet they often operate in isolation, failing to learn from past experiences. Existing memory-based methods primarily store raw trajectories, which are often…

Long-horizon LLM agents leave traces that could become reusable experience, but raw trajectories are noisy and hard to govern. We treat Agent Skills as an experience schema that couples executable scripts, with non-executable guidance on…

Computation and Language · Computer Science 2026-05-19 Hongyi Liu , Haoyan Yang , Tao Jiang , Bo Tang , Feiyu Xiong , Zhiyu Li

Large Language Model (LLM) agents are increasingly extended at runtime via skill packages, structured natural-language instruction bundles loaded from a well-known directory. Community install tooling and registries exist, but two gaps…

Artificial Intelligence · Computer Science 2026-04-21 Sampriti Saha , Pranav Hemanth

Reusable skills let LLM agents package task-specific procedures, tool affordances, and execution guidance into modular building blocks. As skill ecosystems grow to tens of thousands of entries, exposing every skill at inference time becomes…

Machine Learning · Computer Science 2026-04-02 YanZhao Zheng , ZhenTao Zhang , Chao Ma , YuanQiang Yu , JiHuai Zhu , Yong Wu , Tianze Xu , Baohua Dong , Hangcheng Zhu , Ruohui Huang , Gang Yu

Agent Skills is an emerging open standard that defines a modular, filesystem-based packaging format enabling LLM-based agents to acquire domain-specific expertise on demand. Despite rapid adoption across multiple agentic platforms and the…

Cryptography and Security · Computer Science 2026-04-06 Zhiyuan Li , Jingzheng Wu , Xiang Ling , Xing Cui , Tianyue Luo

Skills are a promising way to improve LLM agent capabilities without retraining, while keeping the added procedure reusable and controllable. However, high-quality skills are still largely written by hand. We introduce SkillGen, a…

Machine Learning · Computer Science 2026-05-13 Yuchen Ma , Yue Huang , Han Bao , Haomin Zhuang , Swadheen Shukla , Michel Galley , Xiangliang Zhang , Stefan Feuerriegel

Skill libraries enable large language model agents to reuse experience from past interactions, but most existing libraries store skills as isolated entries and retrieve them only by semantic similarity. This leads to two key challenges for…

Computation and Language · Computer Science 2026-05-13 Xiaoyuan Li , Moxin Li , Keqin Bao , Yubo Ma , Wenjie Wang , Dayiheng Liu , Fuli Feng

Large language model (LLM) agents are increasingly expected to operate in enterprise environments, where work is distributed across specialized roles, permission-controlled systems, and cross-departmental procedures. However, existing…

Skills have become the de facto way to enable LLM agents to perform complex real-world tasks with customized instructions, workflows, and tools, but how to learn them automatically and effectively remains unclear. We introduce…

Computation and Language · Computer Science 2026-04-23 Shanshan Zhong , Yi Lu , Jingjie Ning , Yibing Wan , Lihan Feng , Yuyi Ao , Leonardo F. R. Ribeiro , Markus Dreyer , Sean Ammirati , Chenyan Xiong

Large language model (LLM)-based agents that reason, plan, and act through tools, memory, and structured interaction are emerging as a promising paradigm for automating complex workflows. Recent systems such as OpenClaw and Claude Code…

Information Retrieval · Computer Science 2026-05-27 Yingli Zhou , Wang Shu , Yaodong Su , Wenchuan Du , Yixiang Fang , Xuemin Lin

As the capability frontier of autonomous agents continues to expand, they are increasingly able to complete specialized tasks through plug-and-play external skills. Yet current benchmarks mostly test whether models can use provided skills,…

Artificial Intelligence · Computer Science 2026-04-21 Ziao Zhang , Kou Shi , Shiting Huang , Avery Nie , Yu Zeng , Yiming Zhao , Zhen Fang , Qishen Su , Haibo Qiu , Wei Yang , Qingnan Ren , Shun Zou , Wenxuan Huang , Lin Chen , Zehui Chen , Feng Zhao

This technical report presents SkillTester, a tool for evaluating the utility and security of agent skills. Its evaluation framework combines paired baseline and with-skill execution conditions with a separate security probe suite. Grounded…

Cryptography and Security · Computer Science 2026-04-01 Leye Wang , Zixing Wang , Anjie Xu