中文
相关论文

相关论文: SkillsBench: Benchmarking How Well Agent Skills Wo…

200 篇论文

Agent Skills, structured packages of procedural knowledge loaded into an LLM agent at inference time, are widely reported to improve task pass rates by an average of 16.2~percentage points across diverse domains. Yet the same benchmarks…

人工智能 · 计算机科学 2026-05-26 Samuel Jacob Chacko , James Hugglestone , Chashi Mahiul Islam , Xiuwen Liu

Skills have become the de facto way to enable LLM agents to perform complex real-world tasks with customized instructions, workflows, and tools, but how to learn them automatically and effectively remains unclear. We introduce…

Agent skills, structured procedural knowledge packages injected at inference time, are increasingly used to augment LLM agents on software engineering tasks. However, their real utility in end-to-end development settings remains unclear. We…

软件工程 · 计算机科学 2026-03-17 Tingxu Han , Yi Zhang , Wei Song , Chunrong Fang , Zhenyu Chen , Youcheng Sun , Lijie Hu

Reusable skills are becoming a common interface for extending large language model agents, packaging procedural guidance with access to files, tools, memory, and execution environments. However, this modularity introduces attack surfaces…

密码学与安全 · 计算机科学 2026-05-28 Chang Jin , An Wang , Zeming Wei , Kai Wang , Biaojie Zeng , Qiaosheng Zhang , Chao Yang , Jingjing Qu , Xia Hu , Xingcheng Xu

Large language model (LLM) agents accumulate rich episodic trajectories while solving real-world tasks, but it remains unclear whether such experience can be distilled into reusable procedural skills. We introduce SkillEvolBench, a…

Skills are a promising way to improve LLM agent capabilities without retraining, while keeping the added procedure reusable and controllable. However, high-quality skills are still largely written by hand. We introduce SkillGen, a…

Agent skills, which are reusable, domain-specific knowledge artifacts, have become a popular mechanism for extending LLM-based agents, yet formally benchmarking skill usage performance remains scarce. Existing skill benchmarking efforts…

计算与语言 · 计算机科学 2026-04-07 Yujian Liu , Jiabao Ji , Li An , Tommi Jaakkola , Yang Zhang , Shiyu Chang

Skills, i.e., structured workflow instructions distilled for large language models (LLMs), are becoming an increasingly important mechanism for improving agent performance on real-world downstream tasks. However, as the open-source skill…

计算与语言 · 计算机科学 2026-05-29 Jiahao Ying , Boxian Ai , Wei Tang , Siyuan Liu , Yixin Cao

As LLM agents are increasingly built around reusable skills, a central challenge is no longer only whether agents can use provided skills, but whether they can generate correct, reusable, and executable skills from repositories and…

Agent skills are increasingly used to configure coding agents for software engineering (SE) tasks, yet current practice treats them as static, hand-crafted assets, or evolved on pass rate alone. This is insufficient: a skill can improve…

Large language models (LLMs) and agentic systems have shown promise for automated software development, but applying them to hardware-in-the-loop (HIL) embedded and Internet-of-Things (IoT) systems remains challenging due to the tight…

软件工程 · 计算机科学 2026-03-23 Yiming Li , Yuhan Cheng , Mingchen Ma , Yihang Zou , Ningyuan Yang , Wei Cheng , Hai "Helen" Li , Yiran Chen , Tingjun Chen

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Healthcare automation is shaped by local procedures and organizational constraints, so agent capabilities rarely transfer unchanged across settings. Agent skills, self-contained directories that package reusable procedures for AI agents,…

人工智能 · 计算机科学 2026-05-05 Gelei Xu , Ningzhi Tang , Xueyang Li , Toby Jia-Jun Li , Zhi Zheng , Wei Jin , Yiyu Shi

Modern Large Language Model (LLM) agents promise end to end assistance with real-world software tasks, yet existing benchmarks evaluate LLM agents almost exclusively in pre-baked environments where every dependency is pre-installed. To fill…

软件工程 · 计算机科学 2025-07-15 Avi Arora , Jinu Jang , Roshanak Zilouchian Moghaddam

While Large Language Models (LLMs) have evolved into tool-using agents, they remain brittle in long-horizon interactions. Unlike mathematical reasoning where errors are often rectifiable via backtracking, tool-use failures frequently induce…

Large language model (LLM) agents are increasingly deployed to automate productivity tasks (e.g., email, scheduling, document management), but evaluating them on live services is risky due to potentially irreversible changes. Existing…

Skills provide an effective mechanism for improving LLM agents on complex tasks, yet in existing agent frameworks, their creation, refinement, and selection are typically governed by external teachers, hand-designed rules, or auxiliary…

人工智能 · 计算机科学 2026-05-13 Min Yang , Jinghua Piao , Xu Xia , Xiaochong Lan , Jiaju Chen , Yongshun Gong , Yong Li

Markets are a promising way to coordinate AI agent activity for similar reasons to those used to justify markets more broadly. In order to effectively participate in markets, agents need to have informative signals of their own ability to…

人工智能 · 计算机科学 2026-04-28 Andrey Fradkin , Rohit Krishnan

Agent skills extend large language model (LLM) agents with reusable, program-like modules that define triggering conditions, procedural logic, and tool interactions. As these skills proliferate in public marketplaces, it is unclear what…

软件工程 · 计算机科学 2026-02-10 George Ling , Shanshan Zhong , Richard Huang

Agent skills today are static artifact: authored once -- by human curation or one-shot generation from parametric knowledge -- and then consumed unchanged, with no mechanism to improve from real use. We propose \textbf{SkillEvolver}, a…

人工智能 · 计算机科学 2026-05-12 Genrui Zhang , Erle Zhu , Jinfeng Zhou , Caiyan Jia , Hongning Wang
‹ 上一页 1 2 3 10 下一页 ›