English
Related papers

Related papers: SkillOpt: Executive Strategy for Self-Evolving Age…

200 papers

Manual engineering of high-performance implementations typically consumes many resources and requires in-depth knowledge of the hardware. Compilers try to address these problems; however, they are limited by design in what they can do. To…

Language agents have shown some ability to interact with an external environment, e.g., a virtual world such as ScienceWorld, to perform complex tasks, e.g., growing a plant, without the startup costs of reinforcement learning. However,…

Reinforcement learning (RL) has been widely used to train LLM agents for multi-turn interactive tasks, but its sample efficiency is severely limited by sparse rewards and long horizons. On-policy self-distillation (OPSD) alleviates this by…

Machine Learning · Computer Science 2026-04-14 Hao Wang , Guozhi Wang , Han Xiao , Yufeng Zhou , Yue Pan , Jichao Wang , Ke Xu , Yafei Wen , Xiaohu Ruan , Xiaoxin Chen , Honggang Qi

This paper pioneers a novel data-centric paradigm to maximize the utility of unlabeled data, tackling a critical question: How can we enhance the efficiency and sustainability of deep learning training by optimizing the data itself? We…

Machine Learning · Computer Science 2025-10-13 Xinyi Shang , Peng Sun , Fengyuan Liu , Tao Lin

Global optimization of expensive, derivative-free black-box functions requires extreme sample efficiency. While Bayesian optimization (BO) is the current state-of-the-art, its performance hinges on surrogate and acquisition function…

Agent skills, which are reusable, domain-specific knowledge artifacts, have become a popular mechanism for extending LLM-based agents, yet formally benchmarking skill usage performance remains scarce. Existing skill benchmarking efforts…

Computation and Language · Computer Science 2026-04-07 Yujian Liu , Jiabao Ji , Li An , Tommi Jaakkola , Yang Zhang , Shiyu Chang

Recently, skills have been widely adopted in large language model (LLM)-based agent systems across various domains. In existing frameworks, skills are typically injected into the agent reasoning loop as contextual guidance once matched to a…

Artificial Intelligence · Computer Science 2026-05-18 Duling Xu , Zheng Chen , Zaifeng Pan , Jiawei Guan , Dong Dong , Jialin Li , Bangzheng Pu

LLM-based coding agents rely on \emph{skills}, pre-packaged instruction sets that extend agent capabilities, yet every token of skill content injected into the context window incurs both monetary cost and attention dilution. To understand…

Software Engineering · Computer Science 2026-04-01 Yudong Gao , Zongjie Li , Yuanyuanyuan , Zimo Ji , Pingchuan Ma , Shuai Wang

Skill ecosystems for LLM agents have matured rapidly, yet recent benchmarks show that providing agents with more skills does not monotonically improve performance -- focused sets of 2-3 skills outperform comprehensive documentation, and…

Computation and Language · Computer Science 2026-04-21 Tianle Xia , Lingxiang Hu , Yiding Sun , Ming Xu , Lan Xu , Siying Wang , Wei Xu , Jie Jiang

Embodied agents can benefit from skills that guide object search, action execution, and state changes across diverse environments. Since embodied environments vary across layouts, object states, and other execution factors, these skills…

Artificial Intelligence · Computer Science 2026-05-12 Ruofei Ju , Xinrui Wang , Xin Ding , Yifan Yang , Hao Wu , Shiqi Jiang , Qianxi Zhang , Hao Wen , Xiangyu Li , Weijun Wang , Kun Li , Yunxin Liu , Haipeng Dai , Wei Wang , Ting Cao

Reusable skills let LLM agents package task-specific procedures, tool affordances, and execution guidance into modular building blocks. As skill ecosystems grow to tens of thousands of entries, exposing every skill at inference time becomes…

Machine Learning · Computer Science 2026-04-02 YanZhao Zheng , ZhenTao Zhang , Chao Ma , YuanQiang Yu , JiHuai Zhu , Yong Wu , Tianze Xu , Baohua Dong , Hangcheng Zhu , Ruohui Huang , Gang Yu

Text-to-SQL ensembles improve over single-candidate generation by drawing multiple SQL candidates and selecting one, but their effectiveness is bounded by Pass@K, the probability that at least one of K candidates is correct. Existing…

We present RoboPhD, a system where AI agents autonomously conduct research to improve Text-to-SQL performance. RoboPhD implements a closed-loop evolution cycle with two coordinated components: a SQL Generation agent composed of a database…

Computation and Language · Computer Science 2026-01-27 Andrew Borthwick , Stephen Ash

Agent skills extend LLM agents with reusable instructions, tool interfaces, and executable code, and users increasingly install third-party skills from marketplaces, repositories, and community channels. Because a skill exposes both…

Cryptography and Security · Computer Science 2026-05-13 Zhaojiacheng Zhou

Multi-label image classification demands adaptive training strategies to navigate complex, evolving visual-semantic landscapes, yet conventional methods rely on static configurations that falter in dynamic settings. We propose MAT-Agent, a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jusheng Zhang , Kaitong Cai , Yijia Fan , Ningyuan Liu , Keze Wang

Code efficiency is a fundamental aspect of software quality, yet how to harness large language models (LLMs) to optimize programs remains challenging. Prior approaches have sought for one-shot rewriting, retrieved exemplars, or prompt-based…

Software Engineering · Computer Science 2026-03-31 Zimu Wang , Yuling Shi , Mengfan Li , Zijun Liu , Jie M. Zhang , Chengcheng Wan , Xiaodong Gu

Automatic code optimization remains a difficult challenge, particularly for complex loop nests on modern hardware. This paper investigates a novel approach to code optimization where Large Language Models (LLMs) guide the process through a…

Programming Languages · Computer Science 2025-12-30 Massinissa Merouani , Islem Kara Bernou , Riyadh Baghdadi

Large pre-trained vision-language models like CLIP have shown great potential in learning representations that are transferable across a wide range of downstream tasks. Different from the traditional representation learning that is based…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Kaiyang Zhou , Jingkang Yang , Chen Change Loy , Ziwei Liu

We investigate whether giving LLM agents the collaborative tools and autonomy that humans naturally use for problem solving can improve their performance. We equip Claude Code agents with MCP-based social media and journaling tools and…

Artificial Intelligence · Computer Science 2025-09-18 Harper Reed , Michael Sugimura , Angelo Zangari

Large language model (LLM) agents are moving beyond prompting alone. ChatGPT marked the rise of general-purpose LLM assistants, DeepSeek showed that on-policy reinforcement learning with verifiable rewards can improve reasoning and tool…