English
Related papers

Related papers: Trace2Skill: Distill Trajectory-Local Lessons into…

200 papers

Large language models are increasingly deployed across diverse applications. This often includes tasks LLMs have not encountered during training. This implies that enumerating and obtaining the high-quality training data for all tasks is…

Computation and Language · Computer Science 2025-11-11 Shambhavi Krishna , Atharva Naik , Chaitali Agarwal , Sudharshan Govindan , Taesung Lee , Haw-Shiuan Chang

Large Language Models (LLMs) have demonstrated remarkable capabilities on various tasks, while the further evolvement is limited to the lack of high-quality training data. In addition, traditional training approaches rely too much on…

Computation and Language · Computer Science 2025-02-14 Peidong Wang , Ming Wang , Zhiming Ma , Xiaocui Yang , Shi Feng , Daling Wang , Yifei Zhang , Kaisong Song

The increasing adoption of agentic workflows across diverse domains brings a critical need to scalably and systematically evaluate the complex traces these systems generate. Current evaluation methods depend on manual, domain-specific human…

Artificial Intelligence · Computer Science 2025-06-25 Darshan Deshpande , Varun Gangal , Hersh Mehta , Jitin Krishnan , Anand Kannappan , Rebecca Qian

Large Language Models (LLMs) often generate code with subtle but critical bugs, especially for complex tasks. Existing automated repair methods typically rely on superficial pass/fail signals, offering limited visibility into program…

Software Engineering · Computer Science 2026-02-09 Jiangping Huang , Wenguang Ye , Weisong Sun , Jian Zhang , Mingyue Zhang , Yang Liu

Large language model (LLM) powered AI agents have emerged as a promising paradigm for autonomous problem-solving, yet they continue to struggle with complex, multi-step real-world tasks that demand domain-specific procedural knowledge.…

Artificial Intelligence · Computer Science 2026-05-12 Yixuan Li , Mingshu Cai , Ziyang Xiao , Wanyuan Wang , Yanchen Deng , Bo An

The ability to effectively reuse prior knowledge is a key requirement when building general and flexible Reinforcement Learning (RL) agents. Skill reuse is one of the most common approaches, but current methods have considerable…

Most Large Language Model (LLM) agent memory systems rely on a small set of static, hand-designed operations for extracting memory. These fixed procedures hard-code human priors about what to store and how to revise memory, making them…

Computation and Language · Computer Science 2026-05-26 Haozhen Zhang , Quanyu Long , Jianzhu Bao , Tao Feng , Weizhi Zhang , Haodong Yue , Wenya Wang

Embodied agents can benefit from skills that guide object search, action execution, and state changes across diverse environments. Since embodied environments vary across layouts, object states, and other execution factors, these skills…

Artificial Intelligence · Computer Science 2026-05-12 Ruofei Ju , Xinrui Wang , Xin Ding , Yifan Yang , Hao Wu , Shiqi Jiang , Qianxi Zhang , Hao Wen , Xiangyu Li , Weijun Wang , Kun Li , Yunxin Liu , Haipeng Dai , Wei Wang , Ting Cao

Recent studies provide large language models (LLMs) with textual task-solving experiences via prompts to improve their performance. However, previous methods rely on substantial human labor or time to gather such experiences for each task,…

Computation and Language · Computer Science 2025-05-30 Jinglong Gao , Xiao Ding , Lingxiao Zou , Bibo Cai , Bing Qin , Ting Liu

Competency modeling is widely used in human resource management to select, develop, and evaluate talent. However, traditional expert-driven approaches rely heavily on manual analysis of large volumes of interview transcripts, making them…

Computation and Language · Computer Science 2026-02-16 Silin Du , Manqing Xin , Raymond Jia Wang

The transition from monolithic language models to modular, skill-equipped agents marks a defining shift in how large language models (LLMs) are deployed in practice. Rather than encoding all procedural knowledge within model weights, agent…

Multiagent Systems · Computer Science 2026-02-18 Renjun Xu , Yang Yan

Large Language Models (LLMs) often struggle with the precise logic and schema alignment required for complex Text-to-SQL tasks. While current methods rely heavily on static prompting, they lack the ability to dynamically adapt and…

Computation and Language · Computer Science 2026-05-12 Haolin Yang , Jipeng Zhang , Zhitao He , Alexander Zhou , Yi R. Fung

Large language model (LLM) agents such as OpenClaw rely on reusable skills to perform complex tasks, yet these skills remain largely static after deployment. As a result, similar workflows, tool usage patterns, and failure modes are…

Artificial Intelligence · Computer Science 2026-04-10 Ziyu Ma , Shidong Yang , Yuxiang Ji , Xucong Wang , Yong Wang , Yiming Hu , Tongwen Huang , Xiangxiang Chu

The main challenge in lifelong imitation learning lies in the balance between mitigating catastrophic forgetting of previous skills while maintaining sufficient capacity for acquiring new ones. However, current approaches typically address…

Machine Learning · Computer Science 2025-08-05 Hongquan Zhang , Jingyu Gong , Zhizhong Zhang , Xin Tan , Yanyun Qu , Yuan Xie

Skills, i.e., structured workflow instructions distilled for large language models (LLMs), are becoming an increasingly important mechanism for improving agent performance on real-world downstream tasks. However, as the open-source skill…

Computation and Language · Computer Science 2026-05-29 Jiahao Ying , Boxian Ai , Wei Tang , Siyuan Liu , Yixin Cao

While Large Language Models (LLMs) have empowered AI research agents to perform isolated scientific tasks, automating complex, real-world workflows, such as LLM training, remains a significant challenge. In this paper, we introduce TREX, a…

Artificial Intelligence · Computer Science 2026-04-23 Zerun Ma , Guoqiang Wang , Xinchen Xie , Yicheng Chen , He Du , Bowen Li , Yanan Sun , Wenran Liu , Kai Chen , Yining Li

Large language model (LLM)-based agents increasingly rely on tool use to complete real-world tasks. While existing works evaluate the LLMs' tool use capability, they largely focus on the final answers yet overlook the detailed tool usage…

Post-training data plays a pivotal role in shaping the capabilities of Large Language Models (LLMs), yet datasets are often treated as isolated artifacts, overlooking the systemic connections that underlie their evolution. To disentangle…

Artificial Intelligence · Computer Science 2026-04-14 Yu Li , Xiaoran Shang , Qizhi Pei , Yun Zhu , Xin Gao , Honglin Lin , Zhanping Zhong , Zhuoshi Pan , Zheng Liu , Xiaoyang Wang , Conghui He , Dahua Lin , Feng Zhao , Lijun Wu

Large Language Model (LLM) agents have developed rapidly in recent years to solve complex real-world problems using external tools. However, the scarcity of high-quality trajectories still hinders the development of stronger LLM agents.…

Artificial Intelligence · Computer Science 2025-12-08 Chen Yang , Ran Le , Yun Xing , Zhenwei An , Zongchao Chen , Wayne Xin Zhao , Yang Song , Tao Zhang

Large Language Models (LLMs) can generate SQL queries from natural language questions but struggle with database-specific schemas and tacit domain knowledge. We introduce a framework for continual learning from human feedback in…

Computation and Language · Computer Science 2025-12-01 Thomas Cook , Kelly Patel , Sivapriya Vellaichamy , Udari Madhushani Sehwag , Saba Rahimi , Zhen Zeng , Sumitra Ganesh