English
Related papers

Related papers: AutoRefine: From Trajectories to Reusable Expertis…

200 papers

Memory-augmented LLM agents offer an appealing shortcut to continual learning: rather than updating model parameters, they accumulate experience in external memory, seemingly sidestepping the stability-plasticity dilemma of parametric…

Machine Learning · Computer Science 2026-05-01 Qisheng Hu , Quanyu Long , Wenya Wang

The remarkable success of pretrained language models has motivated the study of what kinds of knowledge these models learn during pretraining. Reformulating tasks as fill-in-the-blanks problems (e.g., cloze tests) is a natural approach for…

Computation and Language · Computer Science 2020-11-10 Taylor Shin , Yasaman Razeghi , Robert L. Logan , Eric Wallace , Sameer Singh

Agentic reinforcement learning has advanced large language models (LLMs) to reason through long chain-of-thought trajectories while interleaving external tool use. Existing approaches assume a fixed inventory of tools, limiting LLM agents'…

Computation and Language · Computer Science 2025-12-16 Jiaru Zou , Ling Yang , Yunzhe Qi , Sirui Chen , Mengting Ai , Ke Shen , Jingrui He , Mengdi Wang

Autonomous agents powered by large language models (LLMs) have the potential to significantly enhance human productivity by reasoning, using tools, and executing complex tasks in diverse environments. However, current approaches to…

Large language model (LLM) agents accumulate rich episodic trajectories while solving real-world tasks, but it remains unclear whether such experience can be distilled into reusable procedural skills. We introduce SkillEvolBench, a…

Large language model (LLM) agents deployed for multi-step tasks frequently fail in predictable ways: attempting actions with unmet preconditions, issuing redundant commands, or mishandling environment constraints. While retrieval-augmented…

Artificial Intelligence · Computer Science 2025-10-03 Humaid Ibrahim , Nikolai Rozanov , Marek Rei

Coding agents produce rich trajectories while solving software-engineering tasks. To enable agent self-evolution, these trajectories can be distilled into reusable procedural skills that compactly encode experience to guide future behavior.…

Artificial Intelligence · Computer Science 2026-05-26 Yanzhou Li , Yiran Zhang , Xiaoyu Zhang , Xiaoxia Liu , Yang Liu

The transition from monolithic large language models (LLMs) to modular, skill-equipped agents represents a fundamental architectural shift in artificial intelligence deployment. While general-purpose models demonstrate remarkable breadth in…

Artificial Intelligence · Computer Science 2026-03-18 Shuzhen Bi , Mengsong Wu , Hao Hao , Keqian Li , Wentao Liu , Siyu Song , Hongbo Zhao , Aimin Zhou

Large language models (LLMs) have shown impressive capabilities across a wide range of language tasks. However, their reasoning process is primarily guided by statistical patterns in training data, which limits their ability to handle novel…

Artificial Intelligence · Computer Science 2025-08-21 Hong Su

Large language models are increasingly deployed as autonomous agents that must plan, act, and recover from mistakes through long-horizon interaction with environments that provide rich feedback. However, prevailing outcome-driven…

Artificial Intelligence · Computer Science 2026-03-18 Rui Ge , Yichao Fu , Yuyang Qian , Junda Su , Yiming Zhao , Peng Zhao , Hao Zhang

Recent advancements in Large Language Models (LLMs) have shown significant progress in understanding complex natural language. One important application of LLM is LLM-based AI Agent, which leverages the ability of LLM as well as external…

Computation and Language · Computer Science 2024-07-19 Zelong Li , Shuyuan Xu , Kai Mei , Wenyue Hua , Balaji Rama , Om Raheja , Hao Wang , He Zhu , Yongfeng Zhang

Traditional enterprises face significant challenges in processing business documents, where tasks like extracting transport references from invoices remain largely manual despite their crucial role in logistics operations. While Large…

Computation and Language · Computer Science 2024-12-23 Jiale Liu , Yifan Zeng , Malte Højmark-Bertelsen , Marie Normann Gadeberg , Huazheng Wang , Qingyun Wu

Generating complex, logically-sound SPARQL queries for multi-hop questions remains a critical bottleneck for Knowledge Graph Question Answering, as the brittle nature of one-shot generation by Large Language Models (LLMs) hinders reliable…

Artificial Intelligence · Computer Science 2025-11-18 Floris Vossebeld , Shenghui Wang

Training large language model (LLM) agents to acquire necessary skills and perform diverse tasks within an environment is gaining interest as a means to enable open-endedness. However, creating the training dataset for their skill…

Artificial Intelligence · Computer Science 2025-06-23 Yongjin Yang , Sinjae Kang , Juyong Lee , Dongjun Lee , Se-Young Yun , Kimin Lee

AI agents, empowered by Large Language Models (LLMs) and communication protocols such as MCP and A2A, have rapidly evolved from simple chatbots to autonomous entities capable of executing complex, multi-step tasks, demonstrating great…

Machine Learning · Computer Science 2025-05-26 Erhu Feng , Wenbo Zhou , Zibin Liu , Le Chen , Yunpeng Dong , Cheng Zhang , Yisheng Zhao , Dong Du , Zhichao Hua , Yubin Xia , Haibo Chen

Optimization modeling underlies critical decision-making across industries, yet remains difficult to automate: natural-language problem descriptions must be translated into precise mathematical formulations and executable solver code.…

The ability to detect and analyze failed executions automatically is crucial for an explainable and robust robotic system. Recently, Large Language Models (LLMs) have demonstrated strong reasoning abilities on textual inputs. To leverage…

Robotics · Computer Science 2023-10-18 Zeyi Liu , Arpit Bahety , Shuran Song

Machine learning models are widely integrated into modern mobile apps to analyze user behaviors and deliver personalized services. Ensuring low-latency on-device model execution is critical for maintaining high-quality user experiences.…

Machine Learning · Computer Science 2026-03-24 Chen Gong , Zhenzhe Zheng , Yiliu Chen , Sheng Wang , Fan Wu , Guihai Chen

Large language models (LLMs) and their associated agent-based frameworks have significantly advanced automated information extraction, a critical component of modern recommender systems. While these multitask frameworks are widely used in…

Information Retrieval · Computer Science 2025-07-28 Blaž Škrlj , Benoît Guilleminot , Andraž Tori

Existing research on large language models (LLMs) shows that they can solve information extraction tasks through multi-step planning. However, their extraction behavior on complex sentences and tasks is unstable, emerging issues such as…

Computation and Language · Computer Science 2024-08-30 Zepeng Ding , Ruiyang Ke , Wenhao Huang , Guochao Jiang , Yanda Li , Deqing Yang , Jiaqing Liang