English
Related papers

Related papers: SAND: Boosting LLM Agents with Self-Taught Action …

200 papers

Large language models (LLMs), optimized through human feedback, have rapidly emerged as a leading paradigm for developing intelligent conversational assistants. However, despite their strong performance across many benchmarks, LLM-based…

Computation and Language · Computer Science 2025-07-29 Maximillian Chen , Ruoxi Sun , Tomas Pfister , Sercan Ö. Arık

Recent advancements in Large Language Models (LLMs) have spurred interest in deploying LLM agents to undertake tasks in the world. LLMs are often deployed in agent systems: code that orchestrates LLM calls and provides them with tools. We…

Artificial Intelligence · Computer Science 2025-05-20 Maxime Robeyns , Martin Szummer , Laurence Aitchison

Large language models (LLMs) are increasingly used as autonomous agents, tackling tasks from robotics to web navigation. Their performance depends on the underlying base agent. Existing methods, however, struggle with long-context reasoning…

Artificial Intelligence · Computer Science 2025-04-09 Nikolai Rozanov , Marek Rei

Open-sourced Large Language Models (LLMs) have achieved great success in various NLP tasks, however, they are still far inferior to API-based models when acting as agents. How to integrate agent ability into general LLMs becomes a crucial…

Computation and Language · Computer Science 2024-03-20 Zehui Chen , Kuikun Liu , Qiuchen Wang , Wenwei Zhang , Jiangning Liu , Dahua Lin , Kai Chen , Feng Zhao

Traditionally, offline datasets have been used to evaluate task-oriented dialogue (TOD) models. These datasets lack context awareness, making them suboptimal benchmarks for conversational systems. In contrast, user-agents, which are…

Computation and Language · Computer Science 2024-11-18 Taaha Kazi , Ruiliang Lyu , Sizhe Zhou , Dilek Hakkani-Tur , Gokhan Tur

Guiding large language models with a selected set of human-authored demonstrations is a common practice for improving LLM applications. However, human effort can be costly, especially in specialized domains (e.g., clinical diagnosis), and…

Artificial Intelligence · Computer Science 2024-08-23 Kai Tzu-iunn Ong , Taeyoon Kwon , Jinyoung Yeo

Large Language Model-based agents have garnered significant attention and are becoming increasingly popular. Furthermore, planning ability is a crucial component of an LLM-based agent, which generally entails achieving a desired goal from…

Computation and Language · Computer Science 2025-02-07 Mengkang Hu , Pu Zhao , Can Xu , Qingfeng Sun , Jianguang Lou , Qingwei Lin , Ping Luo , Saravan Rajmohan

Multi-agent debate has been shown to improve reasoning in large language models (LLMs). However, it is compute-intensive, requiring generation of long transcripts before answering questions. To address this inefficiency, we develop a…

Artificial Intelligence · Computer Science 2026-04-29 John Seon Keun Yi , Aaron Mueller , Dokyun Lee

Large Language Models (LLMs) are reshaping recommender systems by leveraging extensive world knowledge and semantic reasoning to interpret user intent. However, effectively integrating these capabilities with collaborative signals while…

Information Retrieval · Computer Science 2026-02-13 Yang Wu , Haoze Wang , Qian Li , Jun Zhang , Huan Yu , Jie Jiang

Open-source pre-trained Large Language Models (LLMs) exhibit strong language understanding and generation capabilities, making them highly successful in a variety of tasks. However, when used as agents for dealing with complex problems in…

Computation and Language · Computer Science 2024-04-01 Qinhao Zhou , Zihan Zhang , Xiang Xiang , Ke Wang , Yuchuan Wu , Yongbin Li

Large language models (LLMs) have shown potential in supporting decision-making applications, particularly as personal assistants in the financial, healthcare, and legal domains. While prompt engineering strategies have enhanced the…

Computation and Language · Computer Science 2025-11-04 Yougang Lyu , Shijie Ren , Yue Feng , Zihan Wang , Zhumin Chen , Zhaochun Ren , Maarten de Rijke

Small Language Models (SLMs) offer compelling advantages in deployment cost and latency, but their accuracy often lags behind larger models, particularly for complex domain-specific tasks. While supervised fine-tuning can help bridge this…

Artificial Intelligence · Computer Science 2025-10-22 Huan Song , Deeksha Razdan , Yiyue Qian , Arijit Ghosh Chowdhury , Parth Patwa , Aman Chadha , Shinan Zhang , Sharlina Keshava , Hannah Marlowe

The advancement of large language models (LLMs) has accelerated the development of autonomous financial trading systems. While mainstream approaches deploy multi-agent systems mimicking analyst and manager roles, they often rely on abstract…

Artificial Intelligence · Computer Science 2026-02-27 Kunihiro Miyazaki , Takanobu Kawahara , Stephen Roberts , Stefan Zohren

Large language models (LLMs) exhibit strong capabilities as decision-making agents by interleaving reasoning and actions, as seen in ReAct-style frameworks. Yet, their practical deployment is constrained by high inference costs and large…

Machine Learning · Computer Science 2026-05-28 Jun Liu , Zhenglun Kong , Peiyan Dong , Changdi Yang , Tianqi Li , Hao Tang , Geng Yuan , Wei Niu , Wenbin Zhang , Pu Zhao , Xue Lin , Dong Huang , Yanzhi Wang

Large Language Models (LLMs) have become a milestone in the field of artificial intelligence and natural language processing. However, their large-scale deployment remains constrained by the need for significant computational resources.…

Computation and Language · Computer Science 2025-08-07 Julián Camilo Velandia Gutiérrez

Large Language Models (LLMs) have demonstrated great potential in complex reasoning tasks, yet they fall short when tackling more sophisticated challenges, especially when interacting with environments through generating executable actions.…

Computation and Language · Computer Science 2025-02-25 Yuqi Zhu , Shuofei Qiao , Yixin Ou , Shumin Deng , Shiwei Lyu , Yue Shen , Lei Liang , Jinjie Gu , Huajun Chen , Ningyu Zhang

In this work we explore the performance and behavior of reasoning large language models to autonomously optimize atomic layer deposition (ALD) processes. In the ALD process optimization task, an agent built on top of a reasoning LLM has to…

Materials Science · Physics 2026-01-16 Angel Yanguas-Gil

Fine-tuning large language models for vertical domains remains labor-intensive, requiring practitioners to curate data, configure training, and iteratively diagnose model behavior. Despite growing interest in autonomous machine learning and…

Artificial Intelligence · Computer Science 2026-05-21 Qizheng Li , Yifei Zhang , Xiao Yang , Xu Yang , Zhuo Wang , Weiqing Liu , Jiang Bian

Skills provide an effective mechanism for improving LLM agents on complex tasks, yet in existing agent frameworks, their creation, refinement, and selection are typically governed by external teachers, hand-designed rules, or auxiliary…

Artificial Intelligence · Computer Science 2026-05-13 Min Yang , Jinghua Piao , Xu Xia , Xiaochong Lan , Jiaju Chen , Yongshun Gong , Yong Li

In this study, we propose LLM agents as a novel approach in behavioral strategy research, complementing simulations and laboratory experiments to advance our understanding of cognitive processes in decision-making. Specifically, we…

General Economics · Economics 2024-10-10 Daniel Albert , Stephan Billinger