English
Related papers

Related papers: ET-Agent: Incentivizing Effective Tool-Integrated …

200 papers

Large language models (LLMs) possess extensive knowledge bases and strong reasoning capabilities, making them promising tools for complex, multi-agent planning in embodied environments. However, despite LLMs' advanced abilities and the…

Multiagent Systems · Computer Science 2025-06-10 Xinran Li , Chenjia Bai , Zijian Li , Jiakun Zheng , Ting Xiao , Jun Zhang

Recently, LLM-powered driver agents have demonstrated considerable potential in the field of autonomous driving, showcasing human-like reasoning and decision-making abilities.However, current research on aligning driver agent behaviors with…

Robotics · Computer Science 2024-03-19 Ruoxuan Yang , Xinyue Zhang , Anais Fernandez-Laaksonen , Xin Ding , Jiangtao Gong

Large Language Model-based agents have garnered significant attention and are becoming increasingly popular. Furthermore, planning ability is a crucial component of an LLM-based agent, which generally entails achieving a desired goal from…

Computation and Language · Computer Science 2025-02-07 Mengkang Hu , Pu Zhao , Can Xu , Qingfeng Sun , Jianguang Lou , Qingwei Lin , Ping Luo , Saravan Rajmohan

The emergence of large language model (LLM)-based agents has significantly advanced the development of autonomous machine learning (ML) engineering. However, the dominant prompt-based paradigm exhibits limitations: smaller models lack the…

Computation and Language · Computer Science 2026-05-04 Zexi Liu , Jingyi Chai , Xinyu Zhu , Shuo Tang , Rui Ye , Bo Zhang , Lei Bai , Siheng Chen

Table reasoning requires models to jointly perform comprehensive semantic understanding and precise numerical operations. Although recent large language model (LLM)-based methods have achieved promising results, most of them still rely on a…

Artificial Intelligence · Computer Science 2025-12-23 Chuang Jiang , Mingyue Cheng , Xiaoyu Tao , Qingyang Mao , Jie Ouyang , Qi Liu

Large language models (LLMs) are becoming the foundation for autonomous agents that can use tools to solve complex tasks. Reinforcement learning (RL) has emerged as a common approach for injecting such agentic capabilities, but typically…

Machine Learning · Computer Science 2026-02-26 Emre Can Acikgoz , Cheng Qian , Jonas Hübotter , Heng Ji , Dilek Hakkani-Tür , Gokhan Tur

The functionality of Large Language Model (LLM) agents is primarily determined by two capabilities: action planning and answer summarization. The former, action planning, is the core capability that dictates an agent's performance. However,…

Machine Learning · Computer Science 2025-08-28 Zhiwei Li , Yong Hu , Wenqing Wang

Monitoring autonomous large language model (LLM) agents for covert malicious behavior is challenging due to delayed, context-dependent, and long-horizon attack patterns. Agents may pursue hidden objectives while maintaining superficially…

Machine Learning · Computer Science 2026-05-26 Nesreen K. Ahmed , Nima Nafisi

Large language models (LLMs) often struggle with mathematical problems that require exact computation or multi-step algebraic reasoning. Tool-integrated reasoning (TIR) offers a promising solution by leveraging external tools such as code…

Machine Learning · Computer Science 2025-06-25 Xingyue Huang , Xianglong Hu , Zifeng Ding , Yuan He , Rishabh , Waleed Alzarooni , Ziyu Ye , Wendong Fan , Bailan He , Haige Bo , Changran Hu , Guohao Li

Large Audio-Language Models (LALMs) perform well on audio understanding tasks but lack multistep reasoning and tool-calling found in recent Large Language Models (LLMs). This paper presents AudioToolAgent, a framework that coordinates…

Sound · Computer Science 2026-02-16 Gijs Wijngaard , Elia Formisano , Michel Dumontier , Jenia Jitsev

Large Language Model (LLM) based agents have proved their ability to perform complex tasks like humans. However, there is still a large gap between open-sourced LLMs and commercial models like the GPT series. In this paper, we focus on…

Artificial Intelligence · Computer Science 2025-02-25 Dayuan Fu , Keqing He , Yejie Wang , Wentao Hong , Zhuoma Gongque , Weihao Zeng , Wei Wang , Jingang Wang , Xunliang Cai , Weiran Xu

The emergence of autonomous Large Language Model (LLM) agents capable of tool usage has introduced new safety risks that go beyond traditional conversational misuse. These agents, empowered to execute external functions, are vulnerable to…

Artificial Intelligence · Computer Science 2025-07-14 Zeyang Sha , Hanling Tian , Zhuoer Xu , Shiwen Cui , Changhua Meng , Weiqiang Wang

Large language model (LLM) agents have shown impressive reasoning capabilities in interactive decision-making tasks. These agents interact with environment through intermediate interfaces, such as predefined action spaces and interaction…

Artificial Intelligence · Computer Science 2025-05-28 Kaiming Liu , Xuanyu Lei , Ziyue Wang , Peng Li , Yang Liu

Tool-Integrated Reasoning (TIR) has emerged as a promising direction by extending Large Language Models' (LLMs) capabilities with external tools during reasoning. Existing TIR methods typically rely on external tool documentation during…

Computation and Language · Computer Science 2026-04-14 Qiancheng Xu , Yongqi Li , Fan Liu , Hongru Wang , Min Yang , Wenjie Li

Large Language Model (LLM) Agents have recently garnered increasing interest yet they are limited in their ability to learn from trial and error, a key element of intelligent behavior. In this work, we argue that the capacity to learn new…

Artificial Intelligence · Computer Science 2024-08-09 Haiteng Zhao , Chang Ma , Guoyin Wang , Jing Su , Lingpeng Kong , Jingjing Xu , Zhi-Hong Deng , Hongxia Yang

While Large Vision-Language Models (LVLMs) have significantly advanced GUI agents' capabilities in parsing textual instructions, interpreting screen content, and executing tasks, a critical challenge persists: the irreversibility of agent…

Artificial Intelligence · Computer Science 2026-01-27 Shaokang Wang , Pei Fu , Ruoceng Zhang , Shaojie Zhang , Xiuwen Xi , Jiahui Yang , Bin Qin , Ying Huang , Zhenbo Luo , Jian Luan

Language Models and Vision Language Models have recently demonstrated unprecedented capabilities in terms of understanding human intentions, reasoning, scene understanding, and planning-like behaviour, in text form, among many others. In…

Computer-Aided Design (CAD) is an expert-level task that relies on long-horizon reasoning and coherent modeling actions. Large Language Models (LLMs) have shown remarkable advancements in enabling language agents to tackle real-world tasks.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yifei Gong , Xing Wu , Wenda Liu , Kang Tu

Current Large Language Model (LLM) agents show strong performance in tool use, but lack the crucial capability to systematically learn from their own experiences. While existing frameworks mainly focus on mitigating external knowledge gaps,…

Computation and Language · Computer Science 2026-05-19 Rong Wu , Xiaoman Wang , Jianbiao Mei , Pinlong Cai , Daocheng Fu , Cheng Yang , Licheng Wen , Xuemeng Yang , Yufan Shen , Yuxin Wang , Botian Shi

Test-Time Learning (TTL) enables language agents to iteratively refine their performance through repeated interactions with the environment at inference time. At the core of TTL is an adaptation policy that updates the actor policy based on…

Machine Learning · Computer Science 2026-04-03 Zhanzhi Lou , Hui Chen , Yibo Li , Qian Wang , Bryan Hooi