English
Related papers

Related papers: Trajectory2Task: Training Robust Tool-Calling Agen…

200 papers

There is a growing demand for agentic AI technologies for a range of downstream applications like customer service and personal assistants. For applications where the agent needs to interact with a person, real-time low-latency…

Agentic AI architectures augment LLMs with external tools, unlocking strong capabilities. However, tool use is not always beneficial; some calls may be redundant or even harmful. Effective tool use, therefore, hinges on a core LLM decision:…

Artificial Intelligence · Computer Science 2026-05-04 Qinyuan Wu , Soumi Das , Mahsa Amani , Arijit Nag , Seungeon Lee , Krishna P. Gummadi , Abhilasha Ravichander , Muhammad Bilal Zafar

Vision language models (VLMs) are increasingly deployed as controllers with access to external tools for complex reasoning and decision-making, yet their effectiveness remains limited by the scarcity of high-quality multimodal trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Tajamul Ashraf , Umair Nawaz , Abdelrahman M. Shaker , Rao Anwer , Philip Torr , Fahad Shahbaz Khan , Salman Khan

Developing language model-based dialogue agents requires effective data to train models that can follow specific task logic. However, most existing data simulation methods focus on increasing diversity in language, topics, or dialogue acts…

Computation and Language · Computer Science 2025-03-04 Wanyu Du , Song Feng , James Gung , Lijia Sun , Yi Zhang , Saab Mansour , Yanjun Qi

In order for humans to confidently decide where to employ RL agents for real-world tasks, a human developer must validate that the agent will perform well at test-time. Some policy interpretability methods facilitate this by capturing the…

Machine Learning · Computer Science 2022-03-22 Julius Frost , Olivia Watkins , Eric Weiner , Pieter Abbeel , Trevor Darrell , Bryan Plummer , Kate Saenko

Information seeking is a fundamental requirement for humans. However, existing LLM agents rely heavily on open-web search, which exposes two fundamental weaknesses: online content is noisy and unreliable, and many real-world tasks require…

Computation and Language · Computer Science 2025-10-07 Yaxin Du , Yuanshuo Zhang , Xiyuan Yang , Yifan Zhou , Cheng Wang , Gongyi Zou , Xianghe Pang , Wenhao Wang , Menglan Chen , Shuo Tang , Zhiyu Li , Feiyu Xiong , Siheng Chen

While Language Models (LMs) have made significant progress in automating machine learning engineering (MLE), the acquisition of high-quality MLE training data is significantly constrained. Current MLE benchmarks suffer from low scalability…

Machine Learning · Computer Science 2025-10-09 Rushi Qiang , Yuchen Zhuang , Anikait Singh , Percy Liang , Chao Zhang , Sherry Yang , Bo Dai

The recent trend of using Large Language Models (LLMs) as tool agents in real-world applications underscores the necessity for comprehensive evaluations of their capabilities, particularly in complex scenarios involving planning, creating,…

Computation and Language · Computer Science 2024-06-04 Shijue Huang , Wanjun Zhong , Jianqiao Lu , Qi Zhu , Jiahui Gao , Weiwen Liu , Yutai Hou , Xingshan Zeng , Yasheng Wang , Lifeng Shang , Xin Jiang , Ruifeng Xu , Qun Liu

Training effective AI agents for multi-turn interactions requires high-quality data that captures realistic human-agent dynamics, yet such data is scarce and expensive to collect manually. We introduce APIGen-MT, a two-phase framework that…

Web-based 'deep research' agents aim to solve complex question - answering tasks through long-horizon interactions with online tools. These tasks remain challenging, as the underlying language models are often not optimized for long-horizon…

Computation and Language · Computer Science 2025-10-17 Shrey Pandit , Xuan-Phi Nguyen , Yifei Ming , Austin Xu , Jiayu Wang , Caiming Xiong , Shafiq Joty

Large Language Model (LLM) Agents leverage the advanced reasoning capabilities of LLMs in real-world applications. To interface with an environment, these agents often rely on tools, such as web search or database APIs. As the agent…

Artificial Intelligence · Computer Science 2025-03-12 Ivan Milev , Mislav Balunović , Maximilian Baader , Martin Vechev

The growing capabilities of large language models (LLMs) in instruction-following and context-understanding lead to the era of agents with numerous applications. Among these, task planning agents have become especially prominent in…

We introduce AgentSynth, a scalable and cost-efficient pipeline for automatically synthesizing high-quality tasks and trajectory datasets for generalist computer-use agents. Leveraging information asymmetry, AgentSynth constructs subtasks…

Computation and Language · Computer Science 2026-03-03 Jingxu Xie , Dylan Xu , Xuandong Zhao , Dawn Song

Fine-tuning on agent-environment interaction trajectory data holds significant promise for surfacing generalized agent capabilities in open-source large language models (LLMs). In this work, we introduce AgentBank, by far the largest…

Computation and Language · Computer Science 2024-10-11 Yifan Song , Weimin Xiong , Xiutian Zhao , Dawei Zhu , Wenhao Wu , Ke Wang , Cheng Li , Wei Peng , Sujian Li

Effective tool use is essential for large language models (LLMs) to interact with their environment. However, progress is limited by the lack of efficient reinforcement learning (RL) frameworks specifically designed for tool use, due to…

Computation and Language · Computer Science 2026-04-16 Junjie Ye , Changhao Jiang , Zhengyin Du , Yufei Xu , Xuesong Yao , Zhiheng Xi , Xiaoran Fan , Qi Zhang , Tao Gui , Xuanjing Huang , Jiecao Chen

Symbolic world models (e.g., PDDL domains or executable simulators) are central to model-based planning, but training LLMs to generate such world models is limited by the lack of large-scale verifiable supervision. Current approaches rely…

Artificial Intelligence · Computer Science 2025-12-30 Mengkang Hu , Bowei Xia , Yuran Wu , Ailing Yu , Yude Zou , Qiguang Chen , Shijian Wang , Jiarui Jin , Kexin Li , Wenxiang Jiao , Yuan Lu , Ping Luo

Large language models (LLMs) have demonstrated strong capabilities in using external tools to address user inquiries. However, most existing evaluations assume tool use in short contexts, offering limited insight into model behavior during…

Computation and Language · Computer Science 2025-11-24 Beong-woo Kwak , Minju Kim , Dongha Lim , Hyungjoo Chae , Dongjin Kang , Sunghwan Kim , Dongil Yang , Jinyoung Yeo

Large Language Model (LLM) agents significantly extend the capabilities of standalone LLMs, empowering them to interact with external tools (e.g., APIs, functions) and complete various tasks in a self-directed fashion. The challenge of tool…

Artificial Intelligence · Computer Science 2024-02-19 Weizhou Shen , Chenliang Li , Hongzhan Chen , Ming Yan , Xiaojun Quan , Hehong Chen , Ji Zhang , Fei Huang

Large language models (LLMs) have displayed massive improvements in reasoning and decision-making skills and can hold natural conversations with users. Many recent works seek to augment LLM-based assistants with external tools so they can…

Computation and Language · Computer Science 2023-11-21 Nicholas Farn , Richard Shin

LLM-powered agents face a persistent challenge: learning from their execution experiences to improve future performance. While agents can successfully complete many tasks, they often repeat inefficient patterns, fail to recover from similar…

Artificial Intelligence · Computer Science 2026-03-12 Gaodan Fang , Vatche Isahagian , K. R. Jayaram , Ritesh Kumar , Vinod Muthusamy , Punleuk Oum , Gegi Thomas
‹ Prev 1 3 4 5 6 7 10 Next ›