English
Related papers

Related papers: TopoCurate:Modeling Interaction Topology for Tool-…

200 papers

Large Language Models (LLMs) have shown remarkable performance in completing various tasks. However, solving complex problems often requires the coordination of multiple agents, raising a fundamental question: how to effectively select and…

Computation and Language · Computer Science 2026-04-02 Eric Hanchen Jiang , Levina Li , Rui Sun , Xiao Liang , Yubei Li , Yuchen Wu , Haozheng Luo , Hengli Li , Zhi Zhang , Zhaolu Kang , Kai-Wei Chang , Ying Nian Wu

When language model agents tackle complex software engineering tasks, they often degrade over long trajectories, which we define as *agent drift*. We focus on two recurring failure modes *overthinking* and *overacting*, i.e., where the…

Artificial Intelligence · Computer Science 2026-05-08 Yuan Sui , Yulin Chen , Yibo Li , Xue Jiang , Yufei He , Yihong Dong , Xiaoxin He , Tianyu Gao , Bryan Hooi

Tool-augmented language models have demonstrated strong capabilities, but their reliance on live API access creates scalability and reliability challenges during training and deployment. We propose MTR, a simulation-first training framework…

Computation and Language · Computer Science 2025-10-10 Chenpeng Wang , Xiaojie Cheng , Chunye Wang , Linfeng Yang , Lei Zhang

We present a domain-grounded framework and benchmark for tool-aware plan generation in contact centers, where answering a query for business insights, our target use case, requires decomposing it into executable steps over structured tools…

Computation and Language · Computer Science 2026-02-17 Varun Nathan , Shreyas Guha , Ayush Kumar

Large language models (LLMs) achieve remarkable advancements by leveraging tools to interact with environments, a critical step toward generalized AI. However, the standard supervised fine-tuning (SFT) approach, which relies on large-scale…

Computation and Language · Computer Science 2025-08-27 Junjie Ye , Yilong Wu , Sixian Li , Yuming Yang , Zhiheng Xi , Tao Gui , Qi Zhang , Xuanjing Huang , Peng Wang , Zhongchao Shi , Jianping Fan , Zhengyin Du

Learning effective region embeddings from heterogeneous urban data underpins key urban computing tasks (e.g., crime prediction, resource allocation). However, prevailing two-stage methods yield task-agnostic representations, decoupling them…

Artificial Intelligence · Computer Science 2026-02-03 Zitao Guo , Changyang Jiang , Tianhong Zhao , Jinzhou Cao , Genan Dai , Bowen Zhang

In many reinforcement learning tasks, the agent has to learn to interact with many objects of different types and generalize to unseen combinations and numbers of objects. Often a task is a composition of previously learned tasks (e.g.…

Machine Learning · Computer Science 2023-07-19 Fan Feng , Sara Magliacane

Intent detection, a critical component in task-oriented dialogue (TOD) systems, faces significant challenges in adapting to the rapid influx of integrable tools with complex interrelationships. Existing approaches, such as zero-shot…

Computation and Language · Computer Science 2025-04-22 Zihao Feng , Xiaoxue Wang , Ziwei Bai , Donghang Su , Bowen Wu , Qun Yu , Baoxun Wang

Cross-modal retrieval aims to search for instances, which are semantically related to the query through the interaction of different modal data. Traditional solutions utilize a single-tower or dual-tower framework to explicitly compute the…

Information Retrieval · Computer Science 2025-12-02 Minghui Fang , Shengpeng Ji , Jialong Zuo , Hai Huang , Yan Xia , Jieming Zhu , Xize Cheng , Xiaoda Yang , Wenrui Liu , Gang Wang , Zhenhua Dong , Zhou Zhao

Effective interactive tool use requires agents to master Tool Integrated Reasoning (TIR): a complex process involving multi-turn planning and long-context dialogue management. To train agents for this dynamic process, particularly in…

Computation and Language · Computer Science 2025-09-19 Weiting Tan , Xinghua Qu , Ming Tu , Meng Ge , Andy T. Liu , Philipp Koehn , Lu Lu

Large Language Models (LLMs) can extend their parameter knowledge limits by adopting the Tool-Integrated Reasoning (TIR) paradigm. However, existing LLM-based agent training framework often focuses on answers' accuracy, overlooking specific…

Artificial Intelligence · Computer Science 2026-01-21 Yifei Chen , Guanting Dong , Zhicheng Dou

To fulfill user instructions, autonomous web agents must contend with the inherent complexity and volatile nature of real-world websites. Conventional paradigms predominantly rely on Supervised Fine-Tuning (SFT) or Offline Reinforcement…

Artificial Intelligence · Computer Science 2026-05-01 Yuyu Guo , Wenjie Yang , Siyuan Yang , Ziyang Liu , Cheng Chen , Yuan Wei , Yun Hu , Yang Huang , Guoliang Hao , Dongsheng Yuan , Jianming Wang , Xin Chen , Hang Yu , Lei Lei , Peng Di

Task-oriented dialog systems have witnessed substantial progress due to conversational pre-training techniques. Yet, two significant challenges persist. First, most systems primarily utilize the latest turn's state label for the generator.…

Computation and Language · Computer Science 2024-01-30 Longxiang Liu , Xiuxing Li , Yang Feng

Multi-agent systems (MAS) powered by large language models (LLMs) have emerged as a powerful paradigm for complex problem solving, where performance critically depends on the underlying inter-agent communication topology. However, existing…

Machine Learning · Computer Science 2026-05-19 Xuefei Wang , Jialu Wang , Fengbo Zhang , Yihan Hu , Di Zhang , Yutong Ye , Yikun Ban , Jun Han , Ruijie Wang

Post-training methods, especially Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), play an important role in improving large language models' (LLMs) complex reasoning abilities. However, the dominant two-stage pipeline (SFT…

Machine Learning · Computer Science 2025-12-22 Mingyu Su , Jian Guan , Yuxian Gu , Minlie Huang , Hongning Wang

Inspired by human-like behaviors for navigation: first searching to explore unknown areas before discovering the target, and then the pathfinding of moving towards the discovered target, recent studies design parallel submodules to achieve…

Artificial Intelligence · Computer Science 2025-07-23 Yanwei Zheng , Shaopu Feng , Bowen Huang , Chuanlin Lan , Xiao Zhang , Dongxiao Yu

This paper introduces a decentralized multi-agent reinforcement learning framework enabling structurally heterogeneous teams of agents to jointly discover and acquire randomly located targets in environments characterized by partial…

Robotics · Computer Science 2026-01-14 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

Intelligent fault-tolerant (FT) computing has recently demonstrated significant advantages in predicting and diagnosing faults proactively, thereby ensuring reliable service delivery. However, due to the heterogeneity of fault knowledge,…

Machine Learning · Computer Science 2025-12-15 Wenjing Xiao , Wenhao Song , Miaojiang Chen , Min Chen

Large language models (LLMs) have evolved AI assistants into autonomous reasoning engines that maintain context, invoke tools, and pursue long-horizon tasks. This has spurred Agent Operating Systems (Agent OS) as kernel-like layers for…

Human-Computer Interaction · Computer Science 2026-05-18 Heyuan Huang , Yeyi Guan , Jihong Wang , Mingzhi Wang , Jiamu Zhou , Xiangmou Qu , Jiaxin Yin , Xin Liao , Xingyu Lou , Jun Wang

Research on applications of reinforcement learning (RL) to large language models has mostly been focused on single-turn problems, such as mathematical reasoning or single-shot code generation. While these problems can be viewed as…