English
Related papers

Related papers: SynthTools: A Framework for Scaling Synthetic Tool…

200 papers

Augmenting Large Language Models (LLMs) with external tools enables them to execute complex, multi-step tasks. However, tool learning is hampered by the static synthetic data pipelines where data generation and model training are executed…

Computation and Language · Computer Science 2025-11-19 Kangning Zhang , Wenxiang Jiao , Kounianhua Du , Yuan Lu , Weiwen Liu , Weinan Zhang , Yong Yu

As LLM agents are increasingly built around reusable skills, a central challenge is no longer only whether agents can use provided skills, but whether they can generate correct, reusable, and executable skills from repositories and…

Artificial Intelligence · Computer Science 2026-05-19 Yifan Zhou , Zhentao Zhang , Ziming Cheng , Shuo Zhang , Qizhen Lan , Zhangquan Chen , Zhi Yang , QianyuXu , Ronghao Chen , Huacan Wang , Sen Hu

In the interaction between agents and their environments, agents expand their capabilities by planning and executing actions. However, LLM-based agents face substantial challenges when deployed in novel environments or required to navigate…

Computation and Language · Computer Science 2025-06-03 Runnan Fang , Xiaobin Wang , Yuan Liang , Shuofei Qiao , Jialong Wu , Zekun Xi , Ningyu Zhang , Yong Jiang , Pengjun Xie , Fei Huang , Huajun Chen

Synthesizing interactive 3D scenes from text is essential for gaming, virtual reality, and embodied AI. However, existing methods face several challenges. Learning-based approaches depend on small-scale indoor datasets, limiting the scene…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Lu Ling , Chen-Hsuan Lin , Tsung-Yi Lin , Yifan Ding , Yu Zeng , Yichen Sheng , Yunhao Ge , Ming-Yu Liu , Aniket Bera , Zhaoshuo Li

Large Language Models (LLMs) have demonstrated remarkable capabilities in orchestrating tools for reasoning tasks. However, existing methods rely on a step-wise paradigm that lacks a global perspective, which causes error accumulation over…

Artificial Intelligence · Computer Science 2026-05-11 Tairan Huang , Siyu Shang , Qiang Chen , Xiu Su , Yi Chen

Large Language Model (LLM) agents significantly extend the capabilities of standalone LLMs, empowering them to interact with external tools (e.g., APIs, functions) and complete various tasks in a self-directed fashion. The challenge of tool…

Artificial Intelligence · Computer Science 2024-02-19 Weizhou Shen , Chenliang Li , Hongzhan Chen , Ming Yan , Xiaojun Quan , Hehong Chen , Ji Zhang , Fei Huang

Large language models (LLMs) with extended context windows enable tasks requiring extensive information integration but are limited by the scarcity of high-quality, diverse datasets for long-context instruction tuning. Existing data…

Computation and Language · Computer Science 2025-02-25 Jiaxi Li , Xingxing Zhang , Xun Wang , Xiaolong Huang , Li Dong , Liang Wang , Si-Qing Chen , Wei Lu , Furu Wei

Large Language Models (LLMs) can enhance their capabilities as AI assistants by integrating external tools, allowing them to access a wider range of information. While recent LLMs are typically fine-tuned with tool usage examples during…

Computation and Language · Computer Science 2025-02-27 Jie He , Jennifer Neville , Mengting Wan , Longqi Yang , Hui Liu , Xiaofeng Xu , Xia Song , Jeff Z. Pan , Pei Zhou

Recent studies demonstrate that tool-calling capability enables large language models (LLMs) to interact with external environments for long-horizon financial tasks. While existing benchmarks have begun evaluating financial tool calling,…

Solving problems through tool use under explicit constraints constitutes a highly challenging yet unavoidable scenario for large language models (LLMs), requiring capabilities such as function calling, instruction following, and…

Computation and Language · Computer Science 2026-03-17 Junjie Ye , Guoqiang Zhang , Wenjie Fu , Tao Gui , Qi Zhang , Xuanjing Huang

We present SynthTextEval, a toolkit for conducting comprehensive evaluations of synthetic text. The fluency of large language model (LLM) outputs has made synthetic text potentially viable for numerous applications, such as reducing the…

Computation and Language · Computer Science 2025-11-04 Krithika Ramesh , Daniel Smolyak , Zihao Zhao , Nupoor Gandhi , Ritu Agarwal , Margrét Bjarnadóttir , Anjalie Field

Embodied agents have shown promising generalization capabilities across diverse physical environments, making them essential for a wide range of real-world applications. However, building versatile embodied agents poses critical challenges…

Robotics · Computer Science 2025-08-12 Shengli Zhou , Xiangchen Wang , Jinrui Zhang , Ruozai Tian , Rongtao Xu , Feng Zheng

The advancement of LLM agents with tool-use capabilities requires diverse and complex training corpora. Existing data generation methods, which predominantly follow a paradigm of random sampling and shallow generation, often yield simple…

Enterprises possess a vast array of API assets scattered across various functions, forming the backbone of existing business processes. By leveraging these APIs as functional tools, enterprises can design diverse, scenario-specific agent…

Artificial Intelligence · Computer Science 2024-12-23 Guancheng Zeng , Wentao Ding , Beining Xu , Chi Zhang , Wenqiang Han , Gang Li , Jingjing Mo , Pengxu Qiu , Xinran Tao , Wang Tao , Haowen Hu

Recent advancements in large language models (LLMs) have significantly advanced the automation of software development tasks, including code synthesis, program repair, and test generation. More recently, researchers and industry…

Software Engineering · Computer Science 2024-10-30 Chunqiu Steven Xia , Yinlin Deng , Soren Dunn , Lingming Zhang

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Terminal agents have demonstrated strong potential for autonomous command-line execution, yet their training remains constrained by the scarcity of high-quality and diverse execution trajectories. Existing approaches mitigate this…

Artificial Intelligence · Computer Science 2026-04-29 Zhiyuan Fan , Tinghao Yu , Yuanjun Cai , Jiangtao Guan , Yun Yang , Dingxin Hu , Jiang Zhou , Xing Wu , Zhuo Han , Feng Zhang , Lilin Wang

Mobile agents powered by vision-language models have demonstrated impressive capabilities in automating mobile tasks, with recent leading models achieving a marked performance leap, e.g., nearly 70% success on AndroidWorld. However, these…

Artificial Intelligence · Computer Science 2026-04-17 Kanzhi Cheng , Zehao Li , Zheng Ma , Nuo Chen , Jialin Cao , Qiushi Sun , Zichen Ding , Fangzhi Xu , Hang Yan , Jiajun Chen , Anh Tuan Luu , Jianbing Zhang , Lewei Lu , Dahua Lin

As LLM-based agents are increasingly deployed in real-life scenarios, existing benchmarks fail to capture their inherent complexity of handling extensive information, leveraging diverse resources, and managing dynamic user interactions. To…

Computation and Language · Computer Science 2025-10-20 Wei He , Yueqing Sun , Hongyan Hao , Xueyuan Hao , Zhikang Xia , Qi Gu , Chengcheng Han , Dengchang Zhao , Hui Su , Kefeng Zhang , Man Gao , Xi Su , Xiaodong Cai , Xunliang Cai , Yu Yang , Yunke Zhao

Large Language Models (LLMs) have emerged as powerful tools for accelerating scientific discovery, yet their static knowledge and hallucination issues hinder autonomous research applications. Recent advances integrate LLMs into agentic…

Artificial Intelligence · Computer Science 2025-12-23 Zeyu Xia , Jinzhe Ma , Congjie Zheng , Shufei Zhang , Yuqiang Li , Hang Su , P. Hu , Changshui Zhang , Xingao Gong , Wanli Ouyang , Lei Bai , Dongzhan Zhou , Mao Su