English
Related papers

Related papers: ToolForge: A Data Synthesis Pipeline for Multi-Hop…

200 papers

Function calling significantly extends the application boundary of large language models, where high-quality and diverse training data is critical for unlocking this capability. However, real function-calling data is quite challenging to…

The high cost of agentic workflows in formal mathematics hinders large-scale data synthesis, exacerbating the scarcity of open-source corpora. To address this, we introduce \textbf{TheoremForge}, a cost-effective formal data synthesis…

Artificial Intelligence · Computer Science 2026-01-27 Yicheng Tao , Hongteng Xu

Training tool-calling agents requires large-scale trajectory data with verifiable labels, yet existing approaches either synthesize environments that diverge from real API behavior or generate tasks without ground-truth outcomes for…

Multi-turn tool calling is essential for LLMs to function as autonomous agents, yet synthesizing the training data required for these capabilities remains a fundamental challenge. Existing synthetic data generation pipelines often produce…

Computation and Language · Computer Science 2026-05-14 Dinesh Khandelwal , Gnana Prakash Punnavajhala , GPS Bhargav , Gaurav Pandey , Sachin Joshi , Hima Karanam , Dinesh Raghu

Supervised fine-tuning (SFT) is a common method to enhance the tool calling capabilities of Large Language Models (LLMs), with the training data often being synthesized. The current data synthesis process generally involves sampling a set…

Computation and Language · Computer Science 2025-03-18 Zezhong Wang , Xingshan Zeng , Weiwen Liu , Liangyou Li , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical…

Computation and Language · Computer Science 2025-10-09 Shuang Sun , Huatong Song , Yuhao Wang , Ruiyang Ren , Jinhao Jiang , Junjie Zhang , Fei Bai , Jia Deng , Wayne Xin Zhao , Zheng Liu , Lei Fang , Zhongyuan Wang , Ji-Rong Wen

Large Language Model (LLM) agents have developed rapidly in recent years to solve complex real-world problems using external tools. However, the scarcity of high-quality trajectories still hinders the development of stronger LLM agents.…

Artificial Intelligence · Computer Science 2025-12-08 Chen Yang , Ran Le , Yun Xing , Zhenwei An , Zongchao Chen , Wayne Xin Zhao , Yang Song , Tao Zhang

Effective evaluation of multi-hop tool use is critical for analyzing the understanding, reasoning, and function-calling capabilities of large language models (LLMs). However, progress has been hindered by a lack of reliable evaluation…

Computation and Language · Computer Science 2025-05-21 Junjie Ye , Zhengyin Du , Xuesong Yao , Weijian Lin , Yufei Xu , Zehui Chen , Zaiyuan Wang , Sining Zhu , Zhiheng Xi , Siyu Yuan , Tao Gui , Qi Zhang , Xuanjing Huang , Jiecao Chen

As large language models (LLMs) advance, their inability to autonomously execute tasks by directly interacting with external tools remains a critical limitation. Traditional methods rely on inputting tool descriptions as context, which is…

Computation and Language · Computer Science 2025-04-01 Renxi Wang , Xudong Han , Lei Ji , Shu Wang , Timothy Baldwin , Haonan Li

Synthetic data has emerged as a crucial solution to the data scarcity bottleneck in large language models (LLMs), particularly for specialized domains and low-resource languages. However, the broader adoption of existing synthetic data…

Machine Learning · Computer Science 2026-05-12 Zhichao Shi , Cehao Yang , Hao Zhou , Xiaojun Wu , Huajie Li , Xuhui Jiang , Chengjin Xu , Yuanzhuo Wang , Jian Guo

Recent work has made significant progress in helping users to automate single data preparation steps, such as string-transformations and table-manipulation operators (e.g., Join, GroupBy, Pivot, etc.). We in this work propose to automate…

Databases · Computer Science 2021-08-05 Junwen Yang , Yeye He , Surajit Chaudhuri

Despite recent advances in AI, the development of systems capable of executing complex, multi-step reasoning tasks involving multiple tools remains a significant challenge. Current benchmarks fall short in capturing the real-world…

Computation and Language · Computer Science 2025-01-03 Vaskar Nath , Pranav Raja , Claire Yoon , Sean Hendryx

Enabling Large Language Models (LLMs) to effectively utilize tools in multi-turn interactions is essential for building capable autonomous agents. However, acquiring diverse and realistic multi-turn tool-use data remains a significant…

Computation and Language · Computer Science 2026-01-16 Zhihao Xu , Rumei Li , Jiahuan Li , Rongxiang Weng , Jingang Wang , Xunliang Cai , Xiting Wang

Recent approaches in skill matching, employing synthetic training data for classification or similarity model training, have shown promising results, reducing the need for time-consuming and expensive annotations. However, previous…

Computation and Language · Computer Science 2024-02-06 Antoine Magron , Anna Dai , Mike Zhang , Syrielle Montariol , Antoine Bosselut

Augmenting Large Language Models (LLMs) with external tools enables them to execute complex, multi-step tasks. However, tool learning is hampered by the static synthetic data pipelines where data generation and model training are executed…

Computation and Language · Computer Science 2025-11-19 Kangning Zhang , Wenxiang Jiao , Kounianhua Du , Yuan Lu , Weiwen Liu , Weinan Zhang , Yong Yu

Data plays a pivotal role in Text-Based Person Retrieval (TBPR) research. Mainstream research paradigm necessitates real-world person images with manual textual annotations for training models, posing privacy concerns and annotation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Min Cao , Yuxin Lu , Ziyin Zeng , Dong Yi , Jinqiao Wang , Mang Ye

The success of large language models (LLMs) depends heavily on large-scale, high-quality instruction-following and reinforcement datasets. However, generating such data through human annotation is prohibitively time-consuming particularly…

Computation and Language · Computer Science 2026-02-02 Chenhua Shi , Gregor Macdonald , Bhavika Jalli , Wanlu Lei , John Zou , Mridul Jain , Joji Philip

Despite the advancements of open-source large language models (LLMs), e.g., LLaMA, they remain significantly limited in tool-use capabilities, i.e., using external tools (APIs) to fulfill human instructions. The reason is that current…

Tool-calling agents are increasingly deployed in real-world customer-facing workflows. Yet most studies on tool-calling agents focus on idealized settings with general, fixed, and well-specified tasks. In real-world applications, user…

Computation and Language · Computer Science 2026-04-23 Ziyi Wang , Yuxuan Lu , Yimeng Zhang , Pei Chen , Ziwei Dong , Jing Huang , Jiri Gesi , Xianfeng Tang , Chen Luo , Qun Liu , Yisi Sang , Hanqing Lu , Manling Li , Jin Lai , Dakuo Wang

Tool-use capabilities are vital for Large Language Models (LLMs) in finance, a domain characterized by massive investment targets and data-intensive inquiries. However, existing data synthesis methods typically rely on a reverse synthesis…

Computation and Language · Computer Science 2026-03-26 Caishuang Huang , Yang Qiao , Rongyu Zhang , Junjie Ye , Pu Lu , Wenxi Wu , Meng Zhou , Xiku Du , Tao Gui , Qi Zhang , Xuanjing Huang
‹ Prev 1 2 3 10 Next ›