English
Related papers

Related papers: ToolForge: A Data Synthesis Pipeline for Multi-Hop…

200 papers

In recent years, the application of behavioral testing in Natural Language Processing (NLP) model evaluation has experienced a remarkable and substantial growth. However, the existing methods continue to be restricted by the requirements…

Software Engineering · Computer Science 2025-03-10 Hengrui Xing , Cong Tian , Liang Zhao , Zhi Ma , WenSheng Wang , Nan Zhang , Chao Huang , Zhenhua Duan

Equipping LLMs with tool-use capabilities via Agentic Reinforcement Learning (Agentic RL) is bottlenecked by two challenges: the lack of scalable, robust execution environments and the scarcity of realistic training data that captures…

Large language models (LLMs) have been widely adopted for synthetic data generation, significantly reducing annotation costs. However, most existing studies treat synthesis as a set of isolated tasks and overlook a more fundamental…

Artificial Intelligence · Computer Science 2026-05-29 Zhenlin Hu , Yan Wang , Zhen Bi , Zihao Xue , Bingyu Zhu , Longtao Huang , Xiongtao Zhang , Zeyu Yang , Zhixuan Chu , Jungang Lou

Fine-tuning for large language models (LLMs) typically requires substantial amounts of high-quality supervised data, which is both costly and labor-intensive to acquire. While synthetic data generation has emerged as a promising solution,…

Computation and Language · Computer Science 2025-05-28 Zihong Chen , Wanli Jiang , Jinzhe Li , Zhonghang Yuan , Huanjun Kong , Wanli Ouyang , Nanqing Dong

The LLM-as-a-judge paradigm enables flexible, user-defined evaluation, but its effectiveness is often limited by the scarcity of diverse, representative data for refining criteria. We present a tool that integrates synthetic data generation…

Human-Computer Interaction · Computer Science 2025-11-07 Hyo Jin Do , Zahra Ashktorab , Jasmina Gajcin , Erik Miehling , Martín Santillán Cooper , Qian Pan , Elizabeth M. Daly , Werner Geyer

Synthetic data generation has emerged as an invaluable solution in scenarios where real-world data collection and usage are limited by cost and scarcity. Large language models (LLMs) have demonstrated remarkable capabilities in producing…

Machine Learning · Computer Science 2025-07-22 Anh Nguyen , Sam Schafft , Nicholas Hale , John Alfaro

Tool learning, which enables large language models (LLMs) to utilize external tools effectively, has garnered increasing attention for its potential to revolutionize productivity across industries. Despite rapid development in tool…

Artificial Intelligence · Computer Science 2025-05-20 Haotian Chen , Zijun Song , Boye Niu , Ke Zhang , Litu Ou , Yaxi Lu , Zhong Zhang , Xin Cong , Yankai Lin , Zhiyuan Liu , Maosong Sun

Recent advancements in generative models have unlocked the capabilities to render photo-realistic data in a controllable fashion. Trained on the real data, these generative models are capable of producing realistic samples with minimal to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Abhay Rawat , Shubham Dokania , Astitva Srivastava , Shuaib Ahmed , Haiwen Feng , Rahul Tallamraju

Recently, large language models (LLMs) have demonstrated remarkable problem-solving capabilities by autonomously integrating with external tools for collaborative reasoning. However, due to the inherently complex and diverse nature of…

Artificial Intelligence · Computer Science 2025-11-03 Mengjie Deng , Guanting Dong , Zhicheng Dou

Synthetic training data has gained prominence in numerous learning tasks and scenarios, offering advantages such as dataset augmentation, generalization evaluation, and privacy preservation. Despite these benefits, the efficiency of…

Machine Learning · Computer Science 2024-03-21 Jianhao Yuan , Jie Zhang , Shuyang Sun , Philip Torr , Bo Zhao

With the advent of large language models (LLMs) and multimodal large language models (MLLMs), the potential of retrieval-augmented generation (RAG) has attracted considerable research attention. Various novel algorithms and models have been…

Computation and Language · Computer Science 2025-02-25 Jiajie Jin , Yutao Zhu , Guanting Dong , Yuyao Zhang , Xinyu Yang , Chenghao Zhang , Tong Zhao , Zhao Yang , Zhicheng Dou , Ji-Rong Wen

The analyst effort in data cleaning is gradually shifting away from the design of hand-written scripts to building and tuning complex pipelines of automated data cleaning libraries. Hyper-parameter tuning for data cleaning is very different…

Databases · Computer Science 2019-05-08 Sanjay Krishnan , Eugene Wu

Conducting reinforcement learning (RL) in simulated environments offers a cost-effective and highly scalable way to enhance language-based agents. However, previous work has been limited to semi-automated environment synthesis or tasks…

Computation and Language · Computer Science 2025-12-30 Shihao Cai , Runnan Fang , Jialong Wu , Baixuan Li , Xinyu Wang , Yong Jiang , Liangcai Su , Liwen Zhang , Wenbiao Yin , Zhen Zhang , Fuli Feng , Pengjun Xie , Xiaobin Wang

Analogy-making is central to human cognition, allowing us to adapt to novel situations -- an ability that current AI systems still lack. Most analogy datasets today focus on simple analogies (e.g., word analogies); datasets including…

Computation and Language · Computer Science 2024-05-15 Oren Sultan , Yonatan Bitton , Ron Yosef , Dafna Shahaf

With the growing popularity of Large Reasoning Models and their results in solving mathematical problems, it becomes crucial to measure their capabilities. We introduce a pipeline for both automatic and interactive verification as a more…

Artificial Intelligence · Computer Science 2026-02-25 Varvara Sazonova , Dmitri Shmelkin , Stanislav Kikot , Vasily Motolygin

Synthesizing high-quality instruction data from unsupervised text is a promising paradigm for training large language models (LLMs), yet automated methods for this task still exhibit significant limitations in the diversity and difficulty…

Artificial Intelligence · Computer Science 2026-02-04 Mingzhe Li , Xin Lu , Yanyan Zhao

Retrieval-Augmented Generation (RAG) grounds large language models in external evidence, yet it still falters when answers must be pieced together across semantically distant documents. We close this gap with the Hierarchical Lexical Graph…

Automated fact-checking benchmarks have largely ignored the challenge of verifying claims against real-world, high-volume structured data, instead focusing on small, curated tables. We introduce a new large-scale, multilingual dataset to…

Computation and Language · Computer Science 2026-01-27 Jacob Devasier , Akshith Putta , Qing Wang , Alankrit Moses , Chengkai Li

High-definition map transformations are essential in autonomous driving systems, enabling interoperability across tools. Ensuring their semantic correctness is challenging, since existing rule-based frameworks rely on manually written…

Software Engineering · Computer Science 2026-05-05 Ruidi He , Yu Zhang , Meng Zhang , Andreas Rausch

Large language models (LLMs) have demonstrated strong capabilities in language understanding and reasoning, yet they remain limited when tackling real-world tasks that require up-to-date knowledge, precise operations, or specialized tool…

Machine Learning · Computer Science 2025-09-17 Yabo Zhang , Yihan Zeng , Qingyun Li , Zhen Hu , Kavin Han , Wangmeng Zuo