English
Related papers

Related papers: Open Data Synthesis For Deep Research

200 papers

In enterprise search, building high-quality datasets at scale remains a central challenge due to the difficulty of acquiring labeled data. To resolve this challenge, we propose an efficient approach to fine-tune small language models (SLMs)…

Mathematical reasoning remains challenging for LLMs due to complex logic and the need for precise computation. Existing methods enhance LLM reasoning by synthesizing datasets through problem rephrasing, but face issues with generation…

Computation and Language · Computer Science 2025-06-12 Lei Xu , Sirui Chen , Yuxuan Huang , Chaochao Lu

Recent advances in large language models (LLMs) have given rise to powerful coding agents, making it possible for code assistants to evolve into code engineers. However, existing methods still face significant challenges in achieving…

Software Engineering · Computer Science 2025-12-10 Zongwei Li , Zhonghang Li , Zirui Guo , Xubin Ren , Chao Huang

Can the rapid advances in code generation, function calling, and data analysis using large language models (LLMs) help automate the search and verification of hypotheses purely from a set of provided datasets? To evaluate this question, we…

Large language models (LLMs) have made impressive progress in handling simple math problems, yet they still struggle with more challenging and complex mathematical tasks. In this paper, we introduce a series of LLMs that employs the…

Computation and Language · Computer Science 2024-07-18 Chengpeng Li , Guanting Dong , Mingfeng Xue , Ru Peng , Xiang Wang , Dayiheng Liu

Large Language Models (LLMs) excel at many reasoning tasks but struggle with knowledge-intensive queries due to their inability to dynamically access up-to-date or domain-specific information. Retrieval-Augmented Generation (RAG) has…

Computation and Language · Computer Science 2026-03-03 Minghao Guo , Qingcheng Zeng , Xujiang Zhao , Yanchi Liu , Wenchao Yu , Mengnan Du , Haifeng Chen , Wei Cheng

The reasoning capability of large language models (LLMs), defined as their ability to analyze, infer, and make decisions based on input information, is essential for building intelligent task-oriented dialogue systems. However, existing…

Computation and Language · Computer Science 2026-03-02 Yu Zhu , Kai Yang

Recently, DeepSeek-R1 (671B) (DeepSeek-AIet al., 2025) has demonstrated its excellent reasoning ability in complex tasks and has publiclyshared its methodology. This provides potentially high-quality chain-of-thought (CoT) data for…

Artificial Intelligence · Computer Science 2025-04-17 Qianjin Yu , Keyu Wu , Zihan Chen , Chushu Zhang , Manlin Mei , Lingjun Huang , Fang Tan , Yongsheng Du , Kunlin Liu , Yurui Zhu

While Large Language Models (LLMs) have demonstrated proficiency in Deep Research or Wide Search, their capacity to solve highly complex questions-those requiring long-horizon planning, massive evidence gathering, and synthesis across…

Computation and Language · Computer Science 2026-03-04 Yubo Dong , Nianhao You , Yuxuan Hou , Zixun Sun , Yue Zhang , Liang Zhang , Siyuan Zhao , Hehe Fan

In mathematical reasoning tasks, the advancement of Large Language Models (LLMs) relies heavily on high-quality training data with clearly defined and well-graded difficulty levels. However, existing data synthesis methods often suffer from…

Machine Learning · Computer Science 2026-01-27 Xuchen Li , Jing Chen , Xuzhao Li , Hao Liang , Xiaohuan Zhou , Taifeng Wang , Wentao Zhang

Personalization in Information Retrieval (IR) is a topic studied by the research community since a long time. However, there is still a lack of datasets to conduct large-scale evaluations of personalized IR; this is mainly due to the fact…

Information Retrieval · Computer Science 2024-10-30 Marco Braga , Pranav Kasela , Alessandro Raganato , Gabriella Pasi

Graphs are foundational across domains but remain hard to use without deep expertise. LLMs promise accessible natural language (NL) graph analytics, yet they fail to process industry-scale property graphs effectively and efficiently: such…

Large Language Models (LLMs) with extended context windows promise direct reasoning over long documents, reducing the need for chunking or retrieval. Constructing annotated resources for training and evaluation, however, remains costly.…

Computation and Language · Computer Science 2025-11-13 Mohamed Elaraby , Jyoti Prakash Maheswari

Large language models (LLMs) have been widely integrated into information retrieval to advance traditional techniques. However, effectively enabling LLMs to seek accurate knowledge in complex tasks remains a challenge due to the complexity…

Computation and Language · Computer Science 2025-05-27 Zhengliang Shi , Lingyong Yan , Dawei Yin , Suzan Verberne , Maarten de Rijke , Zhaochun Ren

Large language models (LLMs) have shown promise in automating scientific hypothesis generation, yet existing approaches primarily yield coarse-grained hypotheses lacking critical methodological and experimental details. We introduce and…

Computation and Language · Computer Science 2025-10-28 Zonglin Yang , Wanhao Liu , Ben Gao , Yujie Liu , Wei Li , Tong Xie , Lidong Bing , Wanli Ouyang , Erik Cambria , Dongzhan Zhou

Recent agentic search systems have made substantial progress by emphasising deep, multi-step reasoning. However, this focus often overlooks the challenges of wide-scale information synthesis, where agents must aggregate large volumes of…

Artificial Intelligence · Computer Science 2026-04-06 Ka Yiu Lee , Yuxuan Huang , Zhiyuan He , Huichi Zhou , Weilin Luo , Kun Shao , Meng Fang , Jun Wang

The capability gap between open-source and closed-source large language models (LLMs) remains a challenge in text-to-SQL tasks. In this paper, we introduce a synthetic data approach that combines data produced by larger, more powerful…

Computation and Language · Computer Science 2024-08-07 Jiaxi Yang , Binyuan Hui , Min Yang , Jian Yang , Junyang Lin , Chang Zhou

Recent developments in Large Language Model (LLM)-based agents have shown impressive capabilities spanning multiple domains, exemplified by deep research systems that demonstrate superior performance on complex information-seeking and…

Computation and Language · Computer Science 2025-09-03 Ailing Yu , Lan Yao , Jingnan Liu , Zhe Chen , Jiajun Yin , Yuan Wang , Xinhao Liao , Zhiling Ye , Ji Li , Yun Yue , Hansong Xiao , Hualei Zhou , Chunxiao Guo , Peng Wei , Junwei Liu , Jinjie Gu

Large language models (LLMs) like GPT-4, DeepSeek-R1, and ReasonFlux have shown significant improvements in various reasoning tasks. However, smaller LLMs still struggle with complex mathematical reasoning because they fail to effectively…

Computation and Language · Computer Science 2025-02-27 Ling Yang , Zhaochen Yu , Tianjun Zhang , Minkai Xu , Joseph E. Gonzalez , Bin Cui , Shuicheng Yan

High-quality long-context data is essential for training large language models (LLMs) capable of processing extensive documents, yet existing synthesis approaches using relevance-based aggregation face challenges of computational…

Computation and Language · Computer Science 2025-09-22 Junlong Jia , Xing Wu , Chaochen Gao , Ziyang Chen , Zijia Lin , Zhongzhi Li , Weinong Wang , Haotian Xu , Donghui Jin , Debing Zhang , Binghui Guo