English
Related papers

Related papers: SurveyBench: Can LLM(-Agents) Write Academic Surve…

200 papers

Recently, there has been a growing interest among large language model (LLM) developers in LLM-based document reading systems, which enable users to upload their own documents and pose questions related to the document contents, going…

Computation and Language · Computer Science 2024-07-16 Anni Zou , Wenhao Yu , Hongming Zhang , Kaixin Ma , Deng Cai , Zhuosheng Zhang , Hai Zhao , Dong Yu

The advent of Deep Research agents has substantially reduced the time required for conducting extensive research tasks. However, these tasks inherently demand rigorous standards of factual accuracy and comprehensiveness, necessitating…

Computation and Language · Computer Science 2025-08-25 Minghao Li , Ying Zeng , Zhihao Cheng , Cong Ma , Kai Jia

Large Language Models (LLMs) have demonstrated exceptional comprehension capabilities and a vast knowledge base, suggesting that LLMs can serve as efficient tools for automated survey generation. However, recent research related to…

Computation and Language · Computer Science 2025-02-28 Xun Liang , Jiawei Yang , Yezhaohui Wang , Chen Tang , Zifan Zheng , Shichao Song , Zehao Lin , Yebin Yang , Simin Niu , Hanyu Wang , Bo Tang , Feiyu Xiong , Keming Mao , Zhiyu li

Large language models (LLMs) demonstrate strong capabilities in reasoning and question answering, yet their tendency to generate factually incorrect content remains a critical challenge. This study evaluates proprietary and open-source LLMs…

Information Retrieval · Computer Science 2025-08-08 Ning Li , Jingran Zhang , Justin Cui

The exponential growth of scientific literature poses unprecedented challenges for researchers attempting to synthesize knowledge across rapidly evolving fields. We present \textbf{Agentic AutoSurvey}, a multi-agent framework for automated…

Information Retrieval · Computer Science 2025-09-24 Yixin Liu , Yonghui Wu , Denghui Zhang , Lichao Sun

LLM-based automatic survey systems are transforming how users acquire information from the web by integrating retrieval, organization, and content synthesis into end-to-end generation pipelines. While recent works focus on developing new…

Computation and Language · Computer Science 2025-12-03 Jiahao Zhao , Shuaixing Zhang , Nan Xu , Lei Wang

Academic paper review is a critical yet time-consuming task within the research community. With the increasing volume of academic publications, automating the review process has become a significant challenge. The primary issue lies in…

Computation and Language · Computer Science 2025-07-17 Xian Gao , Jiacheng Ruan , Zongyun Zhang , Jingsheng Gao , Ting Liu , Yuzhuo Fu

Recent advancements in large language models (LLMs) have significantly enhanced text generation capabilities, yet evaluating their performance in generative writing remains a challenge. Existing benchmarks primarily focus on generic text…

Artificial Intelligence · Computer Science 2025-12-01 Yuning Wu , Jiahao Mei , Ming Yan , Chenliang Li , Shaopeng Lai , Yuran Ren , Zijia Wang , Ji Zhang , Mengyue Wu , Qin Jin , Fei Huang

Large Language Models (LLMs) with agentic web search capabilities show strong potential for tasks requiring real-time information access and complex fact retrieval, yet evaluating such systems remains challenging. We introduce \bench, a…

Information Retrieval · Computer Science 2026-02-17 Yunfan Zhang , Kathleen McKeown , Smaranda Muresan

Prior benchmarks for evaluating the domain-specific knowledge of large language models (LLMs) lack the scalability to handle complex academic tasks. To address this, we introduce \texttt{ScholarBench}, a benchmark centered on deep expert…

Computation and Language · Computer Science 2025-10-17 Dongwon Noh , Donghyeok Koh , Junghun Yuk , Gyuwan Kim , Jaeyong Lee , Kyungtae Lim , Cheoneum Park

The rapid growth of research literature, particularly in large language models (LLMs), has made producing comprehensive and current survey papers increasingly difficult. This paper introduces autosurvey2, a multi-stage pipeline that…

Artificial Intelligence · Computer Science 2025-12-03 Siyi Wu , Chiaxin Liang , Ziqian Bi , Leyi Zhao , Tianyang Wang , Junhao Song , Yichao Zhang , Keyu Chen , Benji Peng , Xinyuan Song

Automatic survey generation has emerged as a key task in scientific document processing. While large language models (LLMs) have shown promise in generating survey texts, the lack of standardized evaluation datasets critically hampers…

Computation and Language · Computer Science 2025-08-26 Tong Bao , Mir Tafseer Nayeem , Davood Rafiei , Chengzhi Zhang

Autonomous scientific research is significantly advanced thanks to the development of AI agents. One key step in this process is finding the right scientific literature, whether to explore existing knowledge for a research problem, or to…

This paper introduces AutoSurvey, a speedy and well-organized methodology for automating the creation of comprehensive literature surveys in rapidly evolving fields like artificial intelligence. Traditional survey paper creation faces…

Information Retrieval · Computer Science 2024-06-19 Yidong Wang , Qi Guo , Wenjin Yao , Hongbo Zhang , Xin Zhang , Zhen Wu , Meishan Zhang , Xinyu Dai , Min Zhang , Qingsong Wen , Wei Ye , Shikun Zhang , Yue Zhang

While large language models (LLMs) excel at many domain-specific tasks, their ability to deeply comprehend and reason about full-length academic papers remains underexplored. Existing benchmarks often fall short of capturing such depth,…

Artificial Intelligence · Computer Science 2026-01-08 Xinbang Dai , Huikang Hu , Yongrui Chen , Jiaqi Li , Rihui Jin , Yuyang Zhang , Xiaoguang Li , Lifeng Shang , Guilin Qi

While Large Language Models (LLMs) are reshaping the paradigm of AI for Social Science (AI4SS), rigorously evaluating their capabilities in scholarly writing remains a major challenge. Existing benchmarks largely emphasize single-shot,…

Computation and Language · Computer Science 2026-02-18 Houping Yue , Zixiang Di , Mei Jiang , Bingdong Li , Hao Hao , Yu Song , Bo Jiang , Aimin Zhou

Survey paper plays a crucial role in scientific research, especially given the rapid growth of research publications. Recently, researchers have begun using LLMs to automate survey generation for better efficiency. However, the quality gap…

Computation and Language · Computer Science 2025-03-07 Xiangchao Yan , Shiyang Feng , Jiakang Yuan , Renqiu Xia , Bin Wang , Bo Zhang , Lei Bai

The rapid development of automated scientific survey generation technology has made it increasingly important to establish a comprehensive benchmark to evaluate the quality of generated surveys.Nearly all existing evaluation benchmarks rely…

Artificial Intelligence · Computer Science 2026-01-23 Guo-Biao Zhang , Ding-Yuan Liu , Da-Yi Wu , Tian Lan , Heyan Huang , Zhijing Wu , Xian-Ling Mao

While large language models (LLMs) have become the de facto framework for literature-related tasks, they still struggle to function as domain-specific literature agents due to their inability to connect pieces of knowledge and reason across…

Digital Libraries · Computer Science 2026-03-03 Andreas Varvarigos , Ali Maatouk , Jiasheng Zhang , Ngoc Bui , Jialin Chen , Leandros Tassiulas , Rex Ying

The rapid growth of academic literature makes the manual creation of scientific surveys increasingly infeasible. While large language models show promise for automating this process, progress in this area is hindered by the absence of…

Computation and Language · Computer Science 2026-05-05 Weihang Su , Anzhe Xie , Qingyao Ai , Jianming Long , Xuanyi Chen , Jiaxin Mao , Ziyi Ye , Yiqun Liu
‹ Prev 1 2 3 10 Next ›