English
Related papers

Related papers: DeepTRACE: Auditing Deep Research AI Systems for T…

200 papers

The rapid growth of research literature, particularly in large language models (LLMs), has made producing comprehensive and current survey papers increasingly difficult. This paper introduces autosurvey2, a multi-stage pipeline that…

Artificial Intelligence · Computer Science 2025-12-03 Siyi Wu , Chiaxin Liang , Ziqian Bi , Leyi Zhao , Tianyang Wang , Junhao Song , Yichao Zhang , Keyu Chen , Benji Peng , Xinyuan Song

When encountering increasingly frequent performance improvements or cost reductions from a new large language model (LLM), developers of applications leveraging LLMs must decide whether to take advantage of these improvements or stay with…

Computation and Language · Computer Science 2025-02-20 Rubing Li , João Sedoc , Arun Sundararajan

Large language models (LLMs) are increasingly used in scientific domains. While they can produce reasoning-like content via methods such as chain-of-thought prompting, these outputs are typically unstructured and informal, obscuring whether…

Artificial Intelligence · Computer Science 2025-11-18 Pengze Li , Jiaqi Liu , Junchi Yu , Lihao Liu , Mingyu Ding , Wanli Ouyang , Shixiang Tang , Xi Chen

Professional fact-checkers rely on domain knowledge and deep contextual understanding to verify claims. Large language models (LLMs) and large reasoning models (LRMs) lack such grounding and primarily reason from available evidence alone,…

Computation and Language · Computer Science 2026-04-16 Dhruv Sahnan , Subhabrata Dutta , Tanmoy Chakraborty , Preslav Nakov , Iryna Gurevych

Thousands of new scientific papers are published each month. Such information overload complicates researcher efforts to stay current with the state-of-the-art as well as to verify and correctly attribute claims. We pose the following…

Computation and Language · Computer Science 2024-11-05 Ori Press , Andreas Hochlehnert , Ameya Prabhu , Vishaal Udandarao , Ofir Press , Matthias Bethge

LLMs have demonstrated impressive proficiency in generating coherent and high-quality text, making them valuable across a range of text-generation tasks. However, rigorous evaluation of this generated content is crucial, as ensuring its…

The capacity for highly complex, evidence-based, and strategically adaptive persuasion remains a formidable great challenge for artificial intelligence. Previous work, like IBM Project Debater, focused on generating persuasive speeches in…

Computation and Language · Computer Science 2025-11-25 Allen Roush , Devin Gonier , John Hines , Judah Goldfeder , Philippe Martin Wyder , Sanjay Basu , Ravid Shwartz Ziv

The capability of large language models to handle long-context information is crucial across various real-world applications. Existing evaluation methods often rely either on real-world long texts, making it difficult to exclude the…

Computation and Language · Computer Science 2025-09-18 Mo Li , Songyang Zhang , Taolin Zhang , Haodong Duan , Yunxin Liu , Kai Chen

Learning analytics researchers often analyze qualitative student data such as coded annotations or interview transcripts to understand learning processes. With the rise of generative AI, fully automated and human-AI workflows have emerged…

Computation and Language · Computer Science 2026-01-21 Elham Tajik , Conrad Borchers , Bahar Shahrokhian , Sebastian Simon , Ali Keramati , Sonika Pal , Sreecharan Sankaranarayanan

Deep research agents have emerged as powerful systems for addressing complex queries. Meanwhile, LLM-based retrievers have demonstrated strong capability in following instructions or reasoning. This raises a critical question: can LLM-based…

Information Retrieval · Computer Science 2026-02-09 Tiansheng Hu , Yilun Zhao , Canyu Zhang , Arman Cohan , Chen Zhao

Large Language Models (LLMs) have emerged as powerful assistants for scientific writing. However, concerns remain about the quality and reliability of the generated text, including citation accuracy and faithfulness. While most recent work…

Digital Libraries · Computer Science 2026-04-14 Yee Man Choi , Xuehang Guo , Yi R. Fung , Qingyun Wang

Retrieval-Augmented Generation (RAG) has emerged as a crucial approach for enhancing the responses of large language models (LLMs) with external knowledge sources. Despite the impressive performance in complex question-answering tasks, RAG…

Information Retrieval · Computer Science 2025-10-14 Haosheng Qian , Yixing Fan , Jiafeng Guo , Ruqing Zhang , Qi Chen , Dawei Yin , Xueqi Cheng

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Deep Research Agents (DRAs) generate citation-rich reports via multi-step search and synthesis, yet existing benchmarks mainly target text-only settings or short-form multimodal QA, missing end-to-end multimodal evidence use. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Peizhou Huang , Zixuan Zhong , Zhongwei Wan , Donghao Zhou , Samiul Alam , Xin Wang , Zexin Li , Zhihao Dou , Li Zhu , Jing Xiong , Chaofan Tao , Yan Xu , Dimitrios Dimitriadis , Tuo Zhang , Mi Zhang

Ensuring the reliability of Large Language Models (LLMs) in complex reasoning tasks remains a formidable challenge, particularly in scenarios that demand precise mathematical calculations and knowledge-intensive open-domain generation. In…

Machine Learning · Computer Science 2025-05-27 Ali Razghandi , Seyed Mohammad Hadi Hosseini , Mahdieh Soleymani Baghshah

Large language models (LLMs) have raised hopes for automated end-to-end fact-checking, but prior studies report mixed results. As mainstream chatbots increasingly ship with reasoning capabilities and web search tools -- and millions of…

Computation and Language · Computer Science 2025-11-25 Matthew R. DeVerna , Kai-Cheng Yang , Harry Yaojun Yan , Filippo Menczer

RAG (Retrieval-Augmented Generation) systems and web agents are increasingly evaluated on multi-hop deep search tasks, yet current practice suffers from two major limitations. First, most benchmarks leak the reasoning path in the question…

Computation and Language · Computer Science 2025-12-11 Maojia Song , Renhang Liu , Xinyu Wang , Yong Jiang , Pengjun Xie , Fei Huang , Jingren Zhou , Dorien Herremans , Soujanya Poria

Large language models (LLMs) often produce unsupported or unverifiable content, known as "hallucinations." To mitigate this, retrieval-augmented LLMs incorporate citations, grounding the content in verifiable sources. Despite such…

Information Retrieval · Computer Science 2024-08-26 Weijia Zhang , Mohammad Aliannejadi , Yifei Yuan , Jiahuan Pei , Jia-Hong Huang , Evangelos Kanoulas

The advent of Deep Research agents has substantially reduced the time required for conducting extensive research tasks. However, these tasks inherently demand rigorous standards of factual accuracy and comprehensiveness, necessitating…

Computation and Language · Computer Science 2025-08-25 Minghao Li , Ying Zeng , Zhihao Cheng , Cong Ma , Kai Jia

Retrieval-Augmented Generation (RAG) is a framework in which a Generator, such as a Large Language Model (LLM), produces answers by retrieving documents from an external collection using a Retriever. In practice, Generators must integrate…

Computation and Language · Computer Science 2026-04-30 Koki Itai , Shunichi Hasegawa , Yuta Yamamoto , Gouki Minegishi , Masaki Otsuki