English
Related papers

Related papers: DeepTRACE: Auditing Deep Research AI Systems for T…

200 papers

Simulating human profiles by instilling personas into large language models (LLMs) is rapidly transforming research in agentic behavioral simulation, LLM personalization, and human-AI alignment. However, most existing synthetic personas…

Artificial Intelligence · Computer Science 2025-12-02 Zhen Wang , Yufan Zhou , Zhongyan Luo , Lyumanshan Ye , Adam Wood , Man Yao , Saab Mansour , Luoshang Pan

As generative models are advancing in quality and quantity for creating synthetic content, deepfakes begin to cause online mistrust. Deepfake detectors are proposed to counter this effect, however, misuse of detectors claiming fake content…

Artificial Intelligence · Computer Science 2025-10-29 Neslihan Kose , Anthony Rhodes , Umur Aybars Ciftci , Ilke Demir

Retrieval-Augmented Generation (RAG) shows promise for enterprise knowledge work, yet it often underperforms in high-stakes decision settings that require deep synthesis, strict traceability, and recovery from underspecified prompts.…

Information Retrieval · Computer Science 2026-01-27 Xincheng You , Qi Sun , Neha Bora , Huayi Li , Shubham Goel , Kang Li , Sean Culatana

LLM-based Search Engines (LLM-SEs) introduces a new paradigm for information seeking. Unlike Traditional Search Engines (TSEs) (e.g., Google), these systems summarize results, often providing limited citation transparency. The implications…

Computation and Language · Computer Science 2025-12-11 Peixian Zhang , Qiming Ye , Zifan Peng , Kiran Garimella , Gareth Tyson

The rapid advancement of large language models has fundamentally shifted the bottleneck in AI development from computational power to data availability-with countless valuable datasets remaining hidden across specialized repositories,…

Artificial Intelligence · Computer Science 2025-08-12 Keyu Li , Mohan Jiang , Dayuan Fu , Yunze Wu , Xiangkun Hu , Dequan Wang , Pengfei Liu

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

Autonomous scientific research is significantly advanced thanks to the development of AI agents. One key step in this process is finding the right scientific literature, whether to explore existing knowledge for a research problem, or to…

Generative search engines increasingly determine whether online information is merely discoverable, cited as a source, or actually absorbed into generated answers. This paper proposes a two-stage measurement framework for Generative Engine…

Information Retrieval · Computer Science 2026-04-30 Zhang Kai , He Xinyue , Yao Jingang

Recent advances in large language models (LLMs) have given rise to powerful coding agents, making it possible for code assistants to evolve into code engineers. However, existing methods still face significant challenges in achieving…

Software Engineering · Computer Science 2025-12-10 Zongwei Li , Zhonghang Li , Zirui Guo , Xubin Ren , Chao Huang

While hallucinations of large language models could been alleviated through retrieval-augmented generation and citation generation, how the model utilizes internal knowledge is still opaque, and the trustworthiness of its generated answers…

Computation and Language · Computer Science 2025-04-22 Jiajun Shen , Tong Zhou , Yubo Chen , Delai Qiu , Shengping Liu , Kang Liu , Jun Zhao

Deep research requires reasoning over web evidence to answer open-ended questions, and it is a core capability for AI agents. Yet many deep research agents still rely on implicit, unstructured search behavior that causes redundant…

Artificial Intelligence · Computer Science 2026-04-29 Boer Zhang , Mingyan Wu , Dongzhuoran Zhou , Yuqicheng Zhu , Wendong Fan , Puzhen Zhang , Zifeng Ding , Guohao Li , Yuan He

Retrieving and extracting knowledge from extensive research documents and large databases presents significant challenges for researchers, students, and professionals in today's information-rich era. Existing retrieval systems, which rely…

Information Retrieval · Computer Science 2025-02-06 Mohammed-Khalil Ghali , Abdelrahman Farrag , Daehan Won , Yu Jin

We study the source of uncertainty in DeepSeek R1-32B by analyzing its self-reported verbal confidence on question answering (QA) tasks. In the default answer-then-confidence setting, the model is regularly over-confident, whereas semantic…

Computation and Language · Computer Science 2025-11-06 Jakub Podolak , Rajeev Verma

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) with external knowledge but remains vulnerable to low-authority sources that can propagate misinformation. We investigate whether LLMs can perceive information…

Information Retrieval · Computer Science 2026-03-27 Zhihui Yao , Hengran Zhang , Keping Bi

Large Language Models (LLMs) have demonstrated remarkable capabilities in various applications. However, their use as writing assistants in specialized domains like finance, medicine, and law is often hampered by a lack of deep…

Computation and Language · Computer Science 2025-08-15 Song Mao , Lejun Cheng , Pinlong Cai , Guohang Yan , Ding Wang , Botian Shi

The emergence of Large Language Models (LLMs) has transformed information access, with current LLMs also powering deep research systems that can generate comprehensive report-style answers, through planned iterative search, retrieval, and…

Computation and Language · Computer Science 2025-06-18 Bruno Martins , Piotr Szymański , Piotr Gramacki

\Ac{RAG} has emerged as a crucial technique for enhancing large models with real-time and domain-specific knowledge. While numerous improvements and open-source tools have been proposed to refine the \ac{RAG} framework for accuracy,…

Information Retrieval · Computer Science 2025-02-20 Yixing Fan , Qiang Yan , Wenshan Wang , Jiafeng Guo , Ruqing Zhang , Xueqi Cheng

The rapid advancement of large language models (LLMs) demands robust, unbiased, and scalable evaluation methods. However, human annotations are costly to scale, model-based evaluations are susceptible to stylistic biases, and…

Recent advances in large language models have enabled deep research systems that generate expert-level reports through multi-step reasoning and evidence-based synthesis. However, evaluating such reports remains challenging: report quality…

Computation and Language · Computer Science 2026-03-11 Janghoon Han , Heegyu Kim , Changho Lee , Dahm Lee , Min Hyung Park , Hosung Song , Stanley Jungkyu Choi , Moontae Lee , Honglak Lee

With the rapid growth of scientific literature, scientific question answering (SciQA) has become increasingly critical for exploring and utilizing scientific knowledge. Retrieval-Augmented Generation (RAG) enhances LLMs by incorporating…

Computation and Language · Computer Science 2026-01-26 Haotian Chen , Qingqing Long , Siyu Pu , Xiao Luo , Wei Ju , Meng Xiao , Yuanchun Zhou , Jianghua Zhao , Xuezhi Wang