English
Related papers

Related papers: eSapiens's DEREK Module: Deep Extraction & Reasoni…

200 papers

In this paper, we introduce KAG-Thinker, which upgrade KAG to a multi-turn interactive thinking and deep reasoning framework powered by a dedicated parameter-light large language model (LLM). Our approach constructs a structured thinking…

Large language models (LLMs) often need to incorporate external knowledge to solve theme-specific problems. Retrieval-augmented generation (RAG) has shown its high promise, empowering LLMs to generate more qualified responses with retrieved…

Machine Learning · Computer Science 2025-08-05 Jimeng Shi , Sizhe Zhou , Bowen Jin , Wei Hu , Runchu Tian , Shaowen Wang , Giri Narasimhan , Jiawei Han

Although Large Language Models (LLMs) demonstrate significant capabilities, their reliance on parametric knowledge often leads to inaccuracies. Retrieval Augmented Generation (RAG) mitigates this by incorporating external knowledge, but…

Artificial Intelligence · Computer Science 2025-11-04 Hailong Yin , Bin Zhu , Jingjing Chen , Chong-Wah Ngo

Retrieval-Augmented Generation (RAG) over Knowledge Graphs (KGs) suffers from the fact that indexing approaches may lose important contextual nuance when text is reduced to triples, thereby degrading performance in downstream…

Computation and Language · Computer Science 2026-03-13 Riccardo Campi , Nicolò Oreste Pinciroli Vago , Mathyas Giudici , Marco Brambilla , Piero Fraternali

Speculative decoding (SD) has emerged as an effective technique to accelerate large language model (LLM) inference without compromising output quality. However, the achievable speedup largely depends on the effectiveness of the drafting…

Computation and Language · Computer Science 2025-11-04 Min Fang , Zhihui Fu , Qibin Zhao , Jun Wang

Retrieval-augmented generation (RAG) enhances LLMs with external knowledge, yet generation remains vulnerable to retrieval-induced noise and uncertain placement of relevant chunks, often causing hallucinations. We present Ext2Gen, an…

Computation and Language · Computer Science 2025-11-18 Hwanjun Song , Jeonghwan Choi , Minseok Kim

Retrieval-Augmented Generation (RAG) systems critically depend on retrieval quality, yet no systematic comparison of modern retrieval methods exists for heterogeneous documents containing both text and tabular data. We benchmark ten…

Information Retrieval · Computer Science 2026-04-03 Meftun Akarsu , Recep Kaan Karaman , Christopher Mierbach

Reading comprehension models are based on recurrent neural networks that sequentially process the document tokens. As interest turns to answering more complex questions over longer documents, sequential reading of large portions of text…

Computation and Language · Computer Science 2018-09-11 Mor Geva , Jonathan Berant

Scientific paper retrieval is essential for supporting literature discovery and research. While dense retrieval methods demonstrate effectiveness in general-purpose tasks, they often fail to capture fine-grained scientific concepts that are…

Information Retrieval · Computer Science 2025-10-07 Yunyi Zhang , Ruozhen Yang , Siqi Jiao , SeongKu Kang , Jiawei Han

Open-domain complex Question Answering (QA) is a difficult task with challenges in evidence retrieval and reasoning. The complexity of such questions could stem from questions being compositional, hybrid evidence, or ambiguity in questions.…

Computation and Language · Computer Science 2024-06-26 Venktesh V. Deepali Prabhu , Avishek Anand

Retrieval-Augmented Generation (RAG) has become a robust framework for enhancing Large Language Models (LLMs) with external knowledge. Recent advances in RAG have investigated graph based retrieval for intricate reasoning; however, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Tejas Sarnaik , Manan Shah , Ravi Hegde

We introduce the THOR (Transformer Heuristics for On-Demand Retrieval) Module, designed and implemented by eSapiens, a secure, scalable engine that transforms natural-language questions into verified, read-only SQL analytics for enterprise…

Databases · Computer Science 2025-07-18 Isaac Shi , Zeyuan Li , Fan Liu , Wenli Wang , Lewei He , Yang Yang , Tianyu Shi

Ranking has always been one of the top concerns in information retrieval research. For decades, lexical matching signal has dominated the ad-hoc retrieval process, but it also has inherent defects, such as the vocabulary mismatch problem.…

Information Retrieval · Computer Science 2020-10-21 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Min Zhang , Shaoping Ma

Despite advances in generative large language models (LLMs), practical application of specialized conversational AI agents remains constrained by computation costs, latency requirements, and the need for precise domain-specific relevance…

Computation and Language · Computer Science 2025-12-10 Eliot Brenner , Dominic Seyler , Manjunath Hegde , Andrei Simion , Koustuv Dasgupta , Bing Xiang

Retrieval-Augmented Generation (RAG) based on Large Language Models (LLMs) is a powerful solution to understand and query the industry's closed-source documents. However, basic RAG often struggles with complex QA tasks in legal and…

Information Retrieval · Computer Science 2025-09-08 Huifeng Lin , Gang Su , Jintao Liang , You Wu , Rui Zhao , Ziyue Li

LLMs have fundamentally transformed dense retrieval, upgrading backbones from discriminative encoders to generative architectures. However, a critical disconnect remains: while LLMs possess strong reasoning capabilities, current retrievers…

Computation and Language · Computer Science 2026-03-03 Jiajie Jin , Yanzhao Zhang , Mingxin Li , Dingkun Long , Pengjun Xie , Yutao Zhu , Zhicheng Dou

Retrieval-Augmented Generation (RAG) struggles with domain-specific enterprise datasets, often isolated behind firewalls and rich in complex, specialized terminology unseen by LLMs during pre-training. Semantic variability across domains…

Computation and Language · Computer Science 2025-08-06 Kunal Sawarkar , Shivam R. Solanki , Abhilasha Mangal

Large language models (LLMs) achieve optimal utility when their responses are grounded in external knowledge sources. However, real-world documents, such as annual reports, scientific papers, and clinical guidelines, frequently combine…

Information Retrieval · Computer Science 2025-12-17 Chi Zhang , Qiyang Chen , Mengqi Zhang

Large language models (LLMs) are increasingly touted as powerful tools for automating scientific information extraction. However, existing methods and tools often struggle with the realities of scientific literature: long-context documents,…

Retrieval-Augmented Generation (RAG) has proven effective in open-domain question answering. However, the chunking process, which is essential to this pipeline, often receives insufficient attention relative to retrieval and synthesis…

Computation and Language · Computer Science 2025-01-20 Zuhong Liu , Charles-Elie Simon , Fabien Caspani