English
Related papers

Related papers: M3DocDep: Multi-modal, Multi-page, Multi-document …

200 papers

Multimodal document retrieval aims to identify and retrieve various forms of multimodal content, such as figures, tables, charts, and layout information from extensive documents. Despite its increasing popularity, there is a notable lack of…

Information Retrieval · Computer Science 2025-11-10 Kuicai Dong , Yujing Chang , Xin Deik Goh , Dexun Li , Ruiming Tang , Yong Liu

Retrieval-augmented generation (RAG) improves the response quality of large language models (LLMs) by retrieving knowledge from external databases. Typical RAG approaches split the text database into chunks, organizing them in a flat…

Computation and Language · Computer Science 2025-11-18 Boyu Chen , Zirui Guo , Zidan Yang , Yuluo Chen , Junze Chen , Zhenghao Liu , Chuan Shi , Cheng Yang

Multimodal Large Language Models (MLLMs) have achieved remarkable performance in Visually Rich Document Understanding (VRDU) tasks, but their capabilities are mainly evaluated on pristine, well-structured document images. We consider…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zichun Guo , Yuling Shi , Wenhao Zeng , Chao Hu , Haotian Lin , Terry Yue Zhuo , Jiawei Chen , Xiaodong Gu , Wenping Ma

Long-context large language models (LC LLMs) combined with retrieval-augmented generation (RAG) hold strong potential for complex multi-hop and large-document tasks. However, existing RAG systems often suffer from imprecise retrieval,…

Computation and Language · Computer Science 2025-05-22 Woosang Lim , Zekun Li , Gyuwan Kim , Sungyoung Ji , HyeonJung Kim , Kyuri Choi , Jin Hyuk Lim , Kyungpyo Park , William Yang Wang

Document centric RAG pipelines usually begin with OCR, followed by brittle heuristics for chunking, table parsing, and layout reconstruction. These text first workflows are costly to maintain, sensitive to small layout shifts, and often…

Information Retrieval · Computer Science 2026-01-07 Anup Roy , Rishabh Gyanendra Upadhyay , Animesh Rameshbhai Panara , Robin Mills , Aidan Millar

While human cognition inherently retrieves information from diverse and specialized knowledge sources during decision-making processes, current Retrieval-Augmented Generation (RAG) systems typically operate through single-source knowledge…

Machine Learning · Computer Science 2025-03-19 Zhengsheng Guo , Linwei Zheng , Xinyang Chen , Xuefeng Bai , Kehai Chen , Min Zhang

Retrieval-augmented generation (RAG) over long documents typically involves splitting the text into smaller chunks, which serve as the basic units for retrieval. However, due to dependencies across the original document, contextual…

Computation and Language · Computer Science 2026-04-22 Junjie Wu , Jiangnan Li , Yuqing Li , Lemao Liu , Liyan Xu , Jiwei Li , Dit-Yan Yeung , Jie Zhou , Mo Yu

Retrieval-augmented generation (RAG) improves large language model reliability by grounding generated responses in external evidence. However, RAG performance depends on the relevance of retrieved passages, the quality of evidence ranking,…

Information Retrieval · Computer Science 2026-05-05 Fariba Afrin Irany , Sampson Akwafuo

Retrieval-Augmented Generation (RAG), while serving as a viable complement to large language models (LLMs), often overlooks the crucial aspect of text chunking within its pipeline. This paper initially introduces a dual-metric evaluation…

Computation and Language · Computer Science 2025-05-27 Jihao Zhao , Zhiyuan Ji , Zhaoxin Fan , Hanyu Wang , Simin Niu , Bo Tang , Feiyu Xiong , Zhiyu Li

Deploying Large Language Model (LLM) applications, particularly those relying on Retrieval-Augmented Generation (RAG), remains challenging due to high computational demands, outdated knowledge bases, and the need to manually select optimal…

Retrieval-Augmented Generation (RAG) has transformed how we approach text generation tasks by grounding Large Language Model (LLM) outputs in retrieved knowledge. This capability is especially critical in the legal domain. In this work, we…

Computation and Language · Computer Science 2025-09-11 Figarri Keisha , Prince Singh , Pallavi , Dion Fernandes , Aravindh Manivannan , Ilham Wicaksono , Faisal Ahmad , Wiem Ben Rim

The traditional RAG paradigm, which typically engages in the comprehension of relevant text chunks in response to received queries, inherently restricts both the depth of knowledge internalization and reasoning capabilities. To address this…

Computation and Language · Computer Science 2025-10-17 Jihao Zhao , Zhiyuan Ji , Simin Niu , Hanyu Wang , Feiyu Xiong , Zhiyu Li

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipeline's ability…

Artificial Intelligence · Computer Science 2026-05-25 Samuel Hildebrand , Curtis Taylor , Sean Oesch , James M Ghawaly , Amir Sadovnik , Ryan Shivers , Brandon Schreiber , Kevin Kurian

Retrieval-augmented systems are typically evaluated in settings where information required to answer the query can be found within a single source or the answer is short-form or factoid-based. However, many real-world applications demand…

Computation and Language · Computer Science 2025-08-29 Rohan Phanse , Yijie Zhou , Kejian Shi , Wencai Zhang , Yixin Liu , Yilun Zhao , Arman Cohan

This paper addresses the challenge of comprehending very long contexts in Large Language Models (LLMs) by proposing a method that emulates Retrieval Augmented Generation (RAG) through specialized prompt engineering and chain-of-thought…

Computation and Language · Computer Science 2025-02-19 Joon Park , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Retrieval-augmented generation (RAG) has strong potential for producing accurate and factual outputs by combining language models (LMs) with evidence retrieved from large text corpora. However, current pipelines are limited by static…

Information Retrieval · Computer Science 2026-02-27 Xuechen Zhang , Koustava Goswami , Samet Oymak , Jiasi Chen , Nedim Lipka

Polymer literature contains a large and growing body of experimental knowledge, yet much of it is buried in unstructured text and inconsistent terminology, making systematic retrieval and reasoning difficult. Existing tools typically…

Computational Engineering, Finance, and Science · Computer Science 2026-02-19 Sonakshi Gupta , Akhlak Mahmood , Wei Xiong , Rampi Ramprasad

Retrieval pipelines-an integral component of many machine learning systems-perform poorly in domains where documents are long (e.g., 10K tokens or more) and where identifying the relevant document requires synthesizing information across…

Information Retrieval · Computer Science 2024-11-19 Jon Saad-Falcon , Daniel Y. Fu , Simran Arora , Neel Guha , Christopher Ré

Large Language Models (LLMs), constrained by limited context windows, often face significant performance degradation when reasoning over long contexts. To address this, Retrieval-Augmented Generation (RAG) retrieves and reasons over chunks…

Computation and Language · Computer Science 2025-11-04 Jiani Guo , Zuchao Li , Jie Wu , Qianren Wang , Yun Li , Lefei Zhang , Hai Zhao , Yujiu Yang

Retrieval-Augmented Generation (RAG) has recently been extended to multimodal settings, connecting multimodal large language models (MLLMs) with vast corpora of external knowledge such as multimodal knowledge graphs (MMKGs). Despite their…

Computation and Language · Computer Science 2026-04-14 Hyeongcheol Park , Jiyoung Seo , Jaewon Mun , Hogun Park , Wonmin Byeon , Sung June Kim , Hyeonsoo Im , JeungSub Lee , Sangpil Kim