中文
相关论文

相关论文: When Good OCR Is Not Enough: Benchmarking OCR Robu…

200 篇论文

Retrieval-Augmented Generation (RAG) has emerged as a promising framework to mitigate hallucinations in Large Language Models (LLMs), yet its overall performance is dependent on the underlying retrieval system. In the finance domain,…

信息检索 · 计算机科学 2025-03-20 Sejong Kim , Hyunseo Song , Hyunwoo Seo , Hyunjun Kim

Retrieval-augmented generation (RAG) has emerged as one of the most prominent applications of vector databases. By integrating documents retrieved from a database into the prompt of a large language model (LLM), RAG enables more reliable…

数据库 · 计算机科学 2025-10-24 Wenqi Jiang

Retrieval-Augmented Generation (RAG) is increasingly employed in generative AI-driven scientific workflows to integrate rapidly evolving scientific knowledge bases, yet its reliability is frequently compromised by non-determinism in their…

分布式、并行与集群计算 · 计算机科学 2025-09-24 Baiqiang Wang , Dongfang Zhao , Nathan R Tallent , Luanzheng Guo

Retrieval-augmented generation (RAG) generally enhances large language models' (LLMs) ability to solve knowledge-intensive tasks. But RAG may also lead to performance degradation due to imperfect retrieval and the model's limited ability to…

计算与语言 · 计算机科学 2025-05-29 Shuyang Cao , Karthik Radhakrishnan , David Rosenberg , Steven Lu , Pengxiang Cheng , Lu Wang , Shiyue Zhang

Existing QA benchmarks typically assume distinct documents with minimal overlap, yet real-world retrieval-augmented generation (RAG) systems operate on corpora such as financial reports, legal codes, and patents, where information is highly…

计算与语言 · 计算机科学 2026-04-22 Hanjun Cho , Jay-Yoon Lee

Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of large language models (LLMs) by incorporating external knowledge sources. This method addresses common LLM limitations, including outdated information and…

计算与语言 · 计算机科学 2024-07-16 Yuanjie Lyu , Zhiyu Li , Simin Niu , Feiyu Xiong , Bo Tang , Wenjin Wang , Hao Wu , Huanyong Liu , Tong Xu , Enhong Chen

Retrieval-Augmented Generation (RAG) systems fail when documents evolve through versioning-a ubiquitous characteristic of technical documentation. Existing approaches achieve only 58-64% accuracy on version-sensitive questions, retrieving…

信息检索 · 计算机科学 2025-10-10 Daniel Huwiler , Kurt Stockinger , Jonathan Fürst

Current OCR systems are based on deep learning models trained on large amounts of data. Although they have shown some ability to generalize to unseen data, especially in detection tasks, they can struggle with recognizing low-quality data.…

Retrieval-Augmented Generation (RAG) is a promising approach to mitigate hallucinations in Large Language Models (LLMs) for legal applications, but its reliability is critically dependent on the accuracy of the retrieval step. This is…

Retrieval-Augmented Generation (RAG) enhances the response capabilities of language models by integrating external knowledge sources. However, document chunking as an important part of RAG system often lacks effective evaluation tools. This…

计算与语言 · 计算机科学 2025-10-10 Wensheng Lu , Keyu Chen , Ruizhi Qiao , Xing Sun

Retrieval-Augmented Generation (RAG) systems are showing promising potential, and are becoming increasingly relevant in AI-powered legal applications. Existing benchmarks, such as LegalBench, assess the generative capabilities of Large…

人工智能 · 计算机科学 2024-08-21 Nicholas Pipitone , Ghita Houir Alami

Retrieval-Augmented Generation (RAG) has emerged as a promising technology for legal document consultation, yet its application in Chinese legal scenarios faces two key limitations: existing benchmarks lack specialized support for joint…

计算与语言 · 计算机科学 2026-03-13 Yaocong Li , Qiang Lan , Leihan Zhang , Le Zhang

We present OCR-Quality, a comprehensive human-annotated dataset designed for evaluating and developing OCR quality assessment methods. The dataset consists of 1,000 PDF pages converted to PNG images at 300 DPI, sampled from diverse…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Yulong Zhang

Retrieval-Augmented Generation (RAG) has emerged as a critical technique for enhancing large language model (LLM) capabilities. However, practitioners face significant challenges when making RAG deployment decisions. While existing research…

软件工程 · 计算机科学 2025-07-22 Shengming Zhao , Yuchen Shao , Yuheng Huang , Jiayang Song , Zhijie Wang , Chengcheng Wan , Lei Ma

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by integrating external knowledge, leading to improved accuracy and relevance. However, scaling RAG pipelines remains computationally expensive as retrieval sizes…

信息检索 · 计算机科学 2026-03-05 Maxime Louis , Thibault Formal , Hervé Dejean , Stéphane Clinchant

Retrieval-Augmented Generation (RAG) has become a standard architectural pattern for incorporating domain-specific knowledge into user-facing chat applications powered by Large Language Models (LLMs). RAG systems are characterized by (1) a…

计算与语言 · 计算机科学 2025-01-17 Robert Friel , Masha Belyi , Atindriyo Sanyal

Retrieval-Augmented Generation (RAG) has become critical for knowledge-intensive applications, yet evaluating its performance in vertical domains remains difficult due to domain complexity, diverse context scales, and heavy reliance on…

计算与语言 · 计算机科学 2026-05-27 Jingbin Qian , Congwen Yi , Min Xia , Wen Wu , Jun Zhu , Jian Guan

Current evaluation frameworks for multimodal generative AI struggle to establish trustworthiness, hindering enterprise adoption where reliability is paramount. We introduce a systematic, quantitative benchmarking framework to measure the…

信息检索 · 计算机科学 2025-06-30 Varun Mannam , Fang Wang , Xin Chen

Retrieval-Augmented Generation (RAG) has demonstrated strong effectiveness in knowledge-intensive tasks by grounding language generation in external evidence. Despite its success, many existing RAG systems are built based on a…

计算与语言 · 计算机科学 2026-04-27 Lichang Song , Ting Long , Yi Chang

Despite significant advances in document understanding, determining the correct orientation of scanned or photographed documents remains a critical pre-processing step in the real world settings. Accurate rotation correction is essential…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Suranjan Goswami , Abhinav Ravi , Raja Kolla , Ali Faraz , Shaharukh Khan , Akash , Chandra Khatri , Shubham Agarwal