中文
相关论文

相关论文: Evaluating LLMs for Historical Document OCR: A Met…

200 篇论文

Iterating with new and improved OCR solutions enforces decision making when it comes to targeting the right candidates for reprocessing. This especially applies when the underlying data collection is of considerable size and rather diverse…

计算与语言 · 计算机科学 2023-06-22 Pit Schneider , Yves Maurer

Large Multimodal Models (LMMs) have demonstrated impressive performance in recognizing document images with natural language instructions. However, it remains unclear to what extent capabilities in literacy with rich structure and…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Zhibo Yang , Jun Tang , Zhaohai Li , Pengfei Wang , Jianqiang Wan , Humen Zhong , Xuejing Liu , Mingkun Yang , Peng Wang , Shuai Bai , LianWen Jin , Junyang Lin

Large Language Models (LLMs) are increasingly used by undergraduate students as on-demand tutors, yet their reliability on circuit- and diagram-based digital logic problems remains unclear. We present a human- AI study evaluating three…

硬件体系结构 · 计算机科学 2026-02-18 Yogeswar Reddy Thota , Setareh Rafatirad , Homayoun Houman , Tooraj Nikoubin

Accurate transcription of handwritten mathematics is crucial for educational AI systems, yet current benchmarks fail to evaluate this capability properly. Most prior studies focus on single-line expressions and rely on lexical metrics such…

计算机与社会 · 计算机科学 2026-05-27 Jin Seong , Wencke Liermann , Minho Kim , Jong-hun Shin , Soojong Lim

Due to their high versatility in tasks such as image captioning, document analysis, and automated content generation, multimodal Large Language Models (LLMs) have attracted significant attention across various industrial fields. In…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Kotaro Inoue

OCR errors are common in digitised historical archives significantly affecting their usability and value. Generative Language Models (LMs) have shown potential for correcting these errors using the context provided by the corrupted text and…

计算与语言 · 计算机科学 2024-10-01 Jonathan Bourne

This paper presents our methodology and findings from three tasks across Optical Character Recognition (OCR) and Document Layout Analysis using advanced deep learning techniques. First, for the historical Hebrew fragments of the Dead Sea…

计算机视觉与模式识别 · 计算机科学 2025-08-15 Hylke Westerdijk , Ben Blankenborg , Khondoker Ittehadul Islam

Low-resource languages serve as invaluable repositories of human history, embodying cultural evolution and intellectual diversity. Despite their significance, these languages face critical challenges, including data scarcity and…

Enterprise security faces escalating threats from sophisticated malware, compounded by expanding digital operations. This paper presents the first systematic evaluation of large language models (LLMs) to proactively identify indicators of…

密码学与安全 · 计算机科学 2026-01-15 Aniesh Chawla , Udbhav Prasad

Optical character recognition (OCR) and document understanding systems increasingly rely on large vision and vision-language models, yet evaluation remains centered on modern, Western, and institutional documents. This emphasis masks system…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Fitsum Sileshi Beyene , Christopher L. Dancy

GLM-OCR is an efficient 0.9B-parameter compact multimodal model designed for real-world document understanding. It combines a 0.4B-parameter CogViT visual encoder with a 0.5B-parameter GLM language decoder, achieving a strong balance…

Cultural representation in Large Language Model (LLM) outputs has primarily been evaluated through the proxies of cultural diversity and factual accuracy. However, a crucial gap remains in assessing cultural alignment: the degree to which…

计算与语言 · 计算机科学 2026-04-07 Erin MacMurray van Liemt , Aida Davani , Sinchana Kumbale , Neha Dixit , Sunipa Dev

Traditional evaluation metrics like BLEU and ROUGE fall short when capturing the nuanced qualities of generated text, particularly when there is no single ground truth. In this paper, we explore the potential of Large Language Models…

计算与语言 · 计算机科学 2024-12-13 Manav Chaudhary , Harshit Gupta , Savita Bhat , Vasudeva Varma

Large language models (LLMs) are increasingly utilized to assist in scientific and academic writing, helping authors enhance the coherence of their articles. Previous studies have highlighted stereotypes and biases present in LLM outputs,…

计算与语言 · 计算机科学 2024-07-01 Naseela Pervez , Alexander J. Titus

Large language models (LLMs) have shown promise for automated text annotation, raising hopes that they might accelerate cross-cultural research by extracting structured data from ethnographic texts. We evaluated 7 state-of-the-art LLMs on…

计算与语言 · 计算机科学 2026-01-21 Leonardo S. Goodall , Dor Shilton , Daniel A. Mullins , Harvey Whitehouse

How much large language models (LLMs) can aid scientific discovery, notably in assisting academic peer review, is in heated debate. Between a literature digest and a human-comparable research assistant lies their practical application…

计算与语言 · 计算机科学 2025-08-19 Tianyi Li , Yu Qin , Olivia R. Liu Sheng

Accurate text recognition for historical documents can greatly advance the study and preservation of cultural heritage. Existing vision-language models (VLMs), however, are designed for modern, standardized texts and are not equipped to…

计算与语言 · 计算机科学 2025-09-25 Sina J. Semnani , Han Zhang , Xinyan He , Merve Tekgürler , Monica S. Lam

The surge in scientific submissions has placed increasing strain on the traditional peer-review process, prompting the exploration of large language models (LLMs) for automated review generation. While LLMs demonstrate competence in…

计算与语言 · 计算机科学 2025-09-25 Ruochi Li , Haoxuan Zhang , Edward Gehringer , Ting Xiao , Junhua Ding , Haihua Chen

Academic documents are packed with texts, equations, tables, and figures, requiring comprehensive understanding for accurate Optical Character Recognition (OCR). While end-to-end OCR methods offer improved accuracy over layout-based…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Yu Sun , Dongzhan Zhou , Chen Lin , Conghui He , Wanli Ouyang , Han-Sen Zhong

This study presents a framework for automated evaluation of dynamically evolving topic taxonomies in scientific literature using Large Language Models (LLMs). In digital library systems, topic modeling plays a crucial role in efficiently…

计算与语言 · 计算机科学 2025-02-14 Zhiyin Tan , Jennifer D'Souza