English
Related papers

Related papers: DavarOCR: A Toolbox for OCR and Multi-Modal Docume…

200 papers

Scientific knowledge is predominantly stored in books and scientific journals, often in the form of PDFs. However, the PDF format leads to a loss of semantic information, particularly for mathematical expressions. We propose Nougat (Neural…

Machine Learning · Computer Science 2023-08-28 Lukas Blecher , Guillem Cucurull , Thomas Scialom , Robert Stojnic

Optical Character Recognition (OCR) technology is widely used to extract text from images of documents, facilitating efficient digitization and data retrieval. However, merely extracting text is insufficient when dealing with complex…

We present DocFormer -- a multi-modal transformer based architecture for the task of Visual Document Understanding (VDU). VDU is a challenging problem which aims to understand documents in their varied formats (forms, receipts etc.) and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Srikar Appalaraju , Bhavan Jasani , Bhargava Urala Kota , Yusheng Xie , R. Manmatha

Over the past decade, machine learning methods have given us driverless cars, voice recognition, effective web search, and a much better understanding of the human genome. Machine learning is so common today that it is used dozens of times…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Omer Aydin

This paper proposes OCR++, an open-source framework designed for a variety of information extraction tasks from scholarly articles including metadata (title, author names, affiliation and e-mail), structure (section headings and body text,…

Information Extraction from visually rich documents is a challenging task that has gained a lot of attention in recent years due to its importance in several document-control based applications and its widespread commercial value. The…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Mohamed Dhouib , Ghassen Bettaieb , Aymen Shabou

Optical Character Recognition (OCR) is a fundamental task for digitizing information, serving as a critical bridge between visual data and textual understanding. While modern Vision-Language Models (VLM) have achieved high accuracy in this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Sean Man , Gilad Deutch , Roy Ganz , Roi Ronen , Shahar Tsiper , Shai Mazor , Niv Nayman

Text recognition is a long-standing research problem for document digitalization. Existing approaches are usually built based on CNN for image understanding and RNN for char-level text generation. In addition, another language model is…

Computation and Language · Computer Science 2022-09-07 Minghao Li , Tengchao Lv , Jingye Chen , Lei Cui , Yijuan Lu , Dinei Florencio , Cha Zhang , Zhoujun Li , Furu Wei

Optical Character Recognition (OCR) is the process of extracting digitized text from images of scanned documents. While OCR systems have already matured in many languages, they still have shortcomings in cursive languages with overlapping…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Hussein Osman , Karim Zaghw , Mostafa Hazem , Seifeldin Elsehely

Document intelligence automates the extraction of information from documents and supports many business applications. Recent self-supervised learning methods on large-scale unlabeled document datasets have opened up promising directions…

Computation and Language · Computer Science 2022-04-29 Jiuxiang Gu , Jason Kuen , Vlad I. Morariu , Handong Zhao , Nikolaos Barmpalios , Rajiv Jain , Ani Nenkova , Tong Sun

Optical Character Recognition (OCR) has been a topic of interest for many years. It is defined as the process of digitizing a document image into its constituent characters. Despite decades of intense research, developing OCR with…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Noman Islam , Zeeshan Islam , Nazia Noor

Large Multimodal Models (LMMs) have recently shown strong performance on Optical Character Recognition (OCR) tasks, demonstrating their promising capability in document literacy. However, their effectiveness in real-world applications…

Computation and Language · Computer Science 2026-05-06 Zhipeng Xu , Junhao Ji , Zulong Chen , Zhenghao Liu , Qing Liu , Chunyi Peng , Zubao Qin , Ze Xu , Jianqiang Wan , Jun Tang , Zhibo Yang , Shuai Bai , Dayiheng Liu

Vietnamese document analysis and recognition (DAR) is a crucial field with applications in digitization, information retrieval, and automation. Despite advancements in OCR and NLP, Vietnamese text recognition faces unique challenges due to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Anh Le , Thanh Lam , Dung Nguyen

The Optical Character Recognition (OCR) systems have been widely used in various of application scenarios, such as office automation (OA) systems, factory automations, online educations, map productions etc. However, OCR is still a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Yuning Du , Chenxia Li , Ruoyu Guo , Xiaoting Yin , Weiwei Liu , Jun Zhou , Yifan Bai , Zilin Yu , Yehua Yang , Qingqing Dang , Haoshuang Wang

The development of large vision language models drives the demand for managing, and applying massive amounts of multimodal data, making OCR technology, which extracts information from visual images, increasingly popular. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Yufeng Zhong , Lei Chen , Xuanle Zhao , Wenkang Han , Liming Zheng , Jing Huang , Deyang Jiang , Yilin Cao , Lin Ma , Zhixiong Zeng

Existing optical character recognition (OCR) methods rely on task-specific designs with divergent paradigms, architectures, and training strategies, which significantly increases the complexity of research and maintenance and hinders the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Dezhi Peng , Zhenhua Yang , Jiaxin Zhang , Chongyu Liu , Yongxin Shi , Kai Ding , Fengjun Guo , Lianwen Jin

Document understanding aims to perform question answering and information extraction over document images, where the visual content is highly information-dense and most queries rely on only a few relevant layout regions. However, existing…

Artificial Intelligence · Computer Science 2026-05-27 Ye Mo , Kai Ye , Xianwei Mao , Zirui Shao , Gang Huang , Bo Zhang , Hangdi Xing , Kehan Chen , Huan Zhou , Zixu Yan , Jiajun Bu , Sheng Zhou

Abstractive summarization has made significant strides in condensing and rephrasing large volumes of text into coherent summaries. However, summarizing administrative documents presents unique challenges due to domain-specific terminology,…

Computation and Language · Computer Science 2024-12-12 Phan Phuong Mai Chau , Souhail Bakkali , Antoine Doucet

Visual document understanding (VDU) has rapidly advanced with the development of powerful multi-modal language models. However, these models typically require extensive document pre-training data to learn intermediate representations and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Souhail Bakkali , Sanket Biswas , Zuheng Ming , Mickaël Coustaty , Marçal Rusiñol , Oriol Ramos Terrades , Josep Lladós

Detection and recognition of text from scans and other images, commonly denoted as Optical Character Recognition (OCR), is a widely used form of automated document processing with a number of methods available. Yet OCR systems still do not…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Krzysztof Olejniczak , Milan Šulc