English
Related papers

Related papers: Transferring General Multimodal Pretrained Models …

200 papers

We present Multimodal OCR (MOCR), a document parsing paradigm that jointly parses text and graphics into unified textual representations. Unlike conventional OCR systems that focus on text recognition and leave graphical regions as cropped…

Due to the limited scale and quality of video-text training corpus, most vision-language foundation models employ image-text datasets for pretraining and primarily focus on modeling visually semantic representations while disregarding…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Sihan Chen , Xingjian He , Handong Li , Xiaojie Jin , Jiashi Feng , Jing Liu

We present an end-to-end trainable approach for Optical Character Recognition (OCR) on printed documents. Specifically, we propose a model that predicts a) a two-dimensional character grid (\emph{chargrid}) representation of a document…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Christian Reisswig , Anoop R Katti , Marco Spinaci , Johannes Höhne

Printed text recognition is an important problem for industrial OCR systems. Printed text is constructed in a standard procedural fashion in most settings. We develop a mathematical model for this process that can be applied to the backward…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Wei Tang , John Corring , Ying Wu , Gang Hua

Optical Character Recognition (OCR) has many real world applications. The existing methods normally detect where the characters are, and then recognize the character for each detected location. Thus the accuracy of characters recognition is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Baohua Sun , Michael Lin , Hao Sha , Lin Yang

How to learn a universal facial representation that boosts all face analysis tasks? This paper takes one step toward this goal. In this paper, we study the transfer performance of pre-trained models on face analysis tasks and introduce a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Yinglin Zheng , Hao Yang , Ting Zhang , Jianmin Bao , Dongdong Chen , Yangyu Huang , Lu Yuan , Dong Chen , Ming Zeng , Fang Wen

The ability to recognize and reason about text embedded in visual inputs is often lacking in vision-and-language (V&L) models, perhaps because V&L pre-training methods have often failed to include such an ability in their training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jihyung Kil , Soravit Changpinyo , Xi Chen , Hexiang Hu , Sebastian Goodman , Wei-Lun Chao , Radu Soricut

We propose an efficient method to ground pretrained text-only language models to the visual domain, enabling them to process arbitrarily interleaved image-and-text data, and generate text interleaved with retrieved images. Our method…

Computation and Language · Computer Science 2023-06-16 Jing Yu Koh , Ruslan Salakhutdinov , Daniel Fried

Embodied AI agents require a fine-grained understanding of the physical world mediated through visual and language inputs. Such capabilities are difficult to learn solely from task-specific data. This has led to the emergence of pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-12 Gunshi Gupta , Karmesh Yadav , Yarin Gal , Dhruv Batra , Zsolt Kira , Cong Lu , Tim G. J. Rudner

We present an empirical study of adapting an existing pretrained text-to-text model for long-sequence inputs. Through a comprehensive study along three axes of the pretraining pipeline -- model architecture, optimization objective, and…

Computation and Language · Computer Science 2022-11-17 Wenhan Xiong , Anchit Gupta , Shubham Toshniwal , Yashar Mehdad , Wen-tau Yih

Vision-language retrieval is an important multi-modal learning topic, where the goal is to retrieve the most relevant visual candidate for a given text query. Recently, pre-trained models, e.g., CLIP, show great potential on retrieval…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Haojun Jiang , Jianke Zhang , Rui Huang , Chunjiang Ge , Zanlin Ni , Shiji Song , Gao Huang

Achieving robustness in recognition systems across diverse domains is crucial for their practical utility. While ample data availability is usually assumed, low-resource languages, such as ancient manuscripts and non-western languages, tend…

Machine Learning · Computer Science 2025-06-19 Adrià Molina Rodríguez , Oriol Ramos Terrades , Josep Lladós

Some historical and more recent printed documents have been scanned or stored at very low resolutions, such as 60 dpi. Though such scans are relatively easy for humans to read, they still present significant challenges for optical character…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Julian D. Gilbey , Carola-Bibiane Schönlieb

The development of large vision language models drives the demand for managing, and applying massive amounts of multimodal data, making OCR technology, which extracts information from visual images, increasingly popular. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Yufeng Zhong , Lei Chen , Xuanle Zhao , Wenkang Han , Liming Zheng , Jing Huang , Deyang Jiang , Yilin Cao , Lin Ma , Zhixiong Zeng

Integrating outside knowledge for reasoning in visio-linguistic tasks such as visual question answering (VQA) is an open problem. Given that pretrained language models have been shown to include world knowledge, we propose to use a unimodal…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Ander Salaberria , Gorka Azkune , Oier Lopez de Lacalle , Aitor Soroa , Eneko Agirre

Detecting and recognizing text in natural scene images is a challenging, yet not completely solved task. In re- cent years several new systems that try to solve at least one of the two sub-tasks (text detection and text recognition) have…

Computer Vision and Pattern Recognition · Computer Science 2017-07-28 Christian Bartz , Haojin Yang , Christoph Meinel

In this paper, we propose Text-Aware Pre-training (TAP) for Text-VQA and Text-Caption tasks. These two tasks aim at reading and understanding scene text in images for question answering and image caption generation, respectively. In…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Zhengyuan Yang , Yijuan Lu , Jianfeng Wang , Xi Yin , Dinei Florencio , Lijuan Wang , Cha Zhang , Lei Zhang , Jiebo Luo

A method is presented that significantly reduces the character error rates for OCR text obtained from OCRopus models trained on early printed books when only small amounts of diplomatic transcriptions are available. This is achieved by…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Christian Reul , Christoph Wick , Uwe Springmann , Frank Puppe

In the field of scene text spotting, previous OCR methods primarily relied on image encoders and pre-trained text information, but they often overlooked the advantages of incorporating human language instructions. To address this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Chen Duan , Qianyi Jiang , Pei Fu , Jiamin Chen , Shengxi Li , Zining Wang , Shan Guo , Junfeng Luo

Standard OCR is a well-researched topic of computer vision and can be considered solved for machine-printed text. However, when applied to unconstrained images, the recognition rates drop drastically. Therefore, the employment of object…

Computer Vision and Pattern Recognition · Computer Science 2013-04-29 Albert Kavelar , Sebastian Zambanini , Martin Kampel