English
Related papers

Related papers: Where Vision Becomes Text: Locating the OCR Routin…

200 papers

Multimodal Large Language Models (MLLMs) have achieved considerable accuracy in Optical Character Recognition (OCR) from static images. However, their efficacy in video OCR is significantly diminished due to factors such as motion blur,…

Vision-Language Models (VLMs) offer a promising path toward interpretable medical diagnosis by allowing users to ask about clinical explanations alongside predictions and across different modalities. However, training VLMs for detailed…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Chenjun Li , Cheng Wan , Laurin Lux , Alexander Berger , Richard B. Rosen , Martin J. Menten , Johannes C. Paetzold

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable capabilities in understanding and generating content across various modalities, such as images and text. However, their interpretability remains a challenge, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Loris Giulivi , Giacomo Boracchi

This paper presents a complete Optical Character Recognition (OCR) system for camera captured image/graphics embedded textual documents for handheld devices. At first, text regions are extracted and skew corrected. Then, these regions are…

Computer Vision and Pattern Recognition · Computer Science 2011-09-16 Ayatullah Faruk Mollah , Nabamita Majumder , Subhadip Basu , Mita Nasipuri

Visual Commonsense Reasoning (VCR) calls for explanatory reasoning behind question answering over visual scenes. To achieve this goal, a model is required to provide an acceptable rationale as the reason for the predicted answers. Progress…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zhenyang Li , Yangyang Guo , Kejie Wang , Xiaolin Chen , Liqiang Nie , Mohan Kankanhalli

Visual commonsense reasoning (VCR) is a challenging multi-modal task, which requires high-level cognition and commonsense reasoning ability about the real world. In recent years, large-scale pre-training approaches have been developed and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Cheng Yang , Rui Xu , Ye Guo , Peixiang Huang , Yiru Chen , Wenkui Ding , Zhongyuan Wang , Hong Zhou

Vision-language models (VLMs) are increasingly used in autonomous driving because they combine visual perception with language-based reasoning, supporting more interpretable decision-making, yet their robustness to physical adversarial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 David Fernandez , Pedram MohajerAnsari , Amir Salarpour , Mert D. Pese

Business Process Model and Notation (BPMN) is a widely adopted standard for representing complex business workflows. While BPMN diagrams are often exchanged as visual images, existing methods primarily rely on XML representations for…

Artificial Intelligence · Computer Science 2025-12-01 Pritam Deka , Barry Devereux

Vision-language models (VLMs) have demonstrated impressive performance by effectively integrating visual and textual information to solve complex tasks. However, it is not clear how these models reason over the visual and textual data…

Artificial Intelligence · Computer Science 2025-04-15 Pouya Pezeshkpour , Moin Aminnaseri , Estevam Hruschka

With the rapid development of OCR technology, mixed-scene text recognition has become a key technical challenge. Although deep learning models have achieved significant results in specific scenarios, their generality and stability still…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Da Chang , Yu Li

Reasoning benchmarks such as the Abstraction and Reasoning Corpus (ARC) and ARC-AGI are widely used to assess progress in artificial intelligence and are often interpreted as probes of core, so-called ``fluid'' reasoning abilities. Despite…

Computation and Language · Computer Science 2026-01-12 Xinhe Wang , Jin Huang , Xingjian Zhang , Tianhao Wang , Jiaqi W. Ma

The accuracy of Optical Character Recognition (OCR) is crucial to the success of subsequent applications used in text analyzing pipeline. Recent models of OCR post-processing significantly improve the quality of OCR-generated text, but are…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Jie Mei , Aminul Islam , Yajing Wu , Abidalrahman Moh'd , Evangelos E. Milios

Vision-Language-Action (VLA) models aim to predict robotic actions based on visual observations and language instructions. Existing approaches require fine-tuning pre-trained visionlanguage models (VLMs) as visual and language features are…

Vision-language models (VLMs) have demonstrated impressive capabilities in understanding and reasoning about visual and textual content. However, their robustness to common image corruptions remains under-explored. In this work, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Muhammad Usama , Syeda Aishah Asim , Syed Bilal Ali , Syed Talal Wasim , Umair Bin Mansoor

Multimodal large language models (MLLMs) typically extract visual features from the final layers of a pretrained Vision Transformer (ViT). This widespread deep-layer bias, however, is largely driven by empirical convention rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Haoran Chen , Junyan Lin , Xinghao Chen , Yue Fan , Jianfeng Dong , Xin Jin , Hui Su , Jinlan Fu , Xiaoyu Shen

Large Vision Language Models (LVLMs) excel in various vision-language tasks. Yet, their robustness to visual variations in position, scale, orientation, and context that objects in natural scenes inevitably exhibit due to changes in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Zhiyuan Fan , Yumeng Wang , Sandeep Polisetty , Yi R. Fung

Vision-Language Models (VLMs) achieve strong cross-modal performance, yet recent evidence suggests they over-rely on textual descriptions while under-utilizing visual evidence -- a phenomenon termed ``text shortcut learning.'' We propose an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lijie Zhou

Traditional Automatic License Plate Recognition (ALPR) systems employ multi-stage pipelines consisting of object detection networks followed by separate Optical Character Recognition (OCR) modules, introducing compounding errors, increased…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Karthik Sivakoti

Multimodal large language models (MLLMs) exhibit a pronounced preference for textual inputs when processing vision-language data, limiting their ability to reason effectively from visual evidence. Unlike prior studies that attribute this…

Artificial Intelligence · Computer Science 2026-04-21 Xinhan Zheng , Huyu Wu , Xueting Wang , Duo Su , Haiyun Jiang

Object-centric learning (OCL) aims to learn structured scene representations that support compositional generalization and robustness to out-of-distribution (OOD) data. However, OCL models are often not evaluated regarding these goals.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Krishnakant Singh , Simone Schaub-Meyer , Stefan Roth