English
Related papers

Related papers: Structure-Aware Text Recognition for Ancient Greek…

200 papers

Modern vision-language models (VLMs) often fail at cultural competency evaluations and benchmarks. Given the diversity of applications built upon VLMs, there is renewed interest in understanding how they encode cultural nuances. While…

Large language models (LLMs) have increased interest in vision language models (VLMs), which process image-text pairs as input. Studies investigating the visual understanding ability of VLMs have been proposed, but such studies are still…

Computation and Language · Computer Science 2024-06-25 Jesse Atuhurra , Iqra Ali , Tatsuya Hiraoka , Hidetaka Kamigaito , Tomoya Iwakura , Taro Watanabe

Bridge infrastructure inspection is a critical but labor-intensive task requiring expert assessment of structural damage such as rebar exposure, cracking, and corrosion. This paper presents a comprehensive study of quantized Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Takato Yasuno

Pre-training of text and layout has proved effective in a variety of visually-rich document understanding tasks due to its effective model architecture and the advantage of large-scale unlabeled scanned/digital-born documents. We propose…

Computation and Language · Computer Science 2022-01-11 Yang Xu , Yiheng Xu , Tengchao Lv , Lei Cui , Furu Wei , Guoxin Wang , Yijuan Lu , Dinei Florencio , Cha Zhang , Wanxiang Che , Min Zhang , Lidong Zhou

This work presents a comparative analysis of embedding-based and generative models for classifying geoscience technical documents. Using a multi-disciplinary benchmark dataset, we evaluated the trade-offs between model accuracy, stability,…

Information Retrieval · Computer Science 2026-04-08 Rong Lu , Hao Liu , Song Hou

The growing sophistication of deepfakes presents substantial challenges to the integrity of media and the preservation of public trust. Concurrently, vision-language models (VLMs), large language models enhanced with visual reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shahroz Tariq , David Nguyen , M. A. P. Chamikara , Tingmin Wu , Alsharif Abuadbba , Kristen Moore

The combination of multimodal Vision-Language Models (VLMs) and Large Language Models (LLMs) opens up new possibilities for medical classification. This work offers a rigorous, unified benchmark by using four publicly available datasets…

Artificial Intelligence · Computer Science 2026-01-26 Meet Raval , Tejul Pandit , Dhvani Upadhyay

In regions of the Middle East and North Africa (MENA), there is a high demand for wastewater treatment plants (WWTPs), crucial for sustainable water management. Precise identification of WWTPs from satellite images enables environmental…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Akila Premarathna , Kanishka Hewageegana , Garcia Andarcia Mariangel

Large Language Models (LLMs) have achieved remarkable success in source code understanding, yet as software systems grow in scale, computational efficiency has become a critical bottleneck. Currently, these models rely on a text-based…

Computation and Language · Computer Science 2026-04-29 Yuling Shi , Chaoxiang Xie , Zhensu Sun , Yeheng Chen , Chenxu Zhang , Longfei Yun , Chengcheng Wan , Hongyu Zhang , David Lo , Xiaodong Gu

Large multimodal language models have demonstrated impressive capabilities in understanding and manipulating images. However, many of these models struggle with comprehending intensive textual contents embedded within the images, primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Ruiyi Zhang , Yufan Zhou , Jian Chen , Jiuxiang Gu , Changyou Chen , Tong Sun

Visual analytics (VA) workflows are inherently complex, involving data transformation, feature engineering, visual representation, and human interpretation. They are typically described in unstructured prose, hindering systematic…

Artificial Intelligence · Computer Science 2026-05-26 Natalia Andrienko , Gennady Andrienko , Jürgen Bernard , Michael Sedlmair

Medical vision language pre-training (VLP) has emerged as a frontier of research, enabling zero-shot pathological recognition by comparing the query image with the textual descriptions for each disease. Due to the complex semantics of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Vu Minh Hieu Phan , Yutong Xie , Yuankai Qi , Lingqiao Liu , Liyang Liu , Bowen Zhang , Zhibin Liao , Qi Wu , Minh-Son To , Johan W. Verjans

The increasing integration of Visual Language Models (VLMs) into AI systems necessitates robust model alignment, especially when handling multimodal content that combines text and images. Existing evaluation datasets heavily lean towards…

Computation and Language · Computer Science 2026-03-05 Gabriel Downer , Sean Craven , Damian Ruck , Jake Thomas

Vision and language models (VLMs) such as CLIP have showcased remarkable zero-shot recognition abilities yet face challenges in visio-linguistic compositionality, particularly in linguistic comprehension and fine-grained image-text…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Youngtaek Oh , Pyunghwan Ahn , Jinhyung Kim , Gwangmo Song , Soonyoung Lee , In So Kweon , Junmo Kim

Recent progress in large pre-trained vision language models (VLMs) has reached state-of-the-art performance on several object detection benchmarks and boasts strong zero-shot capabilities, but for optimal performance on specific targets…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Frank Ruis , Gertjan Burghouts , Hugo Kuijf

Vision-Language Models (VLMs) parse documents end-to-end but frequently break down on layouts unlike those seen in training. We attribute this to a two-hop bottleneck: before the decoder can extract content (Hop 2), it must first classify…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Peter El Hachem , Ahmed Nassar , A. Said Gurbuz , Christoph Auer , Peter W. J. Staar

By treating visual tokens from visual encoders as text tokens, Multimodal Large Language Models (MLLMs) have achieved remarkable progress across diverse visual understanding tasks, leveraging the robust architectures of Large Language…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Zeliang Zhang , Phu Pham , Wentian Zhao , Kun Wan , Yu-Jhe Li , Jianing Zhou , Daniel Miranda , Ajinkya Kale , Chenliang Xu

Vision-Language Models (VLMs) have rapidly advanced alongside Large Language Models (LLMs). This study evaluates the capabilities of prominent generative VLMs, such as GPT-4.1 and Gemini 2.5 Pro, accessed via APIs, for histopathology image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Samarth Singhal , Sandeep Singhal

Background: A systematic literature review (SLR) is a methodology used to aggregate all relevant existing evidence to answer a research question of interest. Although crucial, the process used to select primary studies can be arduous, time…

Large language models (LLMs) demonstrate extraordinary abilities in a wide range of natural language processing (NLP) tasks. In this paper, we show that, beyond text understanding capability, LLMs are capable of processing text layouts that…

Computation and Language · Computer Science 2024-08-29 Weiming Li , Manni Duan , Dong An , Yan Shao