English
Related papers

Related papers: PsOCR: Benchmarking Large Multimodal Models for Op…

200 papers

Due to their crucial role in all NLP, several benchmarks have been proposed to evaluate pretrained language models. In spite of these efforts, no public benchmark of diverse nature currently exists for evaluation of Arabic. This makes it…

Computation and Language · Computer Science 2023-05-31 AbdelRahim Elmadany , El Moatez Billah Nagoudi , Muhammad Abdul-Mageed

The dominance of large multilingual foundation models has widened linguistic inequalities in Natural Language Processing (NLP), often leaving low-resource languages underrepresented. This paper introduces LilMoo, a 0.6-billion-parameter…

Computation and Language · Computer Science 2026-03-05 Shiza Fatimah , Aniket Sen , Sophia Falk , Florian Mai , Lucie Flek , Nicholas Kluge Corrêa

Purpose: To develop a bilingual multimodal visual question answering (VQA) benchmark for evaluating VLMs in ophthalmology. Methods: Ophthalmic image posts and associated captions published between January 1, 2016, and December 31, 2024,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Pusheng Xu , Xia Gong , Xiaolan Chen , Weiyi Zhang , Jiancheng Yang , Bingjie Yan , Meng Yuan , Yalin Zheng , Mingguang He , Danli Shi

Recent advances in large language models (LLMs) have led to strong reasoning capabilities; however, evaluating such models in low-resource languages remains challenging due to the lack of standardized benchmarks. In particular, Urdu…

Computation and Language · Computer Science 2026-01-30 Muhammad Ali Shafique , Areej Mehboob , Layba Fiaz , Muhammad Usman Qadeer , Hamza Farooq

Real-world License Plate Recognition (LPR) faces significant challenges from severe degradations such as motion blur, low resolution, and complex illumination. The prevailing "restoration-then-recognition" two-stage paradigm suffers from a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Haoyan Gong , Hongbin Liu

Text-rich images, where text serves as the central visual element guiding the overall understanding, are prevalent in real-world applications, such as presentation slides, scanned documents, and webpage snapshots. Tasks involving multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Mengzhao Jia , Wenhao Yu , Kaixin Ma , Tianqing Fang , Zhihan Zhang , Siru Ouyang , Hongming Zhang , Dong Yu , Meng Jiang

Large Language Models (LLMs) have demonstrated remarkable success across a wide range of tasks and domains. However, their performance in low-resource language translation, particularly when translating into these languages, remains…

Arabic remains one of the most underrepresented languages in natural language processing research, particularly in medical applications, due to the limited availability of open-source data and benchmarks. The lack of resources hinders…

Computation and Language · Computer Science 2026-02-03 Mouath Abu-Daoud , Leen Kharouf , Omar El Hajj , Dana El Samad , Mariam Al-Omari , Jihad Mallat , Khaled Saleh , Nizar Habash , Farah E. Shamout

Optical Character Recognition (OCR) systems have been widely used in various of application scenarios. Designing an OCR system is still a challenging task. In previous work, we proposed a practical ultra lightweight OCR system (PP-OCR) to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Yuning Du , Chenxia Li , Ruoyu Guo , Cheng Cui , Weiwei Liu , Jun Zhou , Bin Lu , Yehua Yang , Qiwen Liu , Xiaoguang Hu , Dianhai Yu , Yanjun Ma

In recent years, large language models (LLMs) have demonstrated remarkable potential across various medical applications. Building on this foundation, multimodal large language models (MLLMs) integrate LLMs with visual models to process…

Computation and Language · Computer Science 2025-03-11 Xiaoyi Liang , Mouxiao Bian , Moxin Chen , Lihao Liu , Junjun He , Jie Xu , Lin Li

Optical character recognition (OCR) is a vital process that involves the extraction of handwritten or printed text from scanned or printed images, converting it into a format that can be understood and processed by machines. This enables…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Mahmoud SalahEldin Kasem , Mohamed Mahmoud , Hyun-Soo Kang

The rapid development of Multi-modality Large Language Models (MLLMs) has navigated a paradigm shift in computer vision, moving towards versatile foundational models. However, evaluating MLLMs in low-level visual perception and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zicheng Zhang , Haoning Wu , Erli Zhang , Guangtao Zhai , Weisi Lin

Medical imaging quality control (QC) is essential for accurate diagnosis, yet traditional QC methods remain labor-intensive and subjective. To address this challenge, in this study, we establish a standardized dataset and evaluation…

As a digraphic language, the Persian language utilizes two written standards: Perso-Arabic in Afghanistan and Iran, and Tajik-Cyrillic in Tajikistan. Despite the significant similarity between the dialects of each country, script…

Computation and Language · Computer Science 2025-10-10 Rayyan Merchant , Kevin Tang

Language recognition has been significantly advanced in recent years by means of modern machine learning methods such as deep learning and benchmarks with rich annotations. However, research is still limited in low-resource formal…

Computation and Language · Computer Science 2020-06-03 Hadi Abdi Khojasteh , Ebrahim Ansari , Mahdi Bohlouli

As large language models (LLMs) become increasingly embedded in our daily lives, evaluating their quality and reliability across diverse contexts has become essential. While comprehensive benchmarks exist for assessing LLM performance in…

This survey offers a comprehensive overview of Large Language Models (LLMs) designed for Arabic language and its dialects. It covers key architectures, including encoder-only, decoder-only, and encoder-decoder models, along with the…

Computation and Language · Computer Science 2026-05-20 Malak Mashaabi , Shahad Al-Khalifa , Hend Al-Khalifa

This manuscript introduces DharmaOCR Full and Lite, a pair of specialized small language models (SSLMs) for structured OCR that jointly optimize transcription quality, generation stability, and inference cost. It also presents…

Omni-modal large language models (OLLMs) aim to unify audio, vision, and text understanding within a single framework. While existing benchmarks primarily evaluate general cross-modal question-answering ability, it remains unclear whether…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xingrui Wang , Jiang Liu , Chao Huang , Xiaodong Yu , Ze Wang , Ximeng Sun , Jialian Wu , Alan Yuille , Emad Barsoum , Zicheng Liu

This research is the second phase in a series of investigations on developing an Optical Character Recognition (OCR) of Arabic historical documents and examining how different modeling procedures interact with the problem. The first…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Aly Mostafa , Omar Mohamed , Ali Ashraf , Ahmed Elbehery , Salma Jamal , Anas Salah , Amr S. Ghoneim