English
Related papers

Related papers: PBSBench: A Multi-Level Vision-Language Framework …

200 papers

Although large visual-language models (LVLMs) have demonstrated strong performance in multimodal tasks, errors may occasionally arise due to biases during the reasoning process. Recently, reward models (RMs) have become increasingly pivotal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jiacheng Ruan , Wenzhen Yuan , Xian Gao , Ye Guo , Daoxin Zhang , Zhe Xu , Yao Hu , Ting Liu , Yuzhuo Fu

Introduction: Blood vessels can be non-invasively visualized from a digital fundus image (DFI). Several studies have shown an association between cardiovascular risk and vascular features obtained from DFI. Recent advances in computer…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jonathan Fhima , Jan Van Eijgen , Ingeborg Stalmans , Yevgeniy Men , Moti Freiman , Joachim A. Behar

Endoscopic procedures are essential for diagnosing and treating internal diseases, and multi-modal large language models (MLLMs) are increasingly applied to assist in endoscopy analysis. However, current benchmarks are limited, as they…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Shengyuan Liu , Boyun Zheng , Wenting Chen , Zhihao Peng , Zhenfei Yin , Jing Shao , Jiancong Hu , Yixuan Yuan

As advances in large language models (LLMs) and multimodal techniques continue to mature, the development of general-purpose multimodal large language models (MLLMs) has surged, offering significant applications in interpreting natural…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yuxuan Sun , Chenglu Zhu , Sunyi Zheng , Kai Zhang , Lin Sun , Zhongyi Shui , Yunlong Zhang , Honglin Li , Lin Yang

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

In histopathology, intelligent diagnosis of Whole Slide Images (WSIs) is essential for automating and objectifying diagnoses, reducing the workload of pathologists. However, diagnostic models often face the challenge of forgetting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Weixi Zheng , Aoling Huang , Jingping Yuan , Haoyu Zhao , Zhou Zhao , Yongchao Xu , Thierry Géraud

Neural demyelination and brain damage accumulated in white matter appear as hyperintense areas on T2-weighted MRI scans in the form of lesions. Modeling binary images at the population level, where each voxel represents the existence of a…

Methodology · Statistics 2023-05-29 Anna Menacher , Thomas E. Nichols , Chris Holmes , Habib Ganjgahi

With the increasing integration of Multimodal Large Language Models (MLLMs) into the medical field, comprehensive evaluation of their performance in various medical domains becomes critical. However, existing benchmarks primarily assess…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Chenghanyu Zhang , Zekun Li , Peipei Li , Xing Cui , Shuhan Xia , Weixiang Yan , Yiqiao Zhang , Qianyu Zhuang

Histopathology remains the gold standard for cancer diagnosis because it provides detailed cellular-level assessment of tissue morphology. However, manual histopathological examination is time-consuming, labour-intensive, and subject to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Ravi Mosalpuri , Mohammed Abdelsamea , Ahmed Karam Eldaly

We introduce a new benchmark designed to advance the development of general-purpose, large-scale vision-language models for remote sensing images. Although several vision-language datasets in remote sensing have been proposed to pursue this…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Xiang Li , Jian Ding , Mohamed Elhoseiny

The integration of artificial intelligence (AI) into pathology is advancing precision medicine by improving diagnosis, treatment planning, and patient outcomes. Digitised whole-slide images (WSIs) capture rich spatial and morphological…

Whole Slide Image (WSI) analysis plays a crucial role in modern digital pathology, enabling large-scale feature extraction from tissue samples. However, traditional feature extraction pipelines based on tools like CellProfiler often involve…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Yuechen Yang , Yu Wang , Tianyuan Yao , Ruining Deng , Mengmeng Yin , Shilin Zhao , Haichun Yang , Yuankai Huo

Recent advances in multimodal large language models (MLLMs) have led to impressive progress across various benchmarks. However, their capability in understanding infrared images remains unexplored. To address this gap, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Tao Zhang , Yuyang Hong , Yang Xia , Kun Ding , Zeyu Zhang , Ying Wang , Shiming Xiang , Chunhong Pan

The Theory of Multiple Intelligences underscores the hierarchical nature of cognitive capabilities. To advance Spatial Artificial Intelligence, we pioneer a psychometric framework defining five Basic Spatial Abilities (BSAs) in Visual…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Wenrui Xu , Dalin Lyu , Weihang Wang , Jie Feng , Chen Gao , Yong Li

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hai-Dang Nguyen , Minh-Anh Dang , Minh-Tan Le , Minh-Tuan Le

Computational analysis of whole slide images (WSIs) has seen significant research progress in recent years, with applications ranging across important diagnostic and prognostic tasks such as survival or cancer subtype prediction. Many…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Zak Buzzard , Konstantin Hemker , Nikola Simidjievski , Mateja Jamnik

In the domain of scientific imaging, interpreting visual data often demands an intricate combination of human expertise and deep comprehension of the subject materials. This study presents a novel methodology to linguistically emulate and…

Machine Learning · Computer Science 2023-09-27 Abdulelah S. Alshehri , Franklin L. Lee , Shihu Wang

Biomarker detection is an indispensable part of the diagnosis and treatment of low-grade glioma (LGG). However, current LGG biomarker detection methods rely on expensive and complex molecular genetic testing, for which professionals are…

Image and Video Processing · Electrical Eng. & Systems 2026-04-21 Zijie Fang , Yihan Liu , Yifeng Wang , Xiangyang Zhang , Yang Chen , Changjing Cai , Yiyang Lin , Ying Han , Zhi Wang , Shan Zeng , Jun Tan , Yongbing Zhang , Hong Shen

Due to the large size and lack of fine-grained annotation, Whole Slide Images (WSIs) analysis is commonly approached as a Multiple Instance Learning (MIL) problem. However, previous studies only learn from training data, posing a stark…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Weiqin Zhao , Ziyu Guo , Yinshuang Fan , Yuming Jiang , Maximus Yeung , Lequan Yu

Vision-threatening eye diseases pose a major global health burden, with timely diagnosis limited by workforce shortages and restricted access to specialized care. While multimodal large language models (MLLMs) show promise for medical image…