English
Related papers

Related papers: PBSBench: A Multi-Level Vision-Language Framework …

200 papers

Vision-language models (VLMs) have recently shown remarkable zero-shot performance in medical image understanding, yet their grounding ability, the extent to which textual concepts align with visual evidence, remains underexplored. In the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Haozhe Luo , Shelley Zixin Shu , Ziyu Zhou , Sebastian Otalora , Mauricio Reyes

Brain imaging analysis is crucial for diagnosing and treating brain disorders, and multimodal large language models (MLLMs) are increasingly supporting it. However, current brain imaging visual question-answering (VQA) benchmarks either…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhihao Peng , Cheng Wang , Shengyuan Liu , Zhiying Liang , Zanting Ye , Minjie Ju , PeterYM Woo , Yixuan Yuan

The emergence of large multimodal models has unlocked remarkable potential in AI, particularly in pathology. However, the lack of specialized, high-quality benchmark impeded their development and precise evaluation. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yuxuan Sun , Hao Wu , Chenglu Zhu , Sunyi Zheng , Qizi Chen , Kai Zhang , Yunlong Zhang , Dan Wan , Xiaoxiao Lan , Mengyue Zheng , Jingxiong Li , Xinheng Lyu , Tao Lin , Lin Yang

While traditional computer vision models have historically struggled to generalize to endoscopic domains, the emergence of foundation models has shown promising cross-domain performance. In this work, we present the first large-scale study…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Leon Mayer , Tim Rädsch , Dominik Michael , Lucas Luttner , Amine Yamlahi , Evangelia Christodoulou , Patrick Godau , Marcel Knopp , Annika Reinke , Fiona Kolbinger , Lena Maier-Hein

Survival prediction based on whole slide images (WSIs) is a challenging task for patient-level multiple instance learning (MIL). Due to the vast amount of data for a patient (one or multiple gigapixels WSIs) and the irregularly shaped…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Zhuchen Shao , Yang Chen , Hao Bian , Jian Zhang , Guojun Liu , Yongbing Zhang

Multimodal Large Language Models (MLLMs) show strong visual perception, yet remain limited in reasoning about space under changing viewpoints. We study this challenge as Perspective-Conditioned Spatial Reasoning (PCSR) in 360-degree…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yuangong Chen , Wai Keung Wong , Jiaxing Li , Ioannis Patras , Xu Zheng

Medical report interpretation plays a crucial role in healthcare, enabling both patient-facing explanations and effective information flow across clinical systems. While recent vision-language models (VLMs) and large language models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Fangxin Shang , Yuan Xia , Dalu Yang , Yahui Wang , Binglin Yang

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

Recent studies have made significant progress in developing large language models (LLMs) in the medical domain, which can answer expert-level questions and demonstrate the potential to assist clinicians in real-world clinical scenarios.…

Computation and Language · Computer Science 2025-04-18 Sangwook Kim , Soonyoung Lee , Jongseong Jang

Large language models (LLMs) have demonstrated immense capabilities in understanding textual data and are increasingly being adopted to help researchers accelerate scientific discovery through knowledge extraction (information retrieval),…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Robinson Umeike , Neil Getty , Fangfang Xia , Rick Stevens

Pathology deals with the practice of discovering the reasons for disease by analyzing the body samples. The most used way in this field, is to use histology which is basically studying and viewing microscopic structures of cell and tissues.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-08 Virender Ranga , Shivam Gupta , Priyansh Agrawal , Jyoti Meena

Pulmonary hemorrhage (P-Hem) occurs among multiple species and can have various causes. Cytology of bronchoalveolarlavage fluid (BALF) using a 5-tier scoring system of alveolar macrophages based on their hemosiderin content is considered…

Prompt learning has emerged as a promising paradigm for adapting pre-trained vision-language models (VLMs) to few-shot whole slide image (WSI) classification by aligning visual features with textual representations, thereby reducing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Junjie Zhou , Wei Shao , Yagao Yue , Wei Mu , Peng Wan , Qi Zhu , Daoqiang Zhang

The reliable analysis of blood reports is important for health knowledge, but individuals often struggle with interpretation, leading to anxiety and overlooked issues. We explore the potential of general-purpose Vision-Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Nadia Bakhsheshi , Hamid Beigy

Developing self-supervised learning (SSL) models that can learn universal and transferable representations of H&E gigapixel whole-slide images (WSIs) is becoming increasingly valuable in computational pathology. These models hold the…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Guillaume Jaume , Anurag Vaidya , Andrew Zhang , Andrew H. Song , Richard J. Chen , Sharifa Sahai , Dandan Mo , Emilio Madrigal , Long Phi Le , Faisal Mahmood

Brain midline shift (MLS) is one of the most critical factors to be considered for clinical diagnosis and treatment decision-making for intracranial hemorrhage. Existing computational methods on MLS quantification not only require intensive…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Shizhan Gong , Cheng Chen , Yuqi Gong , Nga Yan Chan , Wenao Ma , Calvin Hoi-Kwan Mak , Jill Abrigo , Qi Dou

Accurate classification of pediatric central nervous system tumors remains challenging due to histological complexity and limited training data. While pathology foundation models have advanced whole-slide image (WSI) analysis, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jian Yu , Joakim Nguyen , Jinrui Fang , Awais Naeem , Zeyuan Cao , Sanjay Krishnan , Nicholas Konz , Tianlong Chen , Chandra Krishnan , Hairong Wang , Edward Castillo , Ying Ding , Ankita Shukla

Semi-supervised learning (SSL) has emerged as an effective paradigm for medical image segmentation, reducing the reliance on extensive expert annotations. Meanwhile, vision-language models (VLMs) have demonstrated strong generalization and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaqi Guo , Mingzhen Li , Hanyu Su , Santiago López , Lexiaozi Fan , Daniel Kim , Aggelos Katsaggelos

Semi-supervised learning (SSL) has emerged as a promising paradigm for breast ultrasound (BUS) image segmentation, but it often suffers from unstable pseudo labels under extremely limited annotations, leading to inaccurate supervision and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ruili Li , Jiayi Ding , Ruiyu Li , Yilun Jin , Shiwen Ge , Yuwen Zeng , Xiaoyong Zhang , Eichi Takaya , Jan Vrba , Noriyasu Homma

Advances in optical microscopy scanning have significantly contributed to computational pathology (CPath) by converting traditional histopathological slides into whole slide images (WSIs). This development enables comprehensive digital…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Xitong Ling , Yuanyuan Lei , Jiawen Li , Junru Cheng , Wenting Huang , Tian Guan , Jian Guan , Yonghong He