English
Related papers

Related papers: WSI-LLaVA: A Multimodal Large Language Model for W…

200 papers

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

Lifelong learning for whole slide images (WSIs) poses the challenge of training a unified model to perform multiple WSI-related tasks, such as cancer subtyping and tumor classification, in a distributed, continual fashion. This is a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Doanh C. Bui , Hoai Luan Pham , Vu Trung Duong Le , Tuan Hai Vu , Van Duy Tran , Yasuhiko Nakashima

Whole Slide Images (WSIs) in histopathology pose a significant challenge for extensive medical image analysis due to their ultra-high resolution, massive scale, and intricate spatial relationships. Although existing Multiple Instance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiaxuan Lu , Yuhui Lin , Junyan Shi , Fang Yan , Dongzhan Zhou , Yue Gao , Xiaosong Wang

Whole Slide Image (WSI) MLLMs are difficult to build and deploy because gigapixel slides induce thousands of visual tokens, while only a small fraction of regions is diagnostically relevant. Existing slide-level pathology MLLMs typically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Qingqiao Hu , Weimin Lyu , Meilong Xu , Kehan Qi , Xiaoling Hu , Saumya Gupta , Jiawei Zhou , Chao Chen

Large Vision-Language Models (LVLMs) are capable of handling diverse data types such as imaging, text, and physiological signals, and can be applied in various fields. In the medical field, LVLMs have a high potential to offer substantial…

Vision-language models (VLMs) have demonstrated remarkable progress in multimodal reasoning. However, existing benchmarks remain limited in terms of high-quality, human-verified examples. Many current datasets rely on synthetically…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Patrick Haller , Fabio Barth , Jonas Golde , Georg Rehm , Alan Akbik

Whole slide imaging is fundamental to biomedical microscopy and computational pathology. Previously, learning representations for gigapixel-sized whole slide images (WSIs) has relied on multiple instance learning with weak labels, which do…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Xinhai Hou , Cheng Jiang , Akhil Kondepudi , Yiwei Lyu , Asadur Chowdury , Honglak Lee , Todd C. Hollon

Despite remarkable efforts been made, the classification of gigapixels whole-slide image (WSI) is severely restrained from either the constrained computing resources for the whole slides, or limited utilizing of the knowledge from different…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ming Feng , Kele Xu , Nanhui Wu , Weiquan Huang , Yan Bai , Changjian Wang , Huaimin Wang

The emergence of large multimodal models (LMMs) has brought significant advancements to pathology. Previous research has primarily focused on separately training patch-level and whole-slide image (WSI)-level models, limiting the integration…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxuan Sun , Yixuan Si , Chenglu Zhu , Xuan Gong , Kai Zhang , Pingyi Chen , Ye Zhang , Zhongyi Shui , Tao Lin , Lin Yang

Vision language models (VLM) have achieved success in both natural language comprehension and image recognition tasks. However, their use in pathology report generation for whole slide images (WSIs) is still limited due to the huge size of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Jing Wei Tan , SeungKyu Kim , Eunsu Kim , Sung Hak Lee , Sangjeong Ahn , Won-Ki Jeong

The histopathological analysis of whole-slide images (WSIs) is fundamental to cancer diagnosis but is a time-consuming and expert-driven process. While deep learning methods show promising results, dominant patch-based methods artificially…

Image and Video Processing · Electrical Eng. & Systems 2025-10-08 Alexander Weers , Alexander H. Berger , Laurin Lux , Peter Schüffler , Daniel Rueckert , Johannes C. Paetzold

Whole slide images (WSIs) in computational pathology (CPath) pose a major computational challenge due to their gigapixel scale, often requiring the processing of tens to hundreds of thousands of high-resolution patches per slide. This…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yonghan Shin , SeungKyu Kim , Won-Ki Jeong

In digital pathology, Whole Slide Image (WSI) analysis is usually formulated as a Multiple Instance Learning (MIL) problem. Although transformer-based architectures have been used for WSI classification, these methods require modifications…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Juan I. Pisula , Katarzyna Bozek

The burgeoning discipline of computational pathology shows promise in harnessing whole slide images (WSIs) to quantify morphological heterogeneity and develop objective prognostic modes for human cancers. However, progress is impeded by the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Chao Tu , Kun Huang , Jie Zhang , Qianjin Feng , Yu Zhang , Zhenyuan Ning

Recently, multimodal large language models (MLLMs) have achieved significant advancements across various domains, and corresponding evaluation benchmarks have been continuously refined and improved. In this process, benchmarks in the…

Computation and Language · Computer Science 2025-08-20 Jiacheng Ruan , Dan Jiang , Xian Gao , Ting Liu , Yuzhuo Fu , Yangyang Kang

Current multi-instance learning algorithms for pathology image analysis often require a substantial number of Whole Slide Images for effective training but exhibit suboptimal performance in scenarios with limited learning data. In clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Linhao Qu , Dingkang Yang , Dan Huang , Qinhao Guo , Rongkui Luo , Shaoting Zhang , Xiaosong Wang

This paper proposes one of the first clinical applications of multimodal large language models (LLMs) as an assistant for radiologists to check errors in their reports. We created an evaluation dataset from real-world radiology datasets…

Computation and Language · Computer Science 2024-03-05 Jinge Wu , Yunsoo Kim , Eva C. Keller , Jamie Chow , Adam P. Levine , Nikolas Pontikos , Zina Ibrahim , Paul Taylor , Michelle C. Williams , Honghan Wu

Vision-language models (VLMs) have gained significant attention in computational pathology due to their multimodal learning capabilities that enhance big-data analytics of giga-pixel whole slide image (WSI). However, their sensitivity to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Vasudev Sharma , Ahmed Alagha , Abdelhakim Khellaf , Vincent Quoc-Huy Trinh , Mahdi S. Hosseini

Multimodal Large Language Model (MLLM) has recently garnered attention as a prominent research focus. By harnessing powerful LLM, it facilitates a transition of conversational generative AI from unimodal text to performing multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xuechen Guo , Wenhao Chai , Shi-Yan Li , Gaoang Wang

Recently, histopathology vision-language foundation models (VLMs) have gained popularity due to their enhanced performance and generalizability across different downstream tasks. However, most existing histopathology benchmarks are either…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Roba Al Majzoub , Hashmat Malik , Muzammal Naseer , Zaigham Zaheer , Tariq Mahmood , Salman Khan , Fahad Khan