中文
相关论文

相关论文: WSI-LLaVA: A Multimodal Large Language Model for W…

200 篇论文

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

Lifelong learning for whole slide images (WSIs) poses the challenge of training a unified model to perform multiple WSI-related tasks, such as cancer subtyping and tumor classification, in a distributed, continual fashion. This is a…

计算机视觉与模式识别 · 计算机科学 2025-04-23 Doanh C. Bui , Hoai Luan Pham , Vu Trung Duong Le , Tuan Hai Vu , Van Duy Tran , Yasuhiko Nakashima

Whole Slide Images (WSIs) in histopathology pose a significant challenge for extensive medical image analysis due to their ultra-high resolution, massive scale, and intricate spatial relationships. Although existing Multiple Instance…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Jiaxuan Lu , Yuhui Lin , Junyan Shi , Fang Yan , Dongzhan Zhou , Yue Gao , Xiaosong Wang

Whole Slide Image (WSI) MLLMs are difficult to build and deploy because gigapixel slides induce thousands of visual tokens, while only a small fraction of regions is diagnostically relevant. Existing slide-level pathology MLLMs typically…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Qingqiao Hu , Weimin Lyu , Meilong Xu , Kehan Qi , Xiaoling Hu , Saumya Gupta , Jiawei Zhou , Chao Chen

Large Vision-Language Models (LVLMs) are capable of handling diverse data types such as imaging, text, and physiological signals, and can be applied in various fields. In the medical field, LVLMs have a high potential to offer substantial…

Vision-language models (VLMs) have demonstrated remarkable progress in multimodal reasoning. However, existing benchmarks remain limited in terms of high-quality, human-verified examples. Many current datasets rely on synthetically…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Patrick Haller , Fabio Barth , Jonas Golde , Georg Rehm , Alan Akbik

Whole slide imaging is fundamental to biomedical microscopy and computational pathology. Previously, learning representations for gigapixel-sized whole slide images (WSIs) has relied on multiple instance learning with weak labels, which do…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Xinhai Hou , Cheng Jiang , Akhil Kondepudi , Yiwei Lyu , Asadur Chowdury , Honglak Lee , Todd C. Hollon

Despite remarkable efforts been made, the classification of gigapixels whole-slide image (WSI) is severely restrained from either the constrained computing resources for the whole slides, or limited utilizing of the knowledge from different…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Ming Feng , Kele Xu , Nanhui Wu , Weiquan Huang , Yan Bai , Changjian Wang , Huaimin Wang

The emergence of large multimodal models (LMMs) has brought significant advancements to pathology. Previous research has primarily focused on separately training patch-level and whole-slide image (WSI)-level models, limiting the integration…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Yuxuan Sun , Yixuan Si , Chenglu Zhu , Xuan Gong , Kai Zhang , Pingyi Chen , Ye Zhang , Zhongyi Shui , Tao Lin , Lin Yang

Vision language models (VLM) have achieved success in both natural language comprehension and image recognition tasks. However, their use in pathology report generation for whole slide images (WSIs) is still limited due to the huge size of…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Jing Wei Tan , SeungKyu Kim , Eunsu Kim , Sung Hak Lee , Sangjeong Ahn , Won-Ki Jeong

The histopathological analysis of whole-slide images (WSIs) is fundamental to cancer diagnosis but is a time-consuming and expert-driven process. While deep learning methods show promising results, dominant patch-based methods artificially…

图像与视频处理 · 电气工程与系统科学 2025-10-08 Alexander Weers , Alexander H. Berger , Laurin Lux , Peter Schüffler , Daniel Rueckert , Johannes C. Paetzold

Whole slide images (WSIs) in computational pathology (CPath) pose a major computational challenge due to their gigapixel scale, often requiring the processing of tens to hundreds of thousands of high-resolution patches per slide. This…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Yonghan Shin , SeungKyu Kim , Won-Ki Jeong

In digital pathology, Whole Slide Image (WSI) analysis is usually formulated as a Multiple Instance Learning (MIL) problem. Although transformer-based architectures have been used for WSI classification, these methods require modifications…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Juan I. Pisula , Katarzyna Bozek

The burgeoning discipline of computational pathology shows promise in harnessing whole slide images (WSIs) to quantify morphological heterogeneity and develop objective prognostic modes for human cancers. However, progress is impeded by the…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Chao Tu , Kun Huang , Jie Zhang , Qianjin Feng , Yu Zhang , Zhenyuan Ning

Recently, multimodal large language models (MLLMs) have achieved significant advancements across various domains, and corresponding evaluation benchmarks have been continuously refined and improved. In this process, benchmarks in the…

计算与语言 · 计算机科学 2025-08-20 Jiacheng Ruan , Dan Jiang , Xian Gao , Ting Liu , Yuzhuo Fu , Yangyang Kang

Current multi-instance learning algorithms for pathology image analysis often require a substantial number of Whole Slide Images for effective training but exhibit suboptimal performance in scenarios with limited learning data. In clinical…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Linhao Qu , Dingkang Yang , Dan Huang , Qinhao Guo , Rongkui Luo , Shaoting Zhang , Xiaosong Wang

This paper proposes one of the first clinical applications of multimodal large language models (LLMs) as an assistant for radiologists to check errors in their reports. We created an evaluation dataset from real-world radiology datasets…

Vision-language models (VLMs) have gained significant attention in computational pathology due to their multimodal learning capabilities that enhance big-data analytics of giga-pixel whole slide image (WSI). However, their sensitivity to…

计算机视觉与模式识别 · 计算机科学 2025-05-02 Vasudev Sharma , Ahmed Alagha , Abdelhakim Khellaf , Vincent Quoc-Huy Trinh , Mahdi S. Hosseini

Multimodal Large Language Model (MLLM) has recently garnered attention as a prominent research focus. By harnessing powerful LLM, it facilitates a transition of conversational generative AI from unimodal text to performing multimodal tasks.…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Xuechen Guo , Wenhao Chai , Shi-Yan Li , Gaoang Wang

Recently, histopathology vision-language foundation models (VLMs) have gained popularity due to their enhanced performance and generalizability across different downstream tasks. However, most existing histopathology benchmarks are either…

图像与视频处理 · 电气工程与系统科学 2025-03-18 Roba Al Majzoub , Hashmat Malik , Muzammal Naseer , Zaigham Zaheer , Tariq Mahmood , Salman Khan , Fahad Khan