English
Related papers

Related papers: Interpretable Vision-Language Survival Analysis wi…

200 papers

Recent advancements in computational pathology have produced patch-level Multi-modal Large Language Models (MLLMs), but these models are limited by their inability to analyze whole slide images (WSIs) comprehensively and their tendency to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yuci Liang , Xinheng Lyu , Wenting Chen , Meidan Ding , Jipeng Zhang , Xiangjian He , Song Wu , Xiaohan Xing , Sen Yang , Xiyue Wang , Linlin Shen

Survival prediction based on whole slide images (WSIs) is a challenging task for patient-level multiple instance learning (MIL). Due to the vast amount of data for a patient (one or multiple gigapixels WSIs) and the irregularly shaped…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Zhuchen Shao , Yang Chen , Hao Bian , Jian Zhang , Guojun Liu , Yongbing Zhang

Oncologists often rely on a multitude of data, including whole-slide images (WSIs), to guide therapeutic decisions, aiming for the best patient outcome. However, predicting the prognosis of cancer patients can be a challenging task due to…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 M Rita Verdelho , Alexandre Bernardino , Catarina Barata

Accurate biomedical image classification under low-resource conditions remains challenging due to limited annotations, subtle inter-class visual differences, and complex disease semantics. While vision--language models offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xiaoliu Luo , Minxue Xiao , Ting Xie , Mengzhu Wang , Huiqing Qi , Joey Tianyi Zhou , Taiping Zhang , Xu Wang

Representation learning from Gigapixel Whole Slide Images (WSI) poses a significant challenge in computational pathology due to the complicated nature of tissue structures and the scarcity of labeled data. Multi-instance learning methods…

Image and Video Processing · Electrical Eng. & Systems 2024-05-28 Ali Nasiri-Sarvi , Vincent Quoc-Huy Trinh , Hassan Rivaz , Mahdi S. Hosseini

The rapidly emerging field of computational pathology has the potential to enable objective diagnosis, therapeutic response prediction and identification of new morphological features of clinical relevance. However, deep learning-based…

Image and Video Processing · Electrical Eng. & Systems 2020-05-25 Ming Y. Lu , Drew F. K. Williamson , Tiffany Y. Chen , Richard J. Chen , Matteo Barbieri , Faisal Mahmood

Whole slide images (WSIs) are gigapixel-scale digital images of H\&E-stained tissue samples widely used in pathology. The substantial size and complexity of WSIs pose unique analytical challenges. Multiple Instance Learning (MIL) has…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jun Wang , Yu Mao , Nan Guan , Chun Jason Xue

Introducing interpretability and reasoning into Multiple Instance Learning (MIL) methods for Whole Slide Image (WSI) analysis is challenging, given the complexity of gigapixel slides. Traditionally, MIL interpretability is limited to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Saarthak Kapse , Pushpak Pati , Srijan Das , Jingwei Zhang , Chao Chen , Maria Vakalopoulou , Joel Saltz , Dimitris Samaras , Rajarsi R. Gupta , Prateek Prasanna

While Vision-Language Models (VLMs) have achieved notable progress in computational pathology (CPath), the gigapixel scale and spatial heterogeneity of Whole Slide Images (WSIs) continue to pose challenges for multimodal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Fengchun Liu , Songhan Jiang , Linghan Cai , Ziyue Wang , Yongbing Zhang

Whole slide images (WSIs) enable weakly supervised prognostic modeling via multiple instance learning (MIL). Spatial transcriptomics (ST) preserves in situ gene expression, providing a spatial molecular context that complements morphology.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Lihe Liu , Xiaoxi Pan , Yinyin Yuan , Lulu Shang

Survival analysis using pathology images poses a considerable challenge, as it requires the localization of relevant information from the multitude of tiles within whole slide images (WSIs). Current methods typically resort to a two-stage…

Image and Video Processing · Electrical Eng. & Systems 2024-09-09 Zhongwei Qiu , Hanqing Chao , Wenbin Liu , Yixuan Shen , Le Lu , Ke Yan , Dakai Jin , Yun Bian , Hui Jiang

Whole slide imaging is fundamental to biomedical microscopy and computational pathology. Previously, learning representations for gigapixel-sized whole slide images (WSIs) has relied on multiple instance learning with weak labels, which do…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Xinhai Hou , Cheng Jiang , Akhil Kondepudi , Yiwei Lyu , Asadur Chowdury , Honglak Lee , Todd C. Hollon

Lung squamous cell carcinoma (LSCC) has a high recurrence and metastasis rate. Factors influencing recurrence and metastasis are currently unknown and there are no distinct histopathological or morphological features indicating the risks of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Weicheng Zhu , Carlos Fernandez-Granda , Narges Razavian

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

We introduce the task of open-vocabulary visual instance search (OVIS). Given an arbitrary textual search query, Open-vocabulary Visual Instance Search (OVIS) aims to return a ranked list of visual instances, i.e., image patches, that…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Sheng Liu , Kevin Lin , Lijuan Wang , Junsong Yuan , Zicheng Liu

Interpretability is significant in computational pathology, leading to the development of multimodal information integration from histopathological image and corresponding text data.However, existing multimodal methods have limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Kangcheng Zhou , Jun Jiang , Qing Zhang , Shuang Zheng , Qingli Li , Shugong Xu

Pathology whole-slide images (WSIs) are widely used for cancer survival analysis because of their comprehensive histopathological information at both cellular and tissue levels, enabling quantitative, large-scale, and prognostically rich…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Yucheng Xing , Ling Huang , Jingying Ma , Ruping Hong , Jiangdong Qiu , Pei Liu , Kai He , Huazhu Fu , Mengling Feng

Presenting whole slide images (WSIs) as graph will enable a more efficient and accurate learning framework for cancer diagnosis. Due to the fact that a single WSI consists of billions of pixels and there is a lack of vast annotated datasets…

Image and Video Processing · Electrical Eng. & Systems 2023-06-09 Milan Aryal , Nasim Yahyasoltani

Whole Slide Image (WSI) analysis is a powerful method to facilitate the diagnosis of cancer in tissue samples. Automating this diagnosis poses various issues, most notably caused by the immense image resolution and limited annotations. WSIs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Ahmet Gokberk Gul , Oezdemir Cetin , Christoph Reich , Tim Prangemeier , Nadine Flinner , Heinz Koeppl

Due to the large size and lack of fine-grained annotation, Whole Slide Images (WSIs) analysis is commonly approached as a Multiple Instance Learning (MIL) problem. However, previous studies only learn from training data, posing a stark…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Weiqin Zhao , Ziyu Guo , Yinshuang Fan , Yuming Jiang , Maximus Yeung , Lequan Yu