English
Related papers

Related papers: WSI-VQA: Interpreting Whole Slide Images by Genera…

200 papers

Convolutional Neural Networks (CNN) are state-of-the-art models for many image classification tasks. However, to recognize cancer subtypes automatically, training a CNN on gigapixel resolution Whole Slide Tissue Images (WSI) is currently…

Computer Vision and Pattern Recognition · Computer Science 2016-03-10 Le Hou , Dimitris Samaras , Tahsin M. Kurc , Yi Gao , James E. Davis , Joel H. Saltz

Recent rapid progress in the field of computational pathology has been enabled by foundation models. These models are beginning to move beyond encoding image patches towards whole-slide understanding but their clinical utility remains…

Accurate analysis of histopathological images is critical for disease diagnosis and treatment planning. Whole-slide images (WSIs), which digitize tissue specimens at gigapixel resolution, are fundamental to this process but require…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Enhui Chai , Sicheng Chen , Tianyi Zhang , Chad Wong , Kecheng Huang , Zeyu Liu , Fei Xia

The integration of AI in digital pathology, particularly in whole slide image (WSI) and spatial transcriptomics (ST) analysis, holds immense potential for enhancing our understanding of diseases. Despite challenges such as training pattern…

Quantitative Methods · Quantitative Biology 2024-11-18 Chao-Hui Huang , Sara Lichtarge , Diane Fernandez

Vision language models (VLM) have achieved success in both natural language comprehension and image recognition tasks. However, their use in pathology report generation for whole slide images (WSIs) is still limited due to the huge size of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Jing Wei Tan , SeungKyu Kim , Eunsu Kim , Sung Hak Lee , Sangjeong Ahn , Won-Ki Jeong

Histopathology Whole-Slide Images (WSIs) provide an important tool to assess cancer prognosis in computational pathology (CPATH). While existing survival analysis (SA) approaches have made exciting progress, they are generally limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Pei Liu , Luping Ji , Jiaxiang Gou , Bo Fu , Mao Ye

Deep learning methods such as convolutional neural networks (CNNs) are difficult to directly utilize to analyze whole slide images (WSIs) due to the large image dimensions. We overcome this limitation by proposing a novel two-stage…

Image and Video Processing · Electrical Eng. & Systems 2021-06-15 Shivam Kalra , Mohammed Adnan , Sobhan Hemati , Taher Dehkharghanian , Shahryar Rahnamayan , Hamid Tizhoosh

The last decade has seen significant advances in computer-aided diagnostics for cytological screening, mainly through the improvement and integration of scanning techniques such as whole slide imaging (WSI) and the combination with deep…

Signal Processing · Electrical Eng. & Systems 2026-01-23 Philip Groult , Julia D. Sistermanns , Ellen Emken , Oliver Hayden , Wolfgang Utschick

Poor performance of quantitative analysis in histopathological Whole Slide Images (WSI) has been a significant obstacle in clinical practice. Annotating large-scale WSIs manually is a demanding and time-consuming task, unlikely to yield the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Sarah Cechnicka , James Ball , Hadrien Reynaud , Callum Arthurs , Candice Roufosse , Bernhard Kainz

The interpretation of histopathology cases underlies many important diagnostic and treatment decisions in medicine. Notably, this process typically requires pathologists to integrate and summarize findings across multiple slides per case.…

Multimodal survival methods combining gigapixel histology whole-slide images (WSIs) and transcriptomic profiles are particularly promising for patient prognostication and stratification. Current approaches involve tokenizing the WSIs into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Andrew H. Song , Richard J. Chen , Guillaume Jaume , Anurag J. Vaidya , Alexander S. Baras , Faisal Mahmood

Vision Transformers (ViTs) and their multi-scale and hierarchical variations have been successful at capturing image representations but their use has been generally studied for low-resolution images (e.g. - 256x256, 384384). For gigapixel…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Richard J. Chen , Chengkuan Chen , Yicong Li , Tiffany Y. Chen , Andrew D. Trister , Rahul G. Krishnan , Faisal Mahmood

Traditional whole slide image (WSI) analysis methods typically rely on the multiple instance learning (MIL) paradigm, which extracts patch-level features at high magnification and aggregates them for slide-level prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiusong Ge , Yingkang Zhan , Wenjie Zhao , Di Zhang , Ke Wang , Jiashuai Liu , Chunze Yang , Chengzu Li , Jian Zhang , Yuxin Dong , Ni Zhang , Qidong Liu , Mireia Crispin-Ortuzar , Huazhu Fu , Chen Li , Zeyu Gao

Despite being widely used to support clinical care, general-purpose large multimodal models (LMMs) have generally shown poor or inconclusive performance in medical image interpretation, particularly in pathology, where gigapixel images are…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Thomas A. Buckley , Kian R. Weihrauch , Katherine Latham , Andrew Z. Zhou , Padmini A. Manrai , Arjun K. Manrai

Recent studies have made significant progress in developing large language models (LLMs) in the medical domain, which can answer expert-level questions and demonstrate the potential to assist clinicians in real-world clinical scenarios.…

Computation and Language · Computer Science 2025-04-18 Sangwook Kim , Soonyoung Lee , Jongseong Jang

Whole-Slide Image (WSI) is an important tool for estimating cancer prognosis. Current studies generally follow a conventional cancer-specific paradigm in which each cancer corresponds to a single model. However, this paradigm naturally…

Image and Video Processing · Electrical Eng. & Systems 2025-12-03 Pei Liu , Luping Ji , Jiaxiang Gou , Xiangxiang Zeng

Whole Slide Images (WSIs) in histopathology pose a significant challenge for extensive medical image analysis due to their ultra-high resolution, massive scale, and intricate spatial relationships. Although existing Multiple Instance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jiaxuan Lu , Yuhui Lin , Junyan Shi , Fang Yan , Dongzhan Zhou , Yue Gao , Xiaosong Wang

Algorithmic decision support is rapidly becoming a staple of personalized medicine, especially for high-stakes recommendations in which access to certain information can drastically alter the course of treatment, and thus, patient outcome;…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Haomin Chen , T. Y. Alvin Liu , Catalina Gomez , Zelia Correa , Mathias Unberath

VQA (Visual Question Answering) combines Natural Language Processing (NLP) with image understanding to answer questions about a given image. It has enormous potential for the development of medical diagnostic AI systems. Such a system can…

Image and Video Processing · Electrical Eng. & Systems 2025-07-30 Gaurav Parajuli

Histopathology whole slide images (WSIs) are being widely used to develop deep learning-based diagnostic solutions, especially for precision oncology. Most of these diagnostic softwares are vulnerable to biases and impurities in the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Abhijeet Patil , Harsh Diwakar , Jay Sawant , Nikhil Cherian Kurian , Subhash Yadav , Swapnil Rane , Tripti Bameta , Amit Sethi