English
Related papers

Related papers: Multimodal Pathology Image Search Between H&E Slid…

200 papers

Histopathology image analysis is fundamental to digital pathology, with hematoxylin and eosin (H&E) staining as the gold standard for diagnostic and prognostic assessments. While H&E imaging effectively highlights cellular and tissue…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Yao Du , Jiaxin Zhuang , Xiaoyu Zheng , Jing Cong , Limei Guo , Chao He , Lin Luo , Xiaomeng Li

Predicting the response of a patient to a cancer treatment is of high interest. Nonetheless, this task is still challenging from a medical point of view due to the complexity of the interaction between the patient organism and the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Bilel Guetarni , Feryal Windal , Halim Benhabiles , Mahfoud Chaibi , Romain Dubois , Emmanuelle Leteurtre , Dominique Collard

Hematoxylin and Eosin (H&E) staining is widely regarded as the standard in pathology for diagnosing diseases and tracking tumor recurrence. While H&E staining shows tissue structures, it lacks the ability to reveal specific proteins that…

Image and Video Processing · Electrical Eng. & Systems 2025-05-21 Tushar Kataria , Beatrice Knudsen , Shireen Y. Elhabian

Accurate prediction of placental diseases via whole slide images (WSIs) is critical for preventing severe maternal and fetal complications. However, WSI analysis presents significant computational challenges due to the massive data volume.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Hang Guo , Qing Zhang , Zixuan Gao , Siyuan Yang , Shulin Peng , Xiang Tao , Ting Yu , Yan Wang , Qingli Li

Histopathological image analysis is an essential process for the discovery of diseases such as cancer. However, it is challenging to train CNN on whole slide images (WSIs) of gigapixel resolution considering the available memory capacity.…

Image and Video Processing · Electrical Eng. & Systems 2019-10-11 Shusuke Takahama , Yusuke Kurose , Yusuke Mukuta , Hiroyuki Abe , Masashi Fukayama , Akihiko Yoshizawa , Masanobu Kitagawa , Tatsuya Harada

Multimodal approaches that integrate histology and genomics hold strong potential for precision oncology. However, phenotypic and genotypic heterogeneity limits the quality of intra-modal representations and hinders effective inter-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yupei Zhang , Yating Huang , Wanming Hu , Lequan Yu , Hujun Yin , Chao Li

Autofluorescence lifetime images reveal unique characteristics of endogenous fluorescence in biological samples. Comprehensive understanding and clinical diagnosis rely on co-registration with the gold standard, histology images, which is…

Image and Video Processing · Electrical Eng. & Systems 2022-02-17 Qiang Wang , Susan Fernandes , Gareth O. S. Williams , Neil Finlayson , Ahsan R. Akram , Kevin Dhaliwal , James R. Hopgood , Marta Vallejo

Large amounts of digitized histopathological data display a promising future for developing pathological foundation models via self-supervised learning methods. Foundation models pretrained with these methods serve as a good basis for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Shengyi Hua , Fang Yan , Tianle Shen , Lei Ma , Xiaofan Zhang

Multimodal evidence is critical in computational pathology: gigapixel whole slide images capture tumor morphology, while patient-level clinical descriptors preserve complementary context for prognosis. Integrating such heterogeneous signals…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Chengying She , Chengwei Chen , Xinran Zhang , Ben Wang , Lizhuang Liu , Chengwei Shao , Yun Bian

Molecular subtypes of breast cancer are important references to personalized clinical treatment. For cost and labor savings, only one of the patient's paraffin blocks is usually selected for subsequent immunohistochemistry (IHC) to obtain…

Image and Video Processing · Electrical Eng. & Systems 2022-03-16 Hong Liu , Wen-Dong Xu , Zi-Hao Shang , Xiang-Dong Wang , Hai-Yan Zhou , Ke-Wen Ma , Huan Zhou , Jia-Lin Qi , Jia-Rui Jiang , Li-Lan Tan , Hui-Min Zeng , Hui-Juan Cai , Kuan-Song Wang , Yue-Liang Qian

Histological Tertiary Lymphoid Structures (TLSs) are increasingly recognized for their correlation with the efficacy of immunotherapy in various solid tumors. Traditionally, the identification and characterization of TLSs rely on…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Qiuli Wang , Yongxu Liu , Li Ma , Xianqi Wang , Wei Chen , Xiaohong Yao

Deep Learning-based computational pathology algorithms have demonstrated profound ability to excel in a wide array of tasks that range from characterization of well known morphological phenotypes to predicting non-human-identifiable…

Image and Video Processing · Electrical Eng. & Systems 2020-09-24 Ming Y. Lu , Dehan Kong , Jana Lipkova , Richard J. Chen , Rajendra Singh , Drew F. K. Williamson , Tiffany Y. Chen , Faisal Mahmood

Survival prediction, utilizing pathological images and genomic profiles, is increasingly important in cancer analysis and prognosis. Despite significant progress, precise survival analysis still faces two main challenges: (1) The massive…

Image and Video Processing · Electrical Eng. & Systems 2024-06-26 Songhan Jiang , Zhengyu Gan , Linghan Cai , Yifeng Wang , Yongbing Zhang

Hand-crafted features extracted from dynamic contrast-enhanced magnetic resonance images (DCE-MRIs) have shown strong predictive abilities in characterization of breast lesions. However, heterogeneity across medical image datasets hinders…

Medical Physics · Physics 2017-01-17 Natalia Antropova , Benjamin Huynh , Maryellen Giger

Multiple instance learning (MIL) is the dominant framework for whole-slide image analysis in computational pathology, typically combining a frozen patch encoder, a projection layer, and a slide-level aggregator. While encoders and…

Quantitative Methods · Quantitative Biology 2026-05-19 Yucheng Xing , Pei Liu , Jingying Ma , Ruping Hong , Jiangdong Qiu , Tianyu Liu , Kai He , Ling Huang , Mengling Feng

Weakly-supervised classification of histopathology slides is a computationally intensive task, with a typical whole slide image (WSI) containing billions of pixels to process. We propose Discriminative Region Active Sampling for Multiple…

Image and Video Processing · Electrical Eng. & Systems 2023-02-23 Jack Breen , Katie Allen , Kieran Zucker , Geoff Hall , Nicolas M. Orsi , Nishant Ravikumar

We introduce MHVAE, a deep hierarchical variational auto-encoder (VAE) that synthesizes missing images from various modalities. Extending multi-modal VAEs with a hierarchical latent structure, we introduce a probabilistic formulation for…

The tumor microenvironment (TME) is a spatially heterogeneous ecosystem where cellular interactions shape tumor progression and response to therapy. Multiplexed imaging technologies enable high-resolution spatial characterization of the…

Applications · Statistics 2025-04-04 Joel Eliason , Arvind Rao , Timothy L Frankel , Michele Peruzzi

Histopathology whole slide images (WSIs) can reveal significant inter-hospital variability such as illumination, color or optical artifacts. These variations, caused by the use of different scanning protocols across medical centers…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Marin Scalbert , Maria Vakalopoulou , Florent Couzinié-Devy

Non-invasive inference of molecular tumor characteristics from medical imaging is a central goal of radiogenomics, particularly in glioblastoma (GBM), where O6-methylguanine-DNA methyltransferase (MGMT) promoter methylation carries…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Mariya Miteva , Maria Nisheva-Pavlova