English
Related papers

Related papers: A Generative Foundation Model for Multimodal Histo…

200 papers

Significant disparities between the features of natural images and those inherent to histopathological images make it challenging to directly apply and transfer pre-trained models from natural images to histopathology tasks. Moreover, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zhenfeng Zhuang , Min Cen , Yanfeng Li , Fangyu Zhou , Lequan Yu , Baptiste Magnier , Liansheng Wang

Digital pathology has advanced significantly over the last decade, with Whole Slide Images (WSIs) encompassing vast amounts of data essential for accurate disease diagnosis. High-resolution WSIs are essential for precise diagnosis but…

Image and Video Processing · Electrical Eng. & Systems 2024-08-28 Xuan Xu , Saarthak Kapse , Prateek Prasanna

Integrating multimodal Electronic Health Records (EHR) data, such as numerical time series and free-text clinical reports, has great potential in predicting clinical outcomes. However, prior work has primarily focused on capturing temporal…

Machine Learning · Computer Science 2025-11-10 Fuying Wang , Feng Wu , Yihan Tang , Lequan Yu

We present DiffInfinite, a hierarchical diffusion model that generates arbitrarily large histological images while preserving long-range correlation structural information. Our approach first generates synthetic segmentation masks,…

Histopathology images; microscopy images of stained tissue biopsies contain fundamental prognostic information that forms the foundation of pathological analysis and diagnostic medicine. However, diagnostics from histopathology images…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Aïcha BenTaieb , Ghassan Hamarneh

Diffusion Generative Models (DGM) have rapidly surfaced as emerging topics in the field of computer vision, garnering significant interest across a wide array of deep learning applications. Despite their high computational demand, these…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Denisha Thakkar , Vincent Quoc-Huy Trinh , Sonal Varma , Samira Ebrahimi Kahou , Hassan Rivaz , Mahdi S. Hosseini

Reliable medical image classification requires accurate predictions and well-calibrated uncertainty estimates, especially in high-stakes clinical settings. This work presents MedSymmFlow, a generative-discriminative hybrid model built on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Francisco Caetano , Lemar Abdi , Christiaan Viviers , Amaan Valiuddin , Fons van der Sommen

Discovering genes with similar functions across diverse biomedical contexts poses a significant challenge in gene representation learning due to data heterogeneity. In this study, we resolve this problem by introducing a novel model called…

Machine Learning · Computer Science 2023-10-05 Tianyu Liu , Yuge Wang , Rex Ying , Hongyu Zhao

Large amounts of digitized histopathological data display a promising future for developing pathological foundation models via self-supervised learning methods. Foundation models pretrained with these methods serve as a good basis for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Shengyi Hua , Fang Yan , Tianle Shen , Lei Ma , Xiaofan Zhang

Hematoxylin and Eosin (H&E) staining is the cornerstone of histopathology but lacks molecular specificity. While Immunohistochemistry (IHC) provides molecular insights, it is costly and complex, motivating H&E-to-IHC translation as a…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Erik Großkopf , Valay Bundele , Mehran Hosseinzadeh , Hendrik P. A. Lensch

Histopathology image synthesis plays an important role in tissue restoration, data augmentation, and modeling of tumor microenvironments. However, existing generative methods typically address restoration and generation as separate tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Xuan Xu , Prateek Prasanna

Multimodal fusion leverages information across modalities to learn better feature representations with the goal of improving performance in fusion-based tasks. However, multimodal datasets, especially in medical settings, are typically…

Machine Learning · Computer Science 2025-02-05 Alejandro Guerra-Manzanares , Farah E. Shamout

Biomedical research increasingly relies on integrating diverse data modalities, including gene expression profiles, medical images, and clinical metadata. While medical images and clinical metadata are routinely collected in clinical…

Artificial Intelligence · Computer Science 2026-01-23 Francesca Pia Panaccione , Carlo Sgaravatti , Pietro Pinoli

Augmentation by generative modelling yields a promising alternative to the accumulation of surgical data, where ethical, organisational and regulatory aspects must be considered. Yet, the joint synthesis of (image, mask) pairs for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yannik Frisch , Christina Bornberg , Moritz Fuchs , Anirban Mukhopadhyay

Cell-level dense prediction is central to computational pathology, but remains challenging due to fine-grained histological structures, strong domain shifts, and costly dense annotations. Existing ViT-based pathology foundation models rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Weiming Chen , Xitong Ling , Zhenyang Cai , Xidong Wang , Jiawen Li , Tian Guan , Benyou Wang , Yonghong He

While pathology foundation models have transformed cancer image analysis, they often lack integration with molecular data at single-cell resolution, limiting their utility for precision oncology. Here, we present PAST, a pan-cancer…

Quantitative Methods · Quantitative Biology 2025-07-10 Changchun Yang , Haoyang Li , Yushuai Wu , Yilan Zhang , Yifeng Jiao , Yu Zhang , Rihan Huang , Yuan Cheng , Yuan Qi , Xin Guo , Xin Gao

Clinical decision-making relies on the integration of information across various data modalities, such as clinical time-series, medical images and textual reports. Compared to other domains, real-world medical data is heterogeneous in…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Baraa Al Jorf , Farah Shamout

Diagnosing medical conditions from histopathology data requires a thorough analysis across the various resolutions of Whole Slide Images (WSI). However, existing generative methods fail to consistently represent the hierarchical structure…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Sarah Cechnicka , James Ball , Matthew Baugh , Hadrien Reynaud , Naomi Simmonds , Andrew P. T. Smith , Catherine Horsfield , Candice Roufosse , Bernhard Kainz

The integration of artificial intelligence into digital pathology has the potential to automate and improve various tasks, such as image analysis and diagnostic decision-making. Yet, the inherent variability of tissues, together with the…

Image and Video Processing · Electrical Eng. & Systems 2023-02-14 Ariel Larey , Nati Daniel , Eliel Aknin , Yael Fisher , Yonatan Savir

Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jianhao Xie , Ziang Zhang , Zhenyu Weng , Yuesheng Zhu , Guibo Luo