English
Related papers

Related papers: PAST: A multimodal single-cell foundation model fo…

200 papers

The synergistic interpretation of anatomical information from computed tomography (CT) and metabolic information from positron emission tomography (PET) is important to oncologic imaging. However, existing deep learning methods for PET/CT…

Image and Video Processing · Electrical Eng. & Systems 2026-05-22 Xiaofeng Liu , Qianru Zhang , Thibault Marin , Menghua Xia , Chi Liu , Georges El Fakhri , Jinsong Ouyang

Positron emission tomography (PET) is a well-established functional imaging technique for diagnosing brain disorders. However, PET's high costs and radiation exposure limit its widespread use. In contrast, magnetic resonance imaging (MRI)…

Image and Video Processing · Electrical Eng. & Systems 2024-10-24 Yitong Li , Igor Yakushev , Dennis M. Hedderich , Christian Wachinger

Recent years have witnessed remarkable progress in multimodal learning within computational pathology. Existing models primarily rely on vision and language modalities; however, language alone lacks molecular specificity and offers limited…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Minghao Han , Dingkang Yang , Linhao Qu , Zizhi Chen , Gang Li , Han Wang , Jiacong Wang , Lihua Zhang

Computed tomography (CT) and clinical numeric data are essential modalities for cancer evaluation, but building large-scale multimodal training datasets for developing medical foundation models remains challenging due to the structural…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Daeun Jung , Jaehyeok Jang , Sooyoung Jang , Yu Rang Park

Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology. Image-based spatial transcriptomics technologies now provide high-resolution measurements of cell…

Quantitative Methods · Quantitative Biology 2026-02-17 Zhenglun Kong , Mufan Qiu , John Boesen , Xiang Lin , Sukwon Yun , Tianlong Chen , Manolis Kellis , Marinka Zitnik

Histopathological imaging is vital for cancer research and clinical practice, with multiplexed Immunofluorescence (MxIF) and Hematoxylin and Eosin (H&E) providing complementary insights. However, aligning different stains at the cell level…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jun Jiang , Raymond Moore , Brenna Novotny , Leo Liu , Zachary Fogarty , Ray Guo , Markovic Svetomir , Chen Wang

Multimodal data provides heterogeneous information for a holistic understanding of the tumor microenvironment. However, existing AI models often struggle to harness the rich information within multimodal data and extract poorly…

Machine Learning · Computer Science 2025-09-17 Huajun Zhou , Fengtao Zhou , Jiabo Ma , Yingxue Xu , Xi Wang , Xiuming Zhang , Li Liang , Zhenhui Li , Hao Chen

Computational pathology foundation models (CPathFMs) have emerged as a powerful approach for analyzing histopathological data, leveraging self-supervised learning to extract robust feature representations from unlabeled whole-slide images.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Ajit J. Nirmal , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

The complexity and variability inherent in high-resolution pathological images present significant challenges in computational pathology. While pathology foundation models leveraging AI have catalyzed transformative advancements, their…

Histopathology remains the gold standard for cancer diagnosis because it provides detailed cellular-level assessment of tissue morphology. However, manual histopathological examination is time-consuming, labour-intensive, and subject to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Ravi Mosalpuri , Mohammed Abdelsamea , Ahmed Karam Eldaly

The use of artificial intelligence to enable precision medicine and decision support systems through the analysis of pathology images has the potential to revolutionize the diagnosis and treatment of cancer. Such applications will depend on…

Foundation models pretrained on large-scale pathology datasets have shown promising results across various diagnostic tasks. Here, we present a systematic evaluation of transfer learning strategies for brain tumor classification using these…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Ken Enda , Yoshitaka Oda , Zen-ichi Tanei , Kenichi Satoh , Hiroaki Motegi , Terasaka Shunsuke , Shigeru Yamaguchi , Takahiro Ogawa , Wang Lei , Masumi Tsuda , Shinya Tanaka

The advancement of Spatial Transcriptomics (ST) has facilitated the spatially-aware profiling of gene expressions based on histopathology images. Although ST data offers valuable insights into the micro-environment of tumors, its…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Hongyi Wang , Xiuju Du , Jing Liu , Shuyi Ouyang , Yen-Wei Chen , Lanfen Lin

Foundation models are reshaping computational pathology by enabling transfer learning, where models pre-trained on vast datasets can be adapted for downstream diagnostic, prognostic, and therapeutic response tasks. Despite these advances,…

Pathology foundation models (PFMs) have recently emerged as powerful pretrained encoders for computational pathology, enabling transfer learning across a wide range of downstream tasks. However, systematic comparisons of these models for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Fredrik K. Gustafsson , Constance Boissin , Johan Vallon-Christersson , David A. Clifton , Mattias Rantalainen

Foundation models have revolutionized computational pathology by achieving remarkable success in high-level diagnostic tasks, yet the critical challenge of low-level image enhancement remains largely unaddressed. Real-world pathology images…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ziyi Liu , Zhe Xu , Jiabo Ma , Wenqaing Li , Junlin Hou , Fuxiang Huang , Xi Wang , Ronald Cheong Kin Chan , Terence Tsz Wai Wong , Hao Chen

Pathology foundation models (PFMs) have emerged as a core approach for learning transferable representations from whole slide images (WSIs), and they are typically benchmarked through downstream clinical endpoints. While such task level…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bokai Zhao , Yiyang Zhang , Yuanchi Zhu , Hanqing Chao , Long Bai , Tai Ma , Minfeng Xu , Ming Song , Tianzi Jiang

Computational pathology relies on effective representation learning to support cancer research and precision medicine. Although self-supervised learning has driven major progress at the patch and whole-slide image levels, representation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Loïc Chadoutaud , Alice Blondel , Hana Feki , Jacqueline Fontugne , Emmanuel Barillot , Thomas Walter

The diagnosis of cancer is mainly performed by visual analysis of the pathologists, through examining the morphology of the tissue slices and the spatial arrangement of the cells. If the microscopic image of a specimen is not stained, it…

Image and Video Processing · Electrical Eng. & Systems 2020-02-06 Pegah Salehi , Abdolah Chalechale

Spatial omics (SO) technologies enable spatially resolved molecular profiling, while hematoxylin and eosin (H&E) imaging remains the gold standard for morphological assessment in clinical pathology. Recent computational advances…