English
Related papers

Related papers: PAST: A multimodal single-cell foundation model fo…

200 papers

Foundation models have revolutionized the paradigm of digital pathology, as they leverage general-purpose features to emulate real-world pathological practices, enabling the quantitative analysis of critical histological patterns and the…

Vision foundation models trained on discretely sampled images achieve strong performance on classification benchmarks, yet whether their representations encode the continuous processes underlying their training data remains unclear. This…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Pritika Vig , Ren-Chin Wu , William Lotter

Positron emission tomography (PET) is a widely recognized technique for diagnosing neurodegenerative diseases, offering critical functional insights. However, its high costs and radiation exposure hinder its widespread use. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yitong Li , Igor Yakushev , Dennis M. Hedderich , Christian Wachinger

Spatial transcriptomics is a technology that captures gene expression levels at different spatial locations, widely used in tumor microenvironment analysis and molecular profiling of histopathology, providing valuable insights into…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Junzhuo Liu , Markus Eckstein , Zhixiang Wang , Friedrich Feuerhake , Dorit Merhof

The advancement of Spatial Transcriptomics (ST) has facilitated the spatially-aware profiling of gene expressions based on histopathology images. Although ST data offers valuable insights into the micro-environment of tumors, its…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Hongyi Wang , Xiuju Du , Jing Liu , Shuyi Ouyang , Yen-Wei Chen , Lanfen Lin

Carcinogenesis is a proteiform phenomenon, with tumors emerging in various locations and displaying complex, diverse shapes. At the crucial intersection of research and clinical practice, it demands precise and flexible assessment. However,…

Spatial transcriptomics is an emerging field that enables the identification of functional regions based on the spatial distribution of gene expression. Integrating this functional information present in transcriptomic data with structural…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Shanaka Liyanaarachchi , Chathurya Wijethunga , Shihab Aaqil Ahamed , Akthas Absar , Ranga Rodrigo

Deep learning is expected to aid pathologists by automating tasks such as tumour segmentation. We aimed to develop one universal tumour segmentation model for histopathological images and examine its performance in different cancer types.…

Optical sensing technologies are emerging technologies used in cancer surgeries to ensure the complete removal of cancerous tissue. While point-wise assessment has many potential applications, incorporating automated large area scanning…

Robotics · Computer Science 2024-11-07 Bochen Yang , Kaizhong Deng , Christopher J Peters , George Mylonas , Daniel S. Elson

Identification and counting of cells and mitotic figures is a standard task in diagnostic histopathology. Due to the large overall cell count on histological slides and the potential sparse prevalence of some relevant cell types or mitotic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Marc Aubreville , Maximilian Krappmann , Christof Bertram , Robert Klopfleisch , Andreas Maier

Computational pathology has made significant progress in recent years, fueling advances in both fundamental disease understanding and clinically ready tools. This evolution is driven by the availability of large amounts of digitized slides…

Histopathology remains the gold standard for diagnosis of various cancers. Recent advances in computer vision, specifically deep learning, have facilitated the analysis of histopathology images for various tasks, including immune cell…

Quantitative Methods · Quantitative Biology 2023-11-02 Jakub R. Kaczmarzyk , Tahsin M. Kurc , Shahira Abousamra , Rajarsi Gupta , Joel H. Saltz , Peter K. Koo

Emerging research has highlighted that artificial intelligence-based multimodal fusion of digital pathology and transcriptomic features can improve cancer diagnosis (grading/subtyping) and prognosis (survival risk) prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Samiran Dey , Christopher R. S. Banerji , Partha Basuchowdhuri , Sanjoy K. Saha , Deepak Parashar , Tapabrata Chakraborti

The diagnosis and prognosis of cancer are typically based on multi-modal clinical data, including histology images and genomic data, due to the complex pathogenesis and high heterogeneity. Despite the advancements in digital pathology and…

Quantitative Methods · Quantitative Biology 2024-04-15 Zeyu Zhang , Yuanshen Zhao , Jingxian Duan , Yaou Liu , Hairong Zheng , Dong Liang , Zhenyu Zhang , Zhi-Cheng Li

Tumour heterogeneity in breast cancer poses challenges in predicting outcome and response to therapy. Spatial transcriptomics technologies may address these challenges, as they provide a wealth of information about gene expression at the…

Image and Video Processing · Electrical Eng. & Systems 2023-09-19 Md Mamunur Rahaman , Ewan K. A. Millar , Erik Meijering

We introduce ProtoPathway, an interpretable-by-design multimodal framework for cancer survival prediction that unifies whole slide imaging and transcriptomics through encoders producing biologically grounded representations on both sides of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Amaya Gallagher-Syed , Costantino Pitzalis , Myles J. Lewis , Michael R. Barnes , Gregory Slabaugh

Multimodal survival methods combining gigapixel histology whole-slide images (WSIs) and transcriptomic profiles are particularly promising for patient prognostication and stratification. Current approaches involve tokenizing the WSIs into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Andrew H. Song , Richard J. Chen , Guillaume Jaume , Anurag J. Vaidya , Alexander S. Baras , Faisal Mahmood

For predicting cancer survival outcomes, standard approaches in clinical research are often based on two main modalities: pathology images for observing cell morphology features, and genomic (e.g., bulk RNA-seq) for quantifying gene…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hongxiao Wang , Yang Yang , Zhuo Zhao , Pengfei Gu , Nishchal Sapkota , Danny Z. Chen

Spatial transcriptomics (ST) provides essential spatial context by mapping gene expression within tissue, enabling detailed study of cellular heterogeneity and tissue organization. However, aligning ST data with histology images poses…

Accurate survival prediction from multimodal medical data is essential for precision oncology, yet clinical deployment faces a persistent challenge: modalities are frequently incomplete due to cost constraints, technical limitations, or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Kyungwon Kim , Dosik Hwang