English
Related papers

Related papers: A Foundation Model for Spatial Proteomics

200 papers

Spatial proteomics maps protein distributions in tissues, providing transformative insights for life sciences. However, current sequencing-based technologies suffer from low spatial resolution, and substantial inter-tissue variability in…

Quantitative Methods · Quantitative Biology 2025-08-26 Bokai Zhao , Weiyang Shi , Hanqing Chao , Zijiang Yang , Yiyang Zhang , Ming Song , Tianzi Jiang

Foundation models have emerged as a powerful paradigm in computational pathology (CPath), enabling scalable and generalizable analysis of histopathological images. While early developments centered on uni-modal models trained solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Xiaohui Chen , Yi He , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

The development of clinical-grade artificial intelligence in pathology is limited by the scarcity of diverse, high-quality annotated datasets. Generative models offer a potential solution but suffer from semantic instability and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xianchao Guan , Zhiyuan Fan , Yifeng Wang , Fuqiang Chen , Yanjiang Zhou , Zengyang Che , Hongxue Meng , Xin Li , Yaowei Wang , Hongpeng Wang , Min Zhang , Heng Tao Shen , Zheng Zhang , Yongbing Zhang

In computational pathology, several foundation models have recently emerged and demonstrated enhanced learning capability for analyzing pathology images. However, adapting these models to various downstream tasks remains challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jeaung Lee , Jeewoo Lim , Keunho Byeon , Jin Tae Kwak

Foundation models are used to extract transferable representations from large amounts of unlabeled data, typically via self-supervised learning (SSL). However, many of these models rely on architectures that offer limited interpretability,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Samuel Ofosu Mensah , Camila Roa , Kerol Djoumessi , Philipp Berens

Spatial Transcriptomics (ST) profiles thousands of gene expression values at discrete spots with precise coordinates on tissue sections, preserving spatial context essential for clinical and pathological studies. With rising sequencing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yishun Zhu , Jiaxin Qi , Jian Wang , Yuhua Zheng , Jianqiang Huang

Mass spectrometry is the dominant technology in the field of proteomics, enabling high-throughput analysis of the protein content of complex biological samples. Due to the complexity of the instrumentation and resulting data, sophisticated…

The integration of deep learning systems into healthcare has been hindered by the resource-intensive process of data annotation and the inability of these systems to generalize to different data distributions. Foundation models, which are…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mohammed Baharoon , Waseem Qureshi , Jiahong Ouyang , Yanwu Xu , Abdulrhman Aljouie , Wei Peng

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

The performance of deep learning models is known to scale with data quantity and diversity. In pathology, as in many other medical imaging domains, the availability of labeled images for a specific task is often limited. Self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jonas Ammeling , Jonathan Ganz , Emely Rosbach , Ludwig Lausser , Christof A. Bertram , Katharina Breininger , Marc Aubreville

Background and objective: Cell-level pathological image analysis requires working with extremely small image patches (40x40 pixels), far below standard ImageNet resolutions. It remains unclear whether modern deep learning architectures and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Hiroki Kagiyama , Toru Nagasaka , Yukari Adachi , Takaaki Tachibana , Ryota Ito , Mitsugu Fujita , Kimihiro Yamashita , Yoshihiro Kakeji

Existing deep learning methods for remote sensing image fusion often suffer from poor generalization when applied to unseen datasets due to the limited availability of real training data and the domain gap between different satellite…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yongchuan Cui , Peng Liu , Yi Zeng

Spatial transcriptomics reveals gene expression patterns within tissue context, enabling precision oncology applications such as treatment response prediction, but its high cost and technical complexity limit clinical adoption. Predicting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Won June Cho , Hongjun Yoon , Daeky Jeong , Hyeongyeol Lim , Yosep Chong

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

The integration of spatial multi-omics data from single tissues is crucial for advancing biological research. However, a significant data imbalance impedes progress: while spatial transcriptomics data is relatively abundant, spatial…

Artificial Intelligence · Computer Science 2026-02-06 Zhaorui Jiang , Yingfang Yuan , Lei Hu , Wei Pang

Due to the increasing workload of pathologists, the need for automation to support diagnostic tasks and quantitative biomarker evaluation is becoming more and more apparent. Foundation models have the potential to improve generalizability…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Till Nicke , Jan Raphael Schaefer , Henning Hoefener , Friedrich Feuerhake , Dorit Merhof , Fabian Kiessling , Johannes Lotz

Here we present a structural similarity index measure (SSIM) guided conditional Generative Adversarial Network (cGAN) that generatively performs image-to-image (i2i) synthesis to generate photo-accurate protein channels in multiplexed…

Image and Video Processing · Electrical Eng. & Systems 2024-01-08 Jillur Rahman Saurav , Mohammad Sadegh Nasr , Paul Koomey , Michael Robben , Manfred Huber , Jon Weidanz , Bríd Ryan , Eytan Ruppin , Peng Jiang , Jacob M. Luber

Foundation models have garnered increasing attention for representation learning in remote sensing. Many such foundation models adopt approaches that have demonstrated success in computer vision with minimal domain-specific modification.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Kevin Lane , Morteza Karimzadeh

Pathology foundation models (PFMs) have emerged as a core approach for learning transferable representations from whole slide images (WSIs), and they are typically benchmarked through downstream clinical endpoints. While such task level…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bokai Zhao , Yiyang Zhang , Yuanchi Zhu , Hanqing Chao , Long Bai , Tai Ma , Minfeng Xu , Ming Song , Tianzi Jiang

Spatial transcriptomics (ST) provides spatially resolved measurements of gene expression, enabling characterization of the molecular landscape of human tissue beyond histological assessment as well as localized readouts that can be aligned…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Konstantin Hemker , Andrew H. Song , Cristina Almagro-Pérez , Guillaume Jaume , Sophia J. Wagner , Anurag Vaidya , Nikola Simidjievski , Mateja Jamnik , Faisal Mahmood