English
Related papers

Related papers: A Foundation Model for Spatial Proteomics

200 papers

Introduction: Photogrammetric surface scans provide a radiation-free option to assess and classify craniosynostosis. Due to the low prevalence of craniosynostosis and high patient restrictions, clinical data is rare. Synthetic data could…

Pathology foundation models (PFMs) have rapidly advanced and are becoming a common backbone for downstream clinical tasks, offering strong transferability across tissues and institutions. However, for dense prediction (e.g., segmentation),…

Image and Video Processing · Electrical Eng. & Systems 2026-02-05 Weiming Chen , Xitong Ling , Xidong Wang , Zhenyang Cai , Yijia Guo , Mingxi Fu , Ziyi Zeng , Minxi Ouyang , Jiawen Li , Yizhi Wang , Tian Guan , Benyou Wang , Yonghong He

Using massive datasets, foundation models are large-scale, pre-trained models that perform a wide range of tasks. These models have shown consistently improved results with the introduction of new methods. It is crucial to analyze how these…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Mobina Mansoori , Sajjad Shahabodini , Farnoush Bayatmakou , Jamshid Abouei , Konstantinos N. Plataniotis , Arash Mohammadi

In this paper, we propose spatial propagation networks for learning the affinity matrix for vision tasks. We show that by constructing a row/column linear propagation model, the spatially varying transformation matrix exactly constitutes an…

Computer Vision and Pattern Recognition · Computer Science 2017-10-04 Sifei Liu , Shalini De Mello , Jinwei Gu , Guangyu Zhong , Ming-Hsuan Yang , Jan Kautz

Cryo-electron microscopy (cryo-EM) remains pivotal in structural biology, yet the task of protein particle picking, integral for 3D protein structure construction, is laden with manual inefficiencies. While recent AI tools such as Topaz and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Fei He , Zhiyuan Yang , Mingyue Gao , Biplab Poudel , Newgin Sam Ebin Sam Dhas , Rajan Gyawali , Ashwin Dhakal , Jianlin Cheng , Dong Xu

Foundation models in digital pathology use massive datasets to learn useful compact feature representations of complex histology images. However, there is limited transparency into what drives the correlation between dataset size and…

Multi-sequence magnetic resonance imaging (MRI) has found wide applications in both modern clinical studies and deep learning research. However, in clinical practice, it frequently occurs that one or more of the MRI sequences are missing…

Image and Video Processing · Electrical Eng. & Systems 2024-03-21 Yunjie Chen , Marius Staring , Olaf M. Neve , Stephan R. Romeijn , Erik F. Hensen , Berit M. Verbist , Jelmer M. Wolterink , Qian Tao

In recent years, deep learning has attracted increasing attention in the field of Cardiac MRI (CMR) reconstruction due to its superior performance over traditional methods, particularly in handling higher acceleration factors, highlighting…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Donghang Lyu , Marius Staring , Hildo Lamb , Mariya Doneva

Multi-modal foundation models are typically trained on millions of pairs of natural images and text captions, frequently obtained through web-crawling approaches. Although such models depict excellent generative capabilities, they do not…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Pierre Chambon , Christian Bluethgen , Curtis P. Langlotz , Akshay Chaudhari

In hematology, computational models offer significant potential to improve diagnostic accuracy, streamline workflows, and reduce the tedious work of analyzing single cells in peripheral blood or bone marrow smears. However, clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Valentin Koch , Sophia J. Wagner , Salome Kazeminia , Ece Sancar , Matthias Hehr , Julia Schnabel , Tingying Peng , Carsten Marr

Spatial transcriptomics enables spatial gene expression profiling, motivating computational models that capture spatially conditioned regulatory relationships. We introduce SAGE-FM, a lightweight spatial transcriptomics foundation model…

Machine Learning · Computer Science 2026-01-23 Xianghao Zhan , Jingyu Xu , Yuanning Zheng , Zinaida Good , Olivier Gevaert

This paper aims to retrieve proteins with similar structures and semantics from large-scale protein dataset, facilitating the functional interpretation of protein structures derived by structural determination methods like cryo-Electron…

Biomolecules · Quantitative Biology 2025-06-11 Qifeng Wu , Zhengzhe Liu , Han Zhu , Yizhou Zhao , Daisuke Kihara , Min Xu

Cancer survival prediction from whole slide images (WSIs) is a challenging task in computational pathology due to the large size, irregular shape, and high granularity of the WSIs. These characteristics make it difficult to capture the full…

Image and Video Processing · Electrical Eng. & Systems 2025-03-05 Rustin Soraki , Huayu Wang , Joann G. Elmore , Linda Shapiro

Proteomics is the large scale study of protein structure and function from biological systems through protein identification and quantification. "Shotgun proteomics" or "bottom-up proteomics" is the prevailing strategy, in which proteins…

One of the most powerful techniques to study protein structures is to look for recurrent fragments (also called substructures or spatial motifs), then use them as patterns to characterize the proteins under study. An emergent trend consists…

Computational Engineering, Finance, and Science · Computer Science 2018-03-02 Wajdi Dhifli , Rabie Saidi , Engelbert Mephu Nguifo

Purpose: Accurately classifying tissue margins during cancer surgeries is crucial for ensuring complete tumor removal. Rapid Evaporative Ionization Mass Spectrometry (REIMS), a tool for real-time intraoperative margin assessment, generates…

Artificial Intelligence (AI) technologies have profoundly transformed the field of remote sensing, revolutionizing data collection, processing, and analysis. Traditionally reliant on manual interpretation and task-specific models, remote…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Siqi Lu , Junlin Guo , James R Zimmer-Dauphinee , Jordan M Nieusma , Xiao Wang , Parker VanValkenburgh , Steven A Wernke , Yuankai Huo

Foundational models have emerged as powerful tools for addressing various tasks in clinical settings. However, their potential development to breast ultrasound analysis remains untapped. In this paper, we present BUSGen, the first…

Melanoma is an aggressive form of skin cancer with rapid progression and high metastatic potential. Accurate characterisation of tissue morphology in melanoma is crucial for prognosis and treatment planning. However, manual segmentation of…

Image and Video Processing · Electrical Eng. & Systems 2025-07-21 Jiaqi Lv , Yijie Zhu , Carmen Guadalupe Colin Tenorio , Brinder Singh Chohan , Mark Eastwood , Shan E Ahmed Raza

Despite the significant potential of Foundation Models (FMs) in medical imaging, their application to prognosis prediction remains challenging due to data scarcity, class imbalance, and task complexity, which limit their clinical adoption.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Filippo Ruffini , Elena Mulero Ayllon , Linlin Shen , Paolo Soda , Valerio Guarrasi