English
Related papers

Related papers: CytoFM: The first cytology foundation model

200 papers

Advances in foundation modeling have reshaped computational pathology. However, the increasing number of available models and lack of standardized benchmarks make it increasingly complex to assess their strengths, limitations, and potential…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Andrew Zhang , Guillaume Jaume , Anurag Vaidya , Tong Ding , Faisal Mahmood

We propose a novel transformer model, capable of segmenting medical images of varying modalities. Challenges posed by the fine grained nature of medical image analysis mean that the adaptation of the transformer for their analysis is still…

Image and Video Processing · Electrical Eng. & Systems 2023-01-31 Athanasios Tragakis , Chaitanya Kaul , Roderick Murray-Smith , Dirk Husmeier

Foundation models, especially those using transformers as backbones, have gained significant popularity, particularly in language and language-vision tasks. However, large foundation models are typically trained on high-quality data, which…

Signal Processing · Electrical Eng. & Systems 2024-04-30 Cheng Ding , Zhicheng Guo , Zhaoliang Chen , Randall J Lee , Cynthia Rudin , Xiao Hu

Gastrointestinal (GI) endoscopy is essential in identifying GI tract abnormalities in order to detect diseases in their early stages and improve patient outcomes. Although deep learning has shown success in supporting GI diagnostics and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Alina Devkota , Annahita Amireskandari , Joel Palko , Shyam Thakkar , Donald Adjeroh , Xiajun Jiang , Binod Bhattarai , Prashnna K. Gyawali

Foundation models like the Segment Anything Model (SAM) excel in zero-shot segmentation for natural images but struggle with medical image segmentation due to differences in texture, contrast, and noise. Annotating medical images is costly…

Image and Video Processing · Electrical Eng. & Systems 2025-04-14 Sourya Sengupta , Satrajit Chakrabarty , Keerthi Sravan Ravi , Gopal Avinash , Ravi Soni

Multimodal Foundation Models (FMs) offer a path to learn general-purpose representations from heterogeneous ecological data, easily transferable to downstream tasks. However, practical biodiversity modelling remains fragmented; separate…

Analyzing and inspecting bone marrow cell cytomorphology is a critical but highly complex and time-consuming component of hematopathology diagnosis. Recent advancements in artificial intelligence have paved the way for the application of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Shayan Fazeli , Alireza Samiei , Thomas D. Lee , Majid Sarrafzadeh

A Pathology report is arguably one of the most important documents in medicine containing interpretive information about the visual findings from the patient's biopsy sample. Each pathology report has a retention period of up to 20 years…

Computation and Language · Computer Science 2019-03-19 Shivam Kalra , Larry Li , Hamid R. Tizhoosh

Background and objective: Cell-level pathological image analysis requires working with extremely small image patches (40x40 pixels), far below standard ImageNet resolutions. It remains unclear whether modern deep learning architectures and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Hiroki Kagiyama , Toru Nagasaka , Yukari Adachi , Takaaki Tachibana , Ryota Ito , Mitsugu Fujita , Kimihiro Yamashita , Yoshihiro Kakeji

Inevitable domain and task discrepancies in real-world scenarios can impair the generalization performance of the pre-trained deep models for medical data. Therefore, we audaciously propose that we should build a general-purpose medical AI…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Huahui Yi , Ziyuan Qin , Qicheng Lao , Wei Xu , Zekun Jiang , Dequan Wang , Shaoting Zhang , Kang Li

Bone marrow cell cytomorphology analysis is critical for the diagnosis of hematological malignancies but remains a labor-intensive process subject to significant inter-observer variability. While recent foundation models have shown promise…

Other Quantitative Biology · Quantitative Biology 2025-12-23 Aziz Muminov , Anne Pham

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

Biological foundation models (BioFMs), pretrained on large-scale biological sequences, have recently shown strong potential in providing meaningful representations for diverse downstream bioinformatics tasks. However, such models often rely…

Machine Learning · Computer Science 2026-02-10 Yifan Wu , Jiyue Jiang , Xichen Ye , Yiqi Wang , Chang Zhou , Yitao Xu , Jiayang Chen , He Hu , Weizhong Zhang , Cheng Jin , Jiao Yuan , Yu Li

The emergence of foundation models in computational pathology has transformed histopathological image analysis, with whole slide imaging (WSI) diagnosis being a core application. Traditionally, weakly supervised fine-tuning via multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Jiawen Li , Jiali Hu , Qiehe Sun , Renao Yan , Minxi Ouyang , Tian Guan , Anjia Han , Chao He , Yonghong He

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Continual learning offers…

Image and Video Processing · Electrical Eng. & Systems 2025-08-20 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Pathology foundation models (PFMs) have emerged as powerful tools for analyzing whole slide images (WSIs). However, adapting these pretrained PFMs for specific clinical tasks presents considerable challenges, primarily due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Neeraj Kumar , Swaraj Nanda , Siddharth Singi , Jamal Benhamida , David Kim , Jie-Fu Chen , Amir Momeni-Boroujeni , Gregory M. Goldgof , Gabriele Campanella , Chad Vanderbilt

Foundation models (FMs) are driving a prominent shift in biomedical imaging from task-specific models to unified backbone models for diverse tasks. This opens an avenue to integrate imaging, pathology, clinical records, and genomics data…

Quantitative Methods · Quantitative Biology 2026-04-23 Amgad Muneer , Kai Zhang , Ibraheem Hamdi , Rizwan Qureshi , Muhammad Waqas , Shereen Fouad , Hazrat Ali , Syed Muhammad Anwar , Jia Wu

Recent advances in AI foundation models have significant potential for lightening the clinical workload by mimicking the comprehensive and multi-faceted approaches used by medical professionals. In the field of radiation oncology, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Kwanyoung Kim , Yujin Oh , Sangjoon Park , Hwa Kyung Byun , Joongyo Lee , Jin Sung Kim , Yong Bae Kim , Jong Chul Ye

The rapid development of Vision Foundation Models (VFMs), particularly Vision Transformers (ViT) and Segment Anything Model (SAM), has sparked significant advances in the field of medical image analysis. These models have demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-02-24 Pengchen Liang , Bin Pu , Haishan Huang , Yiwei Li , Hualiang Wang , Weibo Ma , Qing Chang

The recent surge in performance for image analysis of digitised pathology slides can largely be attributed to the advances in deep learning. Deep models can be used to initially localise various structures in the tissue and hence facilitate…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Simon Graham , Quoc Dang Vu , Mostafa Jahanifar , Shan E Ahmed Raza , Fayyaz Minhas , David Snead , Nasir Rajpoot