English
Related papers

Related papers: Foundation Models in Biomedical Imaging: Turning H…

200 papers

Machine Learning (ML) research has increased substantially in recent years, due to the success of predictive modeling across diverse application domains. However, well-known barriers exist when attempting to deploy ML models in high-stakes,…

Machine Learning · Computer Science 2024-09-19 Nathan Wolfrath , Joel Wolfrath , Hengrui Hu , Anjishnu Banerjee , Anai N. Kothari

Medical imaging plays a vital role in modern diagnostics; however, interpreting high-resolution radiological data remains time-consuming and susceptible to variability among clinicians. Traditional image processing techniques often lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Melika Filvantorkaman , Maral Filvan Torkaman

Hallucination in a foundation model (FM) refers to the generation of content that strays from factual reality or includes fabricated information. This survey paper provides an extensive overview of recent efforts that aim to identify,…

Artificial Intelligence · Computer Science 2023-09-13 Vipula Rawte , Amit Sheth , Amitava Das

Hallucinations in foundation models arise from autoregressive training objectives that prioritize token-likelihood optimization over epistemic accuracy, fostering overconfidence and poorly calibrated uncertainty. We define medical…

Computational pathology foundation models (CPathFMs) have emerged as a powerful approach for analyzing histopathological data, leveraging self-supervised learning to extract robust feature representations from unlabeled whole-slide images.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Dong Li , Guihong Wan , Xintao Wu , Xinyu Wu , Ajit J. Nirmal , Christine G. Lian , Peter K. Sorger , Yevgeniy R. Semenov , Chen Zhao

Biomedical Foundation Models (FMs) are rapidly transforming AI-enabled healthcare research and entering clinical validation. However, their susceptibility to learning non-biological technical features -- including variations in…

This paper contributes with a pragmatic evaluation framework for explainable Machine Learning (ML) models for clinical decision support. The study revealed a more nuanced role for ML explanation models, when these are pragmatically embedded…

Artificial Intelligence · Computer Science 2022-12-22 Oskar Wysocki , Jessica Katharine Davies , Markel Vigo , Anne Caroline Armstrong , Dónal Landers , Rebecca Lee , André Freitas

Vision systems to see and reason about the compositional nature of visual scenes are fundamental to understanding our world. The complex relations between objects and their locations, ambiguities, and variations in the real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Muhammad Awais , Muzammal Naseer , Salman Khan , Rao Muhammad Anwer , Hisham Cholakkal , Mubarak Shah , Ming-Hsuan Yang , Fahad Shahbaz Khan

The integration of AI-assisted biomedical image analysis into clinical practice demands AI-generated findings that are not only accurate but also interpretable to clinicians. However, existing biomedical AI models generally lack the ability…

Embodied agents operating in the physical world must make decisions that are not only effective but also safe, spatially coherent, and grounded in context. While recent advances in large multimodal models (LMMs) have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Dinura Dissanayake , Ahmed Heakl , Omkar Thawakar , Noor Ahsan , Ritesh Thawkar , Ketan More , Jean Lahoud , Rao Anwer , Hisham Cholakkal , Ivan Laptev , Fahad Shahbaz Khan , Salman Khan

The hypothesis that computational models can be reliable enough to be adopted in prognosis and patient care is revolutionizing healthcare. Deep learning, in particular, has been a game changer in building predictive models, thus leading to…

Machine Learning · Statistics 2019-06-17 Jayaraman J. Thiagarajan , Deepta Rajan , Prasanna Sattigeri

We introduce Functional Group-Aware Representations for Small Molecules (FARM), a novel foundation model designed to bridge the gap between SMILES, natural language, and molecular graphs. The key idea behind FARM is the incorporation of…

Machine Learning · Computer Science 2026-04-29 Thao Nguyen , Kuan-Hao Huang , Ge Liu , Martin D. Burke , Ying Diao , Heng Ji

Accurate segmentation of organs and tumors in CT and MRI scans is essential for diagnosis, treatment planning, and disease monitoring. While deep learning has advanced automated segmentation, most models remain task-specific, lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Yuheng Li , Yizhou Wu , Yuxiang Lai , Mingzhe Hu , Xiaofeng Yang

Ultrasound is widely used in obstetric care due to its safety, accessibility, and real-time imaging. However, interpretation remains operator-dependent and susceptible to noise and artifacts. Deep learning models have shown strong…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Leya Barrientos , Yuexi Du , Nicha C. Dvornek

Advances in foundation modeling have reshaped computational pathology. However, the increasing number of available models and lack of standardized benchmarks make it increasingly complex to assess their strengths, limitations, and potential…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Andrew Zhang , Guillaume Jaume , Anurag Vaidya , Tong Ding , Faisal Mahmood

While emerging 3D medical foundation models are envisioned as versatile tools with offer general-purpose capabilities, their validation remains largely confined to regional and structural imaging, leaving a significant modality discrepancy…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yichi Zhang , Feiyang Xiao , Le Xue , Wenbo Zhang , Gang Feng , Chenguang Zheng , Yuan Qi , Yuan Cheng , Zixin Hu

Deep Feedback Models (DFMs) are a new class of stateful neural networks that combine bottom up input with high level representations over time. This feedback mechanism introduces dynamics into otherwise static architectures, enabling DFMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 David Calhas , Arlindo L. Oliveira

Deep Foundation Models (DFMs) offer unprecedented capabilities but their increasing complexity presents profound challenges to understanding their internal workings-a critical need for ensuring trust, safety, and accountability. As we…

Computers and Society · Computer Science 2025-04-25 Zhen Tan , Huan Liu

To support future intelligent multifunctional sixth-generation (6G) wireless communication networks, Synesthesia of Machines (SoM) is proposed as a novel paradigm for artificial intelligence (AI)-native intelligent multi-modal…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Xiang Cheng , Boxun Liu , Xuanyu Liu , Ensong Liu , Ziwei Huang

The emergence of advanced reasoning capabilities in Large Language Models (LLMs) marks a transformative development in healthcare applications. Beyond merely expanding functional capabilities, these reasoning mechanisms enhance decision…

Artificial Intelligence · Computer Science 2025-08-27 Armin Berger , Sarthak Khanna , David Berghaus , Rafet Sifa