English
Related papers

Related papers: Enabling clinical use of foundation models for com…

200 papers

Over the past decade, deep learning models have exhibited considerable advancements, reaching or even exceeding human-level performance in a range of visual perception tasks. This remarkable progress has sparked interest in applying deep…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yulin Wang , Yizeng Han , Chaofei Wang , Shiji Song , Qi Tian , Gao Huang

Promptable segmentation foundation models have emerged as a transformative approach to addressing the diverse needs in medical images, but most existing models require expensive computing, posing a big barrier to their adoption in clinical…

As the potential of foundation models in visual tasks has garnered significant attention, pretraining these models before downstream tasks has become a crucial step. The three key factors in pretraining foundation models are the pretraining…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Keumgang Cha , Junghoon Seo , Taekyung Lee

Deep learning models are routinely employed in computational pathology (CPath) for solving problems of diagnostic and prognostic significance. Typically, the generalization performance of CPath models is analyzed using evaluation protocols…

Image and Video Processing · Electrical Eng. & Systems 2021-06-18 Alex Foote , Amina Asif , Ayesha Azam , Tim Marshall-Cox , Nasir Rajpoot , Fayyaz Minhas

Precision medicine in musculoskeletal imaging requires scalable measurement infrastructure. We developed a modular system that converts routine MRI into standardized quantitative biomarkers suitable for clinical decision support. Promptable…

Image and Video Processing · Electrical Eng. & Systems 2026-04-06 Gabrielle Hoyer , Michelle W Tong , Rupsa Bhattacharjee , Valentina Pedoia , Sharmila Majumdar

Foundation models have demonstrated remarkable generalization, data efficiency, and robustness properties across various domains. In this paper, we explore the feasibility of foundation models for applications in the control domain. The…

Machine Learning · Computer Science 2024-12-18 Martin Ziegler , Andres Felipe Posada-Moreno , Friedrich Solowjow , Sebastian Trimpe

Foundation models for tabular data, such as the Tabular Prior-data Fitted Network (TabPFN), are pre-trained on a massive number of synthetic datasets generated by structural causal models (SCM). They leverage in-context learning to offer…

Machine Learning · Computer Science 2026-01-28 Qinyi Liu , Mohammad Khalil , Naman Goel

Visual microscopic study of diseased tissue by pathologists has been the cornerstone for cancer diagnosis and prognostication for more than a century. Recently, deep learning methods have made significant advances in the analysis and…

Image and Video Processing · Electrical Eng. & Systems 2022-09-30 Puria Azadi Moghadam , Sanne Van Dalen , Karina C. Martin , Jochen Lennerz , Stephen Yip , Hossein Farahani , Ali Bashashati

As natural image understanding moves towards the pretrain-finetune era, research in pathology imaging is concurrently evolving. Despite the predominant focus on pretraining pathological foundation models, how to adapt foundation models to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jiaxuan Lu , Fang Yan , Xiaofan Zhang , Yue Gao , Shaoting Zhang

Recent years have seen significant efforts to adopt Artificial Intelligence (AI) in healthcare for various use cases, from computer-aided diagnosis to ICU triage. However, the size of AI models has been rapidly growing due to scaling laws…

Image and Video Processing · Electrical Eng. & Systems 2024-04-16 Mohammed Adnan , Qinle Ba , Nazim Shaikh , Shivam Kalra , Satarupa Mukherjee , Auranuch Lorsakul

Understanding material failure is critical for designing stronger and lighter structures by identifying weaknesses that could be mitigated. Existing full-physics numerical simulation techniques involve trade-offs between speed, accuracy,…

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

There is substantial interest in developing artificial intelligence systems to support radiologists across tasks ranging from segmentation to report generation. Existing computed tomography (CT) foundation models have largely focused on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Rubén Moreno-Aguado , Alba Magallón , Victor Moreno , Yingying Fang , Guang Yang

A deep feature based saliency model (DeepFeat) is developed to leverage the understanding of the prediction of human fixations. Traditional saliency models often predict the human visual attention relying on few level image cues. Although…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Ali Mahdi , Jun Qin

Causal inference, estimating causal effects from observational data, is a fundamental tool in many disciplines. Of particular importance across a variety of domains is the continuous treatment setting, where the variable of intervention has…

Machine Learning · Computer Science 2026-05-15 Christopher Stith , Medha Barath , Vahid Balazadeh , Jesse C. Cresswell , Rahul G. Krishnan

Foundation models have garnered increasing attention for representation learning in remote sensing. Many such foundation models adopt approaches that have demonstrated success in computer vision with minimal domain-specific modification.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Kevin Lane , Morteza Karimzadeh

The rise of biomedical foundation models creates new hurdles in model testing and authorization, given their broad capabilities and susceptibility to complex distribution shifts. We suggest tailoring robustness tests according to…

Software Engineering · Computer Science 2025-09-01 R. Patrick Xian , Noah R. Baker , Tom David , Qiming Cui , A. Jay Holmgren , Stefan Bauer , Madhumita Sushil , Reza Abbasi-Asl

With access to large-scale, unlabeled medical datasets, researchers are confronted with two questions: Should they attempt to pretrain a custom foundation model on this medical data, or use transfer-learning from an existing generalist…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Jakob Ambsdorf , Asbjørn Munk , Sebastian Llambias , Anders Nymark Christensen , Kamil Mikolaj , Randall Balestriero , Martin Tolsgaard , Aasa Feragen , Mads Nielsen

In the field of medical image analysis, achieving high accuracy is not enough; ensuring well-calibrated predictions is also crucial. Confidence scores of a deep neural network play a pivotal role in explainability by providing insights into…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Abhishek Singh Sambyal , Usma Niyaz , Narayanan C. Krishnan , Deepti R. Bathula

Foundation models open up new possibilities for the use of AI in healthcare. However, even when pre-trained on health data, they still need to be fine-tuned for specific downstream tasks. Furthermore, although foundation models reduce the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Adam Tupper , Christian Gagné