English
Related papers

Related papers: VisionFM: a Multi-Modal Multi-Task Vision Foundati…

200 papers

Artificial intelligence (AI) that can effectively learn ultrasound representations by integrating multi-source data holds significant promise for advancing clinical care. However, the scarcity of large labeled datasets in real-world…

Foundation models refer to artificial intelligence (AI) models that are trained on massive amounts of data and demonstrate broad generalizability across various tasks with high accuracy. These models offer versatile, one-for-many or…

Image and Video Processing · Electrical Eng. & Systems 2024-11-06 Rina Bao , Erfan Darzi , Sheng He , Chuan-Heng Hsiao , Mohammad Arafat Hussain , Jingpeng Li , Atle Bjornerud , Ellen Grant , Yangming Ou

With abundant, unlabeled real faces, how can we learn robust and transferable facial representations to boost generalization across various face security tasks? We make the first attempt and propose FS-VFM, a scalable self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Gaojian Wang , Feng Lin , Tong Wu , Zhisheng Yan , Kui Ren

Foundation models have recently gained significant attention because of their generalizability and adaptability across multiple tasks and data distributions. Although medical foundation models have emerged, solutions for cardiac imaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Sekeun Kim , Pengfei Jin , Sifan Song , Cheng Chen , Yiwei Li , Hui Ren , Xiang Li , Tianming Liu , Quanzheng Li

Artificial intelligence (AI) has significant potential in healthcare applications, but its training and deployment faces challenges due to healthcare's diverse data, complex tasks, and the need to preserve privacy. Foundation models that…

Vision Foundation Models (VFMs) pretrained on massive datasets exhibit impressive performance on various downstream tasks, especially with limited labeled target data. However, due to their high inference compute cost, these models cannot…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Raviteja Vemulapalli , Hadi Pouransari , Fartash Faghri , Sachin Mehta , Mehrdad Farajtabar , Mohammad Rastegari , Oncel Tuzel

In recent years, there has been a proliferation of spatiotemporal foundation models in different scientific disciplines. While promising, these models are often domain-specific and are only assessed within the particular applications for…

Quantitative evaluation of echocardiography is essential for precise assessment of cardiac condition, monitoring disease progression, and guiding treatment decisions. The diverse nature of echo images, including variations in probe types,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Abdoul Aziz Amadou , Yue Zhang , Sebastien Piat , Paul Klein , Ingo Schmuecking , Tiziano Passerini , Puneet Sharma

The clinical adoption of artificial intelligence (AI) in medical imaging requires models that are both diagnostically accurate and interpretable to clinicians. While current multimodal biomedical foundation models prioritize performance,…

Synthetic Aperture Radar (SAR) is a critical imaging modality due to its all-weather operational capability. Although recent advances in self-supervised learning and masked image modeling (MIM) have enabled SAR foundation models, these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Qiwei Ma , Xukun Lu , Wang Liu , Puhong Duan , Xudong Kang , Shutao Li

Traditional AI methods often rely on task-specific model designs and training, which constrain both the scalability of model size and generalization across different tasks. Here, we introduce ChemFM, a large foundation model specifically…

Computational Engineering, Finance, and Science · Computer Science 2025-11-06 Feiyang Cai , Katelin Zacour , Tianyu Zhu , Tzuen-Rong Tzeng , Yongping Duan , Ling Liu , Srikanth Pilla , Gang Li , Feng Luo

Time series forecasting (TSF) possesses great practical values in various fields, including power and energy, transportation, etc. TSF methods have been studied based on knowledge from classical statistics to modern deep learning. Yet, all…

Machine Learning · Computer Science 2025-10-27 Luoxiao Yang , Yun Wang , Xinqi Fan , Israel Cohen , Jingdong Chen , Zijun Zhang

Foundation models leverage large-scale pretraining to capture extensive knowledge, demonstrating generalization in a wide range of language tasks. By comparison, vision foundation models (VFMs) often exhibit uneven improvements across…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shiqi Huang , Yipei Wang , Natasha Thorley , Alexander Ng , Shaheer Saeed , Mark Emberton , Shonit Punwani , Veeru Kasivisvanathan , Dean Barratt , Daniel Alexander , Yipeng Hu

Noninvasive optical imaging modalities can probe patient's tissue in 3D and over time generate gigabytes of clinically relevant data per sample. There is a need for AI models to analyze this data and assist clinical workflow. The lack of…

The integration of AI-assisted biomedical image analysis into clinical practice demands AI-generated findings that are not only accurate but also interpretable to clinicians. However, existing biomedical AI models generally lack the ability…

Head computed tomography (CT) imaging is a widely-used imaging modality with multitudes of medical indications, particularly in assessing pathology of the brain, skull, and cerebrovascular system. It is commonly the first-line imaging in…

Vision impairment affects millions globally, and early detection is critical to preventing irreversible vision loss. Ophthalmology workflows require clinicians to integrate medical images, structured clinical data, and free-text notes to…

As large language models (LLMs) continue to revolutionize AI research, there is a growing interest in building large-scale brain foundation models to advance neuroscience. While most existing brain foundation models are pre-trained on…

Neurons and Cognition · Quantitative Biology 2026-02-11 Xinxu Wei , Kanhao Zhao , Yong Jiao , Lifang He , Yu Zhang

Neuroimaging is a ubiquitous tool for evaluating patients with neurological diseases. The global demand for magnetic resonance imaging (MRI) studies has risen steadily, placing significant strain on health systems, prolonging turnaround…

While traditional computer vision models have historically struggled to generalize to endoscopic domains, the emergence of foundation models has shown promising cross-domain performance. In this work, we present the first large-scale study…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Leon Mayer , Tim Rädsch , Dominik Michael , Lucas Luttner , Amine Yamlahi , Evangelia Christodoulou , Patrick Godau , Marcel Knopp , Annika Reinke , Fiona Kolbinger , Lena Maier-Hein
‹ Prev 1 3 4 5 6 7 10 Next ›