English
Related papers

Related papers: When are Foundation Models Effective? Understandin…

200 papers

Advances in machine learning over the past decade have resulted in a proliferation of algorithmic applications for encoding, characterizing, and acting on complex data that may contain many high dimensional features. Recently, the emergence…

The impressive performance of ChatGPT and other foundation-model-based products in human language understanding has prompted both academia and industry to explore how these models can be tailored for specific industries and application…

Artificial Intelligence · Computer Science 2025-09-22 Haolong Chen , Hanzhi Chen , Zijian Zhao , Kaifeng Han , Guangxu Zhu , Yichen Zhao , Ying Du , Wei Xu , Qingjiang Shi

High success rates on navigation-related tasks do not necessarily translate into reliable decision making by foundation models. To examine this gap, we evaluate current models on six diagnostic tasks spanning three settings: reasoning under…

Artificial Intelligence · Computer Science 2026-04-09 Jua Han , Jaeyoon Seo , Jungbin Min , Sieun Choi , Huichan Seo , Jihie Kim , Jean Oh

Recent vision foundation models (VFMs) have demonstrated proficiency in various tasks but require supervised fine-tuning to perform the task of semantic segmentation effectively. Benchmarking their performance is essential for selecting…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Tommie Kerssies , Daan de Geus , Gijs Dubbelman

This paper assesses trending AI foundation models, especially emerging computer vision foundation models and their performance in natural landscape feature segmentation. While the term foundation model has quickly garnered interest from the…

The emergence of Large Language Models (LLMs) and multimodal foundation models (FMs) has generated heightened interest in their applications that integrate vision and language. This paper investigates the capabilities of ChatGPT-4V and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Zhenyuan Yang , Xuhui Lin , Qinyi He , Ziye Huang , Zhengliang Liu , Hanqi Jiang , Peng Shu , Zihao Wu , Yiwei Li , Stephen Law , Gengchen Mai , Tianming Liu , Tao Yang

In recent years, foundation models such as CLIP, DINO,and CONCH have demonstrated remarkable domain generalization and unsupervised feature extraction capabilities across diverse imaging tasks. However, systematic and independent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lavish Ramchandani , Aashay Tinaikar , Dev Kumar Das , Rohit Garg , Tijo Thomas

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

Advanced interpretation of hyperspectral remote sensing images benefits many precise Earth observation tasks. Recently, visual foundation models have promoted the remote sensing interpretation but concentrating on RGB and multispectral…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Jingtao Li , Yingyi Liu , Xinyu Wang , Yunning Peng , Chen Sun , Shaoyu Wang , Zhendong Sun , Tian Ke , Xiao Jiang , Tangwei Lu , Anran Zhao , Yanfei Zhong

Neural networks achieve state-of-the-art performance in many supervised learning tasks when the training data distribution matches the test data distribution. However, their performance drops significantly under domain (covariate) shift, a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Kerem Cekmeceli , Meva Himmetoglu , Guney I. Tombak , Anna Susmelj , Ertunc Erdil , Ender Konukoglu

Cloud segmentation is a critical challenge in remote sensing image interpretation, as its accuracy directly impacts the effectiveness of subsequent data processing and analysis. Recently, vision foundation models (VFM) have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Xuechao Zou , Shun Zhang , Kai Li , Shiying Wang , Junliang Xing , Lei Jin , Congyan Lang , Pin Tao

Language models have gained significant interest due to their general-purpose capabilities, which appear to emerge as models are scaled to increasingly larger parameter sizes. However, these large models impose stringent requirements on…

Machine Learning · Computer Science 2024-12-23 Savitha Viswanadh Kandala , Pramuka Medaranga , Ambuj Varshney

Recent developments in foundation models, like Large Language Models (LLMs) and Vision-Language Models (VLMs), trained on extensive data, facilitate flexible application across different tasks and modalities. Their impact spans various…

A key challenge for the widespread application of learning-based models for robotic perception is to significantly reduce the required amount of annotated training data while achieving accurate predictions. This is essential not only to…

Robotics · Computer Science 2024-12-04 Niclas Vödisch , Kürsat Petek , Markus Käppeler , Abhinav Valada , Wolfram Burgard

When deploying large language models (LLMs), it is important to ensure that these models are not only capable, but also reliable. Many benchmarks have been created to track LLMs' growing capabilities, however there has been no similar focus…

Machine Learning · Computer Science 2025-02-06 Joshua Vendrow , Edward Vendrow , Sara Beery , Aleksander Madry

Foundation models (FMs) pretrained on large datasets have become fundamental for various downstream machine learning tasks, in particular in scenarios where obtaining perfectly labeled data is prohibitively expensive. In this paper, we…

Machine Learning · Computer Science 2025-08-04 Ecem Bozkurt , Antonio Ortega

From self-supervised, vision-only models to contrastive visual-language frameworks, computational pathology has rapidly evolved in recent years. Generative AI "co-pilots" now demonstrate the ability to mine subtle, sub-visual tissue cues…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Mohsin Bilal , Aadam , Manahil Raza , Youssef Altherwy , Anas Alsuhaibani , Abdulrahman Abduljabbar , Fahdah Almarshad , Paul Golding , Nasir Rajpoot

Although large-scale visual foundation models (VFMs) achieve remarkable performance in semantic understanding, they still underperform in instance-aware dense prediction tasks. They exhibit different biases in representation: for instance,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yachan Guo , JoseLuis Gomez Zurita , Danna Xue , Yi Xiao , AntonioManuel Lopez Pena

We present GeoGrid-Bench, a benchmark designed to evaluate the ability of foundation models to understand geo-spatial data in the grid structure. Geo-spatial datasets pose distinct challenges due to their dense numerical values, strong…

Computation and Language · Computer Science 2025-05-27 Bowen Jiang , Yangxinyu Xie , Xiaomeng Wang , Jiashu He , Joshua Bergerson , John K Hutchison , Jordan Branham , Camillo J Taylor , Tanwi Mallick

Deep learning has led to remarkable advancements in computational histopathology, e.g., in diagnostics, biomarker prediction, and outcome prognosis. Yet, the lack of annotated data and the impact of batch effects, e.g., systematic technical…

Machine Learning · Computer Science 2024-11-11 Jonah Kömen , Hannah Marienwald , Jonas Dippel , Julius Hense