English
Related papers

Related papers: When are Foundation Models Effective? Understandin…

200 papers

The realization of universal robots is an ultimate goal of researchers. However, a key hurdle in achieving this goal lies in the robots' ability to manipulate objects in their unstructured surrounding environments according to different…

Geospatial technologies are becoming increasingly essential in our world for a wide range of applications, including agriculture, urban planning, and disaster response. To help improve the applicability and performance of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Matias Mendieta , Boran Han , Xingjian Shi , Yi Zhu , Chen Chen

Foundation models have transformed natural language processing and computer vision, and their impact is now reshaping remote sensing image analysis. With powerful generalization and transfer learning capabilities, they align naturally with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Liling Yang , Ning Chen , Jun Yue , Yidan Liu , Jiayi Ma , Pedram Ghamisi , Antonio Plaza , Leyuan Fang

Recent advances in self-supervised learning and neural network scaling have enabled the creation of large models, known as foundation models, which can be easily adapted to a wide range of downstream tasks. The current paradigm for…

Machine Learning · Computer Science 2024-01-09 Brandon Duderstadt , Hayden S. Helm , Carey E. Priebe

The foundation model has recently garnered significant attention due to its potential to revolutionize the field of visual representation learning in a self-supervised manner. While most foundation models are tailored to effectively process…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Danfeng Hong , Bing Zhang , Xuyang Li , Yuxuan Li , Chenyu Li , Jing Yao , Naoto Yokoya , Hao Li , Pedram Ghamisi , Xiuping Jia , Antonio Plaza , Paolo Gamba , Jon Atli Benediktsson , Jocelyn Chanussot

The advent of foundation models, particularly Vision-Language Models (VLMs) and Multi-modal Large Language Models (MLLMs), has redefined the frontiers of artificial intelligence, enabling remarkable generalization across diverse tasks with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Redwan Sony , Parisa Farmanifard , Hamzeh Alzwairy , Nitish Shukla , Arun Ross

Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in…

Machine Learning · Computer Science 2025-01-17 Wasif Khan , Seowung Leem , Kyle B. See , Joshua K. Wong , Shaoting Zhang , Ruogu Fang

Significant progress in the development of highly adaptable and reusable Artificial Intelligence (AI) models is expected to have a significant impact on Earth science and remote sensing. Foundation models are pre-trained on large unlabeled…

Recent advancements in machine learning (ML), natural language processing (NLP), and foundational models have shown promise for real-life applications in critical, albeit compute-constrainted fields like healthcare. In such areas, combining…

Machine Learning · Computer Science 2025-02-05 Georgios Margaritis , Periklis Petridis , Dimitris J. Bertsimas

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Foundation models have reshaped the landscape of Remote Sensing (RS) by enhancing various image interpretation tasks. Pretraining is an active research topic, encompassing supervised and self-supervised learning methods to initialize model…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Di Wang , Jing Zhang , Minqiang Xu , Lin Liu , Dongsheng Wang , Erzhong Gao , Chengxi Han , Haonan Guo , Bo Du , Dacheng Tao , Liangpei Zhang

Accurate lung tumor segmentation is crucial for improving diagnosis, treatment planning, and patient outcomes in oncology. However, the complexity of tumor morphology, size, and location poses significant challenges for automated…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Elena Mulero Ayllón , Massimiliano Mantegna , Linlin Shen , Paolo Soda , Valerio Guarrasi , Matteo Tortora

Data scaling has revolutionized research fields like natural language processing, computer vision, and robotics control, providing foundation models with remarkable multi-task and generalization capabilities. In this paper, we investigate…

Systems and Control · Electrical Eng. & Systems 2025-03-27 Shaohuai Liu , Lin Dong , Chao Tian , Le Xie

Biometric capture devices have been utilised to estimate a person's alertness through near-infrared iris images, expanding their use beyond just biometric recognition. However, capturing a substantial number of corresponding images related…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Juan E. Tapia , Christoph Busch

Foundation Models have demonstrated significant success across various domains in Artificial Intelligence (AI), yet their capabilities for brainwave modeling remain unclear. In this paper, we comprehensively evaluate current Large Brainwave…

Machine Learning · Computer Science 2025-11-26 Na Lee , Konstantinos Barmpas , Yannis Panagakis , Dimitrios Adamos , Nikolaos Laskaris , Stefanos Zafeiriou

Remote sensing (RS) techniques are increasingly crucial for deepening our understanding of the planet. As the volume and diversity of RS data continue to grow exponentially, there is an urgent need for advanced data modeling and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Danfeng Hong , Chenyu Li , Xuyang Li , Gustau Camps-Valls , Jocelyn Chanussot

In real-world scenarios, achieving domain adaptation and generalization poses significant challenges, as models must adapt to or generalize across unknown target distributions. Extending these capabilities to unseen multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Hao Dong , Moru Liu , Kaiyang Zhou , Eleni Chatzi , Juho Kannala , Cyrill Stachniss , Olga Fink

Foundation models in medical imaging have shown promising label efficiency, achieving high performance on downstream tasks using only a fraction of the annotated data otherwise required. In this study, we evaluate this potential in the…

Time series forecasting drives operational decisions in areas like finance, transportation, and energy. While supervised learning approaches achieve strong performance, they require domain-specific training, feature engineering, and ongoing…

Machine Learning · Computer Science 2026-05-26 Kavin Soni , Debanshu Das , Vamshi Guduguntla

Modern Foundation Models (FMs) are typically trained on corpora spanning a wide range of different data modalities, topics and downstream tasks. Utilizing these models can be very computationally expensive and is out of reach for most…

Machine Learning · Computer Science 2025-06-09 Andrey Zhmoginov , Jihwan Lee , Mark Sandler