English
Related papers

Related papers: Cross-Domain Foundation Model Adaptation: Pioneeri…

200 papers

Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in…

Machine Learning · Computer Science 2025-01-17 Wasif Khan , Seowung Leem , Kyle B. See , Joshua K. Wong , Shaoting Zhang , Ruogu Fang

This paper reviews the most notable works applying machine learning techniques (ML) in the context of geophysics and corresponding subbranches. We showcase both the progress achieved to date as well as the important future directions for…

Machine Learning · Computer Science 2021-02-08 Miroslav Kosanic , Veljko Milutinovic

Developing physics-based models for molecular simulation requires fitting many unknown parameters to diverse experimental datasets. Traditionally, this process is piecemeal and difficult to reproduce, leading to a fragmented landscape of…

Biological Physics · Physics 2025-04-10 Ryan K. Krueger , Megan C. Engel , Ryan Hausen , Michael P. Brenner

Bioinformatics has witnessed a paradigm shift with the increasing integration of artificial intelligence (AI), particularly through the adoption of foundation models (FMs). These AI techniques have rapidly advanced, addressing historical…

Quantitative Methods · Quantitative Biology 2024-02-08 Qing Li , Zhihang Hu , Yixuan Wang , Lei Li , Yimin Fan , Irwin King , Le Song , Yu Li

Recent advances in foundation models have shown great promise in domains such as natural language processing and computer vision, and similar efforts are now emerging in the Earth Observation community. These models aim to generalize across…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Pierre Adorni , Minh-Tan Pham , Stéphane May , Sébastien Lefèvre

The increasing availability of Earth observation data offers unprecedented opportunities for large-scale environmental monitoring and analysis. However, these datasets are inherently heterogeneous, stemming from diverse sensors,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Georges Le Bellier , Nicolas Audebert

Foundation models (FMs) are transforming computational pathology by offering new ways to analyze histopathology images. However, FMs typically require weeks of training on large databases, making their creation a resource-intensive process.…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Till Nicke , Daniela Schacherer , Jan Raphael Schäfer , Natalia Artysh , Antje Prasse , André Homeyer , Andrea Schenk , Henning Höfener , Johannes Lotz

General Circulation Models (GCMs) are widely used for future climate projections, but their coarse spatial resolution and systematic biases limit their direct use for impact studies. This limitation is particularly critical for wind-related…

While reinforcement learning from scratch has shown impressive results in solving sequential decision-making tasks with efficient simulators, real-world applications with expensive interactions require more sample-efficient agents.…

Machine Learning · Computer Science 2025-09-22 Remo Sasso , Michelangelo Conserva , Dominik Jeurissen , Paulo Rauber

Over the past decades, computer-aided diagnosis tools for breast cancer have been developed to enhance screening procedures, yet their clinical adoption remains challenged by data variability and inherent biases. Although foundation models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Elodie Germani , Ilayda Selin Türk , Fatima Zeineddine , Charbel Mourad , Shadi Albarqouni

Earth observation (EO) missions produce petabytes of multispectral imagery, increasingly analyzed using large Geospatial Foundation Models (GeoFMs). Alongside end-to-end adaptation, workflows make growing use of intermediate representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Luis Gilch , Isabelle Wittmann , Maximilian Nitsche , Johannes Jakubik , Arne Ewald , Thomas Brunschwiler

Deep learning models such as convolutional neural networks and transformers have been widely applied to solve 3D object detection problems in the domain of autonomous driving. While existing models have achieved outstanding performance on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Ruixiao Zhang , Juheon Lee , Xiaohao Cai , Adam Prugel-Bennett

Capturing human mobility is essential for modeling how people interact with and move through physical spaces, reflecting social behavior, access to resources, and dynamic spatial patterns. To support scalable and transferable analysis…

Artificial Intelligence · Computer Science 2025-06-18 Mohammad Hashemi , Andreas Zufle

Unsupervised domain adaptation (UDA) is vital for alleviating the workload of labeling 3D point cloud data and mitigating the absence of labels when facing a newly defined domain. Various methods of utilizing images to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jingyi Xu , Weidong Yang , Lingdong Kong , Youquan Liu , Rui Zhang , Qingyuan Zhou , Ben Fei

Recent progress in self-supervision has shown that pre-training large neural networks on vast amounts of unsupervised data can lead to substantial increases in generalization to downstream tasks. Such models, recently coined foundation…

Foundation models are deep neural networks (such as GPT-5, Gemini~3, and Opus~4) trained on large datasets that can perform diverse downstream tasks -- text and code generation, question answering, summarization, image classification, and…

Machine Learning · Computer Science 2026-05-01 Logan G Wright , Tianyu Wang , Tatsuhiro Onodera , Peter L. McMahon

Machine learning and deep learning methods have been widely explored in understanding the chaotic behavior of the atmosphere and furthering weather forecasting. There has been increasing interest from technology companies, government…

Significant progress in the development of highly adaptable and reusable Artificial Intelligence (AI) models is expected to have a significant impact on Earth science and remote sensing. Foundation models are pre-trained on large unlabeled…

Foundation models (FMs) are general-purpose artificial intelligence (AI) models that have recently enabled multiple brand-new generative AI applications. The rapid advances in FMs serve as an important contextual backdrop for the vision of…

Networking and Internet Architecture · Computer Science 2024-05-08 Zihan Chen , Howard H. Yang , Y. C. Tay , Kai Fong Ernest Chong , Tony Q. S. Quek

Seismic processing plays a crucial role in transforming raw data into high-quality subsurface images, pivotal for various geoscience applications. Despite its importance, traditional seismic processing techniques face challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Fabian Fuchs , Mario Ruben Fernandez , Norman Ettrich , Janis Keuper