English
Related papers

Related papers: Cryo-Bench: Benchmarking Foundation Models for Cry…

200 papers

The increasing availability of geospatial foundation models has the potential to transform remote sensing applications such as land cover classification, environmental monitoring, and change detection. Despite promising benchmark results,…

Training deep neural networks remains computationally intensive due to the itera2 tive nature of gradient-based optimization. We propose Gradient Flow Matching (GFM), a continuous-time modeling framework that treats neural network training…

Machine Learning · Computer Science 2025-05-27 Xiao Shou , Yanna Ding , Jianxi Gao

Over the past decade, U-Net has been the dominant architecture in medical image segmentation, leading to the development of thousands of U-shaped variants. Despite its widespread adoption, there is still no comprehensive benchmark to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Fenghe Tang , Chengqi Dong , Wenxin Ma , Zikang Xu , Heqin Zhu , Zihang Jiang , Rongsheng Wang , Yuhao Wang , Chenxu Wu , Shaohua Kevin Zhou

Foundation models are reshaping medical imaging, yet their application in echocardiography remains limited, hindered by a heavy reliance on private datasets that prevent reproducible comparison. Echocardiography poses unique challenges,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Darya Taratynova , Ahmed Aly , Numan Saeed , Mohammad Yaqub

Artificial Intelligence (AI) Foundation models (FMs), pre-trained on massive unlabelled datasets, have the potential to drastically change AI applications in ocean science, where labelled data are often sparse and expensive to collect. In…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Geoffrey Dawson , Remy Vandaele , Andrew Taylor , David Moffat , Helen Tamura-Wicks , Sarah Jackson , Rosie Lickorish , Paolo Fraccaro , Hywel Williams , Chunbo Luo , Anne Jones

The increasing frequency and severity of climate related disasters have intensified the need for real time monitoring, early warning, and informed decision-making. Earth Observation (EO), powered by satellite data and Machine Learning (ML),…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Stella Girtsou , Konstantinos Alexis , Giorgos Giannopoulos , Charalambos Kontoes

Foundation models (FMs) are a popular topic of research in AI. Their ability to generalize to new tasks and datasets without retraining or needing an abundance of data makes them an appealing candidate for applications on specialist…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Marga Don , Stijn Pinson , Blanca Guillen Cebrian , Yuki M. Asano

Remote sensing semantic segmentation requires models that can jointly capture fine spatial details and high-level semantic context across complex scenes. While classical encoder-decoder architectures such as U-Net remain strong baselines,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Md Aminur Hossain , Ayush V. Patel , Siddhant Gole , Sanjay K. Singh , Biplab Banerjee

The demand for high-resolution subsurface imaging and continuous Earth monitoring has driven rapid growth in active and passive seismic data from dense geophone deployments, distributed acoustic sensing (DAS) arrays, and large-scale 2D and…

Geophysics · Physics 2026-05-13 Jiahua Zhao , Umair bin Waheed , Jing Sun , Yang Cui , Nikos Savva , Eric Verschuur

Pathology foundation models (PFMs) have rapidly advanced and are becoming a common backbone for downstream clinical tasks, offering strong transferability across tissues and institutions. However, for dense prediction (e.g., segmentation),…

Image and Video Processing · Electrical Eng. & Systems 2026-02-05 Weiming Chen , Xitong Ling , Xidong Wang , Zhenyang Cai , Yijia Guo , Mingxi Fu , Ziyi Zeng , Minxi Ouyang , Jiawen Li , Yizhi Wang , Tian Guan , Benyou Wang , Yonghong He

We introduce NeuCo-Bench, a novel benchmark framework for evaluating (lossy) neural compression and representation learning in the context of Earth Observation (EO). Our approach builds on fixed-size embeddings that act as compact,…

High-fidelity Monte Carlo simulations and complex inverse problems, such as mapping smeared experimental observations to ground-truth states, are computationally intensive yet essential for robust data analysis. Conditional Flow Matching…

Machine Learning · Computer Science 2026-04-03 Zeyu Xia , Tyler Kim , Trevor Reed , Judy Fox , Geoffrey Fox , Adam Szczepaniak

Simulating fluid flow around arbitrary shapes is key to solving various engineering problems. However, simulating flow physics across complex geometries remains numerically challenging and computationally resource-intensive, particularly…

Pre-trained Foundation Models (PFMs) have ushered in a paradigm-shift in Artificial Intelligence, due to their ability to learn general-purpose representations that can be readily employed in a wide range of downstream tasks. While PFMs…

Databases · Computer Science 2024-11-13 Pasquale Balsebre , Weiming Huang , Gao Cong , Yi Li

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Salah Ghamizi , Georgia Kanli , Yu Deng , Magali Perquin , Olivier Keunen

Foundation Models (FMs) have shown impressive performance on various text and image processing tasks. They can generalize across domains and datasets in a zero-shot setting. This could make them suitable for automated quality inspection…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Simon Baeuerle , Pratik Khanna , Nils Friederich , Angelo Jovin Yamachui Sitcheu , Damir Shakirov , Andreas Steimer , Ralf Mikut

Training data imbalance poses a major challenge for code LLMs. Most available data heavily over represents raw opensource code while underrepresenting broader software engineering tasks, especially in low resource languages like Golang. As…

Machine Learning · Computer Science 2025-11-17 Yashshi Pipalani , Hritik Raj , Rajat Ghosh , Vaishnavi Bhargava , Debojyoti Dutta

This paper introduces WavesFM, a novel Wireless Foundation Model (WFM) framework, capable of supporting a wide array of communication, sensing, and localization tasks. Our proposed architecture combines a shared Vision Transformer (ViT)…

Signal Processing · Electrical Eng. & Systems 2025-04-22 Ahmed Aboulfotouh , Elsayed Mohammed , Hatem Abou-Zeid

Visual foundation models (VFMs) have become increasingly popular due to their state-of-the-art performance. However, interpretability remains crucial for critical applications. In this sense, self-explainable models (SEM) aim to provide…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Hugues Turbé , Mina Bjelogrlic , Gianmarco Mengaldo , Christian Lovis

As urbanization and climate change progress, urban heat island effects are becoming more frequent and severe. To formulate effective mitigation plans, cities require detailed air temperature data. However, predictive analytics methods based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 David Kreismann