English
Related papers

Related papers: Panopticon: Advancing Any-Sensor Foundation Models…

200 papers

Earth observation applications increasingly rely on data from multiple sensors, including optical, radar, elevation, and land-cover. Relationships between modalities are fundamental for data integration but are inherently non-injective:…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Miguel Espinosa , Eva Gmelich Meijling , Valerio Marsocci , Elliot J. Crowley , Mikolaj Czerkawski

We aim to develop a robust yet flexible visual foundation model for Earth observation. It should possess strong capabilities in recognizing and localizing diverse visual targets while providing compatibility with various input-output…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Liang Yao , Fan Liu , Delong Chen , Chuanyi Zhang , Yijun Wang , Ziyun Chen , Wei Xu , Shimin Di , Yuhui Zheng

Driven by rapid climate change, the frequency and intensity of flood events are increasing. Electro-Optical (EO) satellite imagery is commonly utilized for rapid response. However, its utilities in flood situations are hampered by issues…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Minseok Seo , Youngtack Oh , Doyi Kim , Dongmin Kang , Yeji Choi

While foundation models have shown promise across a variety of fields, astronomy still lacks a unified framework for joint modeling across its highly diverse data modalities. In this paper, we present AION-1, a family of large-scale…

Recent progress in self-supervision shows that pre-training large neural networks on vast amounts of unsupervised data can lead to impressive increases in generalisation for downstream tasks. Such models, recently coined as foundation…

Geospatial models must adapt to the diversity of Earth observation data in terms of resolutions, scales, and modalities. However, existing approaches expect fixed input configurations, which limits their practical applicability. We propose…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Guillaume Astruc , Nicolas Gonthier , Clement Mallet , Loic Landrieu

Vision foundation models like DINOv2 demonstrate remarkable potential in medical imaging despite their origin in natural image domains. However, their design inherently works best for uni-modal image analysis, limiting their effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Viktoria Ehm , Anke Meyer-Baese , Jan C. Peeken , Daniel Rueckert , Benedikt Wiestler

The demand for high-resolution subsurface imaging and continuous Earth monitoring has driven rapid growth in active and passive seismic data from dense geophone deployments, distributed acoustic sensing (DAS) arrays, and large-scale 2D and…

Geophysics · Physics 2026-05-13 Jiahua Zhao , Umair bin Waheed , Jing Sun , Yang Cui , Nikos Savva , Eric Verschuur

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Alistair Francis , Mikolaj Czerkawski

Foundation models in artificial intelligence (AI) are transforming medical imaging by enabling general-purpose feature learning from large-scale, unlabeled datasets. In this work, we introduce BrainFound, a self-supervised foundation model…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Moona Mazher , Geoff J. M. Parker , Daniel C. Alexander

Recent advances in foundation models have shown great promise in domains such as natural language processing and computer vision, and similar efforts are now emerging in the Earth Observation community. These models aim to generalize across…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Pierre Adorni , Minh-Tan Pham , Stéphane May , Sébastien Lefèvre

Vision foundation models have attracted significant attention for their ability to leverage large-scale unlabeled visual data. This advantage is particularly important in remote sensing, where data acquisition is costly and annotation often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hyobin Park , Minseok Seo , Dong-Geol Choi

Satellite-based remote sensing has revolutionised the way we address global challenges. Huge quantities of Earth Observation (EO) data are generated by satellite sensors daily, but processing these large datasets for use in ML pipelines is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Matthew J Allen , Francisco Dorr , Joseph Alejandro Gallego Mejia , Laura Martínez-Ferrer , Anna Jungbluth , Freddie Kalaitzis , Raúl Ramos-Pollán

Foundation models constitute a significant advancement in computer vision: after a single, albeit costly, training phase, they can address a wide array of tasks. In the field of Earth observation, over 75 remote sensing vision foundation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Pierre Adorni , Minh-Tan Pham , Stéphane May , Sébastien Lefèvre

Construction sites are challenging environments for autonomous systems due to their unstructured nature and the presence of dynamic actors, such as workers and machinery. This work presents a comprehensive panoptic scene understanding…

Robotics · Computer Science 2024-10-08 Lorenzo Terenzi , Julian Nubert , Pol Eyschen , Pascal Roth , Simin Fei , Edo Jelavic , Marco Hutter

Earth observation (EO) missions produce petabytes of multispectral imagery, increasingly analyzed using large Geospatial Foundation Models (GeoFMs). Alongside end-to-end adaptation, workflows make growing use of intermediate representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Luis Gilch , Isabelle Wittmann , Maximilian Nitsche , Johannes Jakubik , Arne Ewald , Thomas Brunschwiler

Visual control enables quadrotors to adaptively navigate using real-time sensory data, bridging perception with action. Yet, challenges persist, including generalization across scenarios, maintaining reliability, and ensuring real-time…

Robotics · Computer Science 2024-04-09 Alessandro Saviolo , Pratyaksh Rao , Vivek Radhakrishnan , Jiuhong Xiao , Giuseppe Loianno

We introduce Grounded SAM, which uses Grounding DINO as an open-set object detector to combine with the segment anything model (SAM). This integration enables the detection and segmentation of any regions based on arbitrary text inputs and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Tianhe Ren , Shilong Liu , Ailing Zeng , Jing Lin , Kunchang Li , He Cao , Jiayu Chen , Xinyu Huang , Yukang Chen , Feng Yan , Zhaoyang Zeng , Hao Zhang , Feng Li , Jie Yang , Hongyang Li , Qing Jiang , Lei Zhang

Satellite missions and Earth Observation (EO) systems represent fundamental assets for environmental monitoring and the timely identification of catastrophic events, long-term monitoring of both natural resources and human-made assets, such…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Luca Colomba , Paolo Garza

Earth observation (EO) systems are essential for mapping, catastrophe monitoring, and resource management, but they have trouble processing and sending large amounts of EO data efficiently, especially for specialized applications like…