English
Related papers

Related papers: Panopticon: Advancing Any-Sensor Foundation Models…

200 papers

Modern Earth Observation (EO) systems increasingly rely on high-resolution imagery to support critical applications such as environmental monitoring, disaster response, and land-use analysis. Although these applications benefit from…

Earth Observation (EO) systems are crucial for cartography, disaster surveillance, and resource administration. Nonetheless, they encounter considerable obstacles in the processing and transmission of extensive data, especially in…

Earth Observation (EO) Foundation Modelling (FM) holds great promise for simplifying and improving the use of EO data for diverse real-world tasks. However, most existing models require additional adaptation before they can be used and are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Samuel J. Barrett , Docko Sow

Despite the significant advancements in general image segmentation achieved by large-scale pre-trained foundation models (such as Meta's Segment Any-thing Model (SAM) series and DINOv2), their performance in specialized fields remains…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yimin Xu , Fan Yang , Bin Xu

We present the Transparent Earth, a transformer-based architecture for reconstructing subsurface properties from heterogeneous datasets that vary in sparsity, resolution, and modality, where each modality represents a distinct type of…

Machine Learning · Computer Science 2025-09-24 Arnab Mazumder , Javier E. Santos , Noah Hobbs , Mohamed Mehana , Daniel O'Malley

Forests are vital to ecosystems, supporting biodiversity and essential services, but are rapidly changing due to land use and climate change. Understanding and mitigating negative effects requires parsing data on forests at global scale…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Nikolaos Ioannis Bountos , Arthur Ouaknine , Ioannis Papoutsis , David Rolnick

We present OmniSpectra, the first native-resolution foundation model for astronomy spectra. Unlike traditional models, which are limited to fixed-length input sizes or configurations, OmniSpectra handles spectra of any length at their…

Instrumentation and Methods for Astrophysics · Physics 2026-01-23 Md Khairul Islam , Judy Fox

We present a multi-modal classification framework that fuses satellite and street-level imagery through a Perceiver IO architecture operating on spatial patch tokens from a shared DINOv2 backbone. The design naturally handles a variable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Niels Sombekke , Rob G. J. Wijnhoven , Martin R. Oswald

Earth observation satellite imaging scheduling is a challenging NP-hard combinatorial optimisation problem central to space mission operations. While next-generation agile Earth observation satellites (EOS) increase operational flexibility,…

Panoptic segmentation combines instance and semantic predictions, allowing the detection of "things" and "stuff" simultaneously. Effectively approaching panoptic segmentation in remotely sensed data can be auspicious in many challenging…

Earth observation (EO) sensors deliver data with daily or weekly temporal resolution. Most land use and land cover (LULC) approaches, however, expect cloud-free and mono-temporal observations. The increasing temporal capabilities of today's…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Marc Rußwurm , Marco Körner

This paper proposes an observer for generating depth maps of a scene from a sequence of measurements acquired by a two-plane light-field (plenoptic) camera. The observer is based on a gradient-descent methodology. The use of motion allows…

Optimization and Control · Mathematics 2018-09-24 Sean G. P. O'Brien , Jochen Trumpf , Viorela Ila , Robert Mahony

With tremendous advancements in low-power embedded computing devices and remote sensing instruments, the traditional satellite image processing pipeline which includes an expensive data transfer step prior to processing data on the ground…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Tharindu Fernando , Clinton Fookes , Harshala Gammulle , Simon Denman , Sridha Sridharan

The objective of this work is to develop an AI foundation model for physical signals that can generalize across diverse phenomena, domains, applications, and sensing apparatuses. We propose a phenomenological approach and framework for…

A significant amount of remotely sensed data is generated daily by many Earth observation (EO) spaceborne and airborne sensors over different countries of our planet. Different applications use those data, such as natural hazard monitoring,…

Image and Video Processing · Electrical Eng. & Systems 2024-10-23 Alessandro Sebastianelli , Francesco Mauro , Giulia Ciabatti , Dario Spiller , Bertrand Le Saux , Paolo Gamba , Silvia Ullo

The rapid advancement of foundation models has revolutionized visual representation learning in a self-supervised manner. However, their application in remote sensing (RS) remains constrained by a fundamental gap: existing models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Hanbo Bi , Yingchao Feng , Boyuan Tong , Mengyu Wang , Haichen Yu , Yongqiang Mao , Hao Chang , Wenhui Diao , Peijin Wang , Yue Yu , Hanyang Peng , Yehong Zhang , Kun Fu , Xian Sun

Earth observation (EO) satellite missions have been providing detailed images about the state of the Earth and its land cover for over 50 years. Long term missions, such as NASA's Landsat, Terra, and Aqua satellites, and more recently, the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-27 Lynn Miller , Charlotte Pelletier , Geoffrey I. Webb

Optical imaging and spectroscopy solutions, such as near-infrared spectroscopy (NIRS) and diffuse optical tomography (DOT), have the potential to provide compact, bedside monitoring of the placenta in the clinic, thanks to recent…

In this work, we present a panoramic metric depth foundation model that generalizes across diverse scene distances. We explore a data-in-the-loop paradigm from the view of both data construction and framework design. We collect a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Xin Lin , Meixi Song , Dizhe Zhang , Wenxuan Lu , Haodong Li , Bo Du , Ming-Hsuan Yang , Truong Nguyen , Lu Qi

Medical foundation models, pre-trained with large-scale clinical data, demonstrate strong performance in diverse clinically relevant applications. RETFound, trained on nearly one million retinal images, exemplifies this approach in…