English
Related papers

Related papers: Panopticon: Advancing Any-Sensor Foundation Models…

200 papers

Recent studies have highlighted the potential of adapting the Segment Anything Model (SAM) for various downstream tasks. However, constructing a more powerful and generalizable encoder to further enhance performance remains an open…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Xinyu Xiong , Zihuang Wu , Lei Zhang , Lei Lu , Ming Li , Guanbin Li

Current state-of-the-art methods for panoptic segmentation require an immense amount of annotated training data that is both arduous and expensive to obtain posing a significant challenge for their widespread adoption. Concurrently, recent…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Markus Käppeler , Kürsat Petek , Niclas Vödisch , Wolfram Burgard , Abhinav Valada

The growing availability of Earth Observation (EO) data and recent advances in Computer Vision have driven rapid progress in machine learning for EO, producing domain-specific models at ever-increasing scales. Yet this progress risks…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Tasos Papazafeiropoulos , Nikolaos Ioannis Bountos , Nikolas Papadopoulos , Ioannis Papoutsis

The integration of deep learning systems into healthcare has been hindered by the resource-intensive process of data annotation and the inability of these systems to generalize to different data distributions. Foundation models, which are…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mohammed Baharoon , Waseem Qureshi , Jiahong Ouyang , Yanwu Xu , Abdulrhman Aljouie , Wei Peng

Despite the unprecedented volume of multimodal data provided by modern Earth observation systems, our ability to model atmospheric dynamics remains constrained. Traditional modeling frameworks force heterogeneous measurements into…

To prepare for the analyses of the future PLATO light curves, we develop a deep learning model, Panopticon, to detect transits in high precision photometric light curves. Since PLATO's main objective is the detection of temperate Earth-size…

Earth and Planetary Astrophysics · Physics 2025-02-26 H. G. Vivien , M. Deleuil , N. Jannsen , J. De Ridder , D. Seynaeve , M. -A. Carpine , Y. Zerah

Foundation models have the potential to transform the landscape of remote sensing (RS) data analysis by enabling large computer vision models to be pre-trained on vast amounts of remote sensing data. These models can then be fine-tuned with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Caleb S. Spradlin , Jordan A. Caraballo-Vega , Jian Li , Mark L. Carroll , Jie Gong , Paul M. Montesano

The immense volume of data generated by Earth observation (EO) satellites presents significant challenges in transmitting it to Earth over rate-limited satellite-to-ground communication links. This paper presents an efficient downlink…

Signal Processing · Electrical Eng. & Systems 2024-12-17 Van-Phuc Bui , Shashi Raj Pandey , Israel Leyva-Mayorga , Petar Popovski

Foundation models pre-trained using self-supervised learning have shown powerful transfer learning capabilities on various downstream tasks, including language understanding, text generation, and image recognition. The Earth observation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Yi-Chia Chang , Adam J. Stewart , Favyen Bastani , Piper Wolters , Shreya Kannan , George R. Huber , Jingtong Wang , Arindam Banerjee

Pansharpening generates the high-resolution multi-spectral (MS) image by integrating spatial details from a texture-rich panchromatic (PAN) image and spectral attributes from a low-resolution MS image. Existing methods are predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Hebaixu Wang , Jing Zhang , Haonan Guo , Di Wang , Jiayi Ma , Bo Du , Liangpei Zhang

Earth observation (EO), aiming at monitoring the state of planet Earth using remote sensing data, is critical for improving our daily lives and living environment. With a growing number of satellites in orbit, an increasing number of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Zhitong Xiong , Fahong Zhang , Yi Wang , Yilei Shi , Xiao Xiang Zhu

Foundation models have garnered increasing attention for representation learning in remote sensing. Many such foundation models adopt approaches that have demonstrated success in computer vision with minimal domain-specific modification.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Kevin Lane , Morteza Karimzadeh

3D object detection with omnidirectional views enables safety-critical applications such as mobile robot navigation. Such applications increasingly operate on resource-constrained edge devices, facilitating reliable processing without…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Jeho Lee , Chanyoung Jung , Jiwon Kim , Hojung Cha

The increasing frequency and severity of climate related disasters have intensified the need for real time monitoring, early warning, and informed decision-making. Earth Observation (EO), powered by satellite data and Machine Learning (ML),…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Stella Girtsou , Konstantinos Alexis , Giorgos Giannopoulos , Charalambos Kontoes

We introduce NeuCo-Bench, a novel benchmark framework for evaluating (lossy) neural compression and representation learning in the context of Earth Observation (EO). Our approach builds on fixed-size embeddings that act as compact,…

We propose PyViT-FUSE, a foundation model for earth observation data explicitly designed to handle multi-modal imagery by learning to fuse an arbitrary number of mixed-resolution input bands into a single representation through an attention…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Manuel Weber , Carly Beneke

Earth observation (EO) foundation models (FMs) are increasingly trained on multisensor data, spanning multispectral imagery (MSI), synthetic aperture radar (SAR), and derived geospatial layers, but hyperspectral imagery (HSI) remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Nassim Ait Ali Braham , Aaron Banze , Conrad M. Albrecht , Julien Mairal , Jocelyn Chanussot , Xiao Xiang Zhu

Foundation models offer a promising route to transferable remote sensing representations, but many current approaches depend on very large pretraining datasets and fixed sensor configurations, limiting their suitability for ecological and…

We introduce EarthPT -- an Earth Observation (EO) pretrained transformer. EarthPT is a 700 million parameter decoding transformer foundation model trained in an autoregressive self-supervised manner and developed specifically with EO…

Machine Learning · Computer Science 2024-01-12 Michael J. Smith , Luke Fleming , James E. Geach

We present DINO Patch Visual Odometry (DINO-VO), an end-to-end monocular visual odometry system with strong scene generalization. Current Visual Odometry (VO) systems often rely on heuristic feature extraction strategies, which can degrade…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Qi Chen , Guanghao Li , Sijia Hu , Xin Gao , Junpeng Ma , Xiangyang Xue , Jian Pu