English
Related papers

Related papers: Pixel-Wise Multimodal Contrastive Learning for Rem…

200 papers

Using images acquired by different satellite sensors has shown to improve classification performance in the framework of crop mapping from satellite image time series (SITS). Existing state-of-the-art architectures use self-attention…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Theresa Follath , David Mickisch , Jan Hemmerling , Stefan Erasmi , Marcel Schwieder , Begüm Demir

Satellite Image Time Series (SITS) of the Earth's surface provide detailed land cover maps, with their quality in the spatial and temporal dimensions consistently improving. These image time series are integral for developing systems that…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 James Brock , Zahraa S. Abdallah

Nowadays, modern Earth Observation systems continuously generate huge amounts of data. A notable example is represented by the Sentinel-2 mission, which provides images at high spatial resolution (up to 10m) with high temporal revisit…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Roberto Interdonato , Dino Ienco , Raffaele Gaetano , Kenji Ose

Earth observation (EO) satellite missions have been providing detailed images about the state of the Earth and its land cover for over 50 years. Long term missions, such as NASA's Landsat, Terra, and Aqua satellites, and more recently, the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-27 Lynn Miller , Charlotte Pelletier , Geoffrey I. Webb

Representation learning constitutes a pivotal cornerstone in contemporary deep learning paradigms, offering a conduit to elucidate distinctive features within the latent space and interpret the deep models. Nevertheless, the inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Siyuan Dai , Kai Ye , Kun Zhao , Ge Cui , Haoteng Tang , Liang Zhan

We pilot a family of stable contrastive losses for learning pixel-level representations that jointly capture semantic and geometric information. Our approach maps each pixel of an image to an overcomplete descriptor that is both…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Leonid Pogorelyuk , Niels Bracher , Aaron Verkleeren , Lars Kühmichel , Stefan T. Radev

Recent self-supervised learning (SSL) methods have demonstrated impressive results in learning visual representations from unlabeled remote sensing images. However, most remote sensing images predominantly consist of scenographic scenes…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Kaixuan Lu , Ruiqian Zhang , Xiao Huang , Yuxing Xie , Xiaogang Ning , Hanchao Zhang , Mengke Yuan , Pan Zhang , Tao Wang , Tongkui Liao

European satellite missions Sentinel-1 (S1) and Sentinel-2 (S2) provide at highspatial resolution and high revisit time, respectively, radar and optical imagesthat support a wide range of Earth surface monitoring tasks such as LandUse/Land…

We develop an approach to learning visual representations that embraces multimodal data, driven by a combination of intra- and inter-modal similarity preservation objectives. Unlike existing visual pre-training methods, which solve a proxy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , Yilin Wang , Michael Maire , Ajinkya Kale , Baldo Faieta

Image retrieval enables an efficient search through vast amounts of satellite imagery and returns similar images to a query. Deep learning models can identify images across various semantic concepts without the need for annotations. This…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Benedikt Blumenstiel , Viktoria Moor , Romeo Kienzler , Thomas Brunschwiler

Photometric redshift estimation plays a crucial role in modern cosmological surveys for studying the universe's large-scale structures and the evolution of galaxies. Deep learning has emerged as a powerful method to produce accurate…

Cosmology and Nongalactic Astrophysics · Physics 2023-10-04 R. Ait-Ouahmed , S. Arnouts , J. Pasquet , M. Treyer , E. Bertin

We present a simple but effective pixel-level self-supervised distillation framework friendly to dense prediction tasks. Our method, called Pixel-Wise Contrastive Distillation (PCD), distills knowledge by attracting the corresponding pixels…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Junqiang Huang , Zichao Guo

In visual Reinforcement Learning (RL), learning from pixel-based observations poses significant challenges on sample efficiency, primarily due to the complexity of extracting informative state representations from high-dimensional data.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Jiarui Sun , M. Ugur Akcal , Wei Zhang , Girish Chowdhary

This report presents PixelBytes, an approach for unified multimodal representation learning. Drawing inspiration from sequence models like Image Transformers, PixelCNN, and Mamba-Bytes, we explore integrating text, audio, action-state, and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Fabien Furfaro

Self-supervised representation learning based on Contrastive Learning (CL) has been the subject of much attention in recent years. This is due to the excellent results obtained on a variety of subsequent tasks (in particular…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Ahmed Ben Saad , Kristina Prokopetc , Josselin Kherroubi , Axel Davy , Adrien Courtois , Gabriele Facciolo

Referring Remote Sensing Image Segmentation (RRSIS) is critical for ecological monitoring, urban planning, and disaster management, requiring precise segmentation of objects in remote sensing imagery guided by textual descriptions. This…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Tianxiang Zhang , Zhaokun Wen , Bo Kong , Kecheng Liu , Yisi Zhang , Peixian Zhuang , Jiangyun Li

Seismic imaging is the numerical process of creating a volumetric representation of the subsurface geological structures from elastic waves recorded at the surface of the Earth. As such, it is widely utilized in the energy and construction…

Geophysics · Physics 2024-11-05 Juan Romero , Wolfgang Heidrich , Nick Luiken , Matteo Ravasi

Optical and radar satellite time series are synergetic: optical images contain rich spectral information, while C-band radar captures useful geometrical information and is immune to cloud cover. Motivated by the recent success of temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Vivien Sainte Fare Garnot , Loic Landrieu , Nesrine Chehata

Hyperspectral imaging (HSI) captures detailed spectral signatures across hundreds of contiguous bands per pixel, being indispensable for remote sensing applications such as land-cover classification, change detection, and environmental…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Hugo Carlesso , Josiane Mothe , Radu Tudor Ionescu

Multispectral imaging (MSI) plays a critical role in material classification, environmental monitoring, and remote sensing. However, MSI sensors typically have wavelength-dependent resolution, which limits downstream analysis. MSI…

Image and Video Processing · Electrical Eng. & Systems 2026-03-10 Haley Duba-Sullivan , Emma J. Reid , Sophie Voisin , Charles A. Bouman , Gregery T. Buzzard