English
Related papers

Related papers: Pixel-Wise Multimodal Contrastive Learning for Rem…

200 papers

We introduce a highly multimodal transformer to represent many remote sensing modalities - multispectral optical, synthetic aperture radar, elevation, weather, pseudo-labels, and more - across space and time. These inputs are useful for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Gabriel Tseng , Anthony Fuller , Marlena Reil , Henry Herzog , Patrick Beukema , Favyen Bastani , James R. Green , Evan Shelhamer , Hannah Kerner , David Rolnick

The analysis of time-sequence satellite images is a powerful tool in remote sensing; it is used to explore the statics and dynamics of the surface of the earth. Usually, the quality of multitemporal images is influenced by metrological…

Image and Video Processing · Electrical Eng. & Systems 2024-05-01 Hessah Albanwan

A vital and rapidly growing application, remote sensing offers vast yet sparsely labeled, spatially aligned multimodal data; this makes self-supervised learning algorithms invaluable. We present CROMA: a framework that combines contrastive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Anthony Fuller , Koreen Millard , James R. Green

Hyperspectral images (HSI) clustering is an important but challenging task. The state-of-the-art (SOTA) methods usually rely on superpixels, however, they do not fully utilize the spatial and spectral information in HSI 3-D structure, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Jianhan Qi , Yuheng Jia , Hui Liu , Junhui Hou

Physical and budget constraints often result in irregular sampling, which complicates accurate subsurface imaging. Pre-processing approaches, such as missing trace or shot interpolation, are typically employed to enhance seismic data in…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Paul Goyes , Edwin Vargas , Claudia Correa , Yu Sun , Ulugbek Kamilov , Brendt Wohlberg , Henry Arguello

We address the problem of learning self-supervised representations from unlabeled image collections. Unlike existing approaches that attempt to learn useful features by maximizing similarity between augmented versions of each input image or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Omiros Pantazis , Gabriel Brostow , Kate Jones , Oisin Mac Aodha

Visualization methods based on the nearest neighbor graph, such as t-SNE or UMAP, are widely used for visualizing high-dimensional data. Yet, these approaches only produce meaningful results if the nearest neighbors themselves are…

Machine Learning · Computer Science 2024-06-06 Jan Niklas Böhm , Philipp Berens , Dmitry Kobak

Deep superpixel algorithms have made remarkable strides by substituting hand-crafted features with learnable ones. Nevertheless, we observe that existing deep superpixel methods, serving as mid-level representation operations, remain…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Sen Xu , Shikui Wei , Tao Ruan , Lixin Liao

The effective combination of the complementary information provided by the huge amount of unlabeled multi-sensor data (e.g., Synthetic Aperture Radar (SAR) and optical images) is a critical topic in remote sensing. Recently, contrastive…

Image and Video Processing · Electrical Eng. & Systems 2021-10-11 Yuxing Chen , Lorenzo Bruzzone

In this paper, we present a novel deep image clustering approach termed PICI, which enforces the partial information discrimination and the cross-level interaction in a joint learning framework. In particular, we leverage a Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Hai-Xin Zhang , Dong Huang , Hua-Bao Ling , Guang-Yu Zhang , Wei-jun Sun , Zi-hao Wen

Remote sensing is a higher technology to produce knowledge for data mining applications. In principle hyperspectral images (HSIs) is a remote sensing tool that provides precise classification of regions. The HSI contains more than a hundred…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Elkebir Sarhrouni , Ahmed Hammouch , Driss Aboutajdine

Multimodal Language Analysis is a demanding area of research, since it is associated with two requirements: combining different modalities and capturing temporal information. During the last years, several works have been proposed in the…

Computation and Language · Computer Science 2022-01-10 Panagiotis Koromilas , Theodoros Giannakopoulos

Recent advances in skeleton-based person re-identification (re-ID) obtain impressive performance via either hand-crafted skeleton descriptors or skeleton representation learning with deep learning paradigms. However, they typically require…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Haocong Rao , Chunyan Miao

Compressive sensing (CS) reconstructs images from sub-Nyquist measurements by solving a sparsity-regularized inverse problem. Traditional CS solvers use iterative optimizers with hand crafted sparsifiers, while early data-driven methods…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Pamuditha Somarathne , Tharindu Wickremasinghe , Amashi Niwarthana , A. Thieshanthan , Chamira U. S. Edussooriya , Dushan N. Wadduwage

Accurate in-season crop type classification is crucial for the crop production estimation and monitoring of agricultural parcels. However, the complexity of the plant growth patterns and their spatio-temporal variability present significant…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Valentin Barriere , Martin Claverie , Maja Schneider , Guido Lemoine , Raphaël d'Andrimont

Multimodal remote sensing image (MRSI) matching is pivotal for cross-modal fusion, localization, and object detection, but it faces severe challenges due to geometric, radiometric, and viewpoint discrepancies across imaging modalities.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Peihao Wu , Yongxiang Yao , Wenfei Zhang , Dong Wei , Yi Wan , Yansheng Li , Yongjun Zhang

The need to analyze the available large synoptic multi-band surveys drives the development of new data-analysis methods. Photometric redshift estimation is one field of application where such new methods improved the results, substantially.…

Instrumentation and Methods for Astrophysics · Physics 2018-01-31 Antonio D'Isanto , Kai Lars Polsterer

High-performance Multimodal Large Language Models (MLLMs) are heavily dependent on data quality. To advance fine-grained image recognition within MLLMs, we introduce a novel data synthesis method inspired by contrastive learning and image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Qirui Jiao , Daoyuan Chen , Yilun Huang , Bolin Ding , Yaliang Li , Ying Shen

Remote sensing (RS) image-text retrieval faces significant challenges in real-world datasets due to the presence of Pseudo-Matched Pairs (PMPs), semantically mismatched or weakly aligned image-text pairs, which hinder the learning of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Pengxiang Ouyang , Qing Ma , Zheng Wang , Cong Bai

Remote sensing composed image retrieval (RSCIR) enables search in large satellite image archives using composed queries that combine a reference image with a textual modifier. Although RSCIR offers a flexible interface for expressing…