English
Related papers

Related papers: Pixel-Wise Multimodal Contrastive Learning for Rem…

200 papers

Subspace clustering is a powerful unsupervised approach for hyperspectral image (HSI) analysis, but its high computational and memory costs limit scalability. Superpixel segmentation can improve efficiency by reducing the number of data…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xianlu Li , Nicolas Nadisic , Shaoguang Huang , Aleksandra Pizurica

Existing multi-view image compression methods often rely on 2D projection-based similarities between views to estimate disparities. While effective for small disparities, such as those in stereo images, these methods struggle with the more…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yujun Huang , Bin Chen , Niu Lian , Baoyi An , Shu-Tao Xia

High-dimensional and complex spectral structures make the clustering of hyperspectral images (HSI) a challenging task. Subspace clustering is an effective approach for addressing this problem. However, current subspace clustering algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Renxiang Guan , Zihao Li , Xianju Li , Chang Tang , Ruyi Feng

Large-scale multi-modal contrastive learning frameworks like CLIP typically require a large amount of image-text samples for training. However, these samples are always collected continuously in real scenarios. This paper discusses the…

Machine Learning · Computer Science 2023-06-02 Zixuan Ni , Longhui Wei , Siliang Tang , Yueting Zhuang , Qi Tian

Satellite image time series (SITS) provide continuous observations of the Earth's surface, making them essential for applications such as environmental management and disaster assessment. However, existing spatiotemporal foundation models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Xiaolei Qin , Di Wang , Jing Zhang , Fengxiang Wang , Xin Su , Bo Du , Liangpei Zhang

Cutting-edge connected vehicle (CV) technologies have drawn much attention in recent years. The real-time traffic data captured by a CV can be shared with other CVs and data centers so as to open new possibilities for solving diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Shaocheng Jia , Wei Yao

In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes. However, its…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Vladan Stojnić , Vladimir Risojević

Multi-Image Super-Resolution (MISR) is a crucial yet challenging research task in the remote sensing community. In this paper, we address the challenging task of Multi-Image Super-Resolution in Remote Sensing (MISR-RS), aiming to generate a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Zhihui Zhang , Jinhui Pang , Jianan Li , Xiaoshuai Hao

Hyperspectral image (HSI) clustering is gaining considerable attention owing to recent methods that overcome the inefficiency and misleading results from the absence of supervised information. Contrastive learning methods excel at existing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Renxiang Guan , Zihao Li , Xianju Li , Chang Tang

Multimodal time series forecasting is foundational in various fields, such as utilizing satellite imagery and numerical data for predicting typhoons in climate science. However, existing multimodal approaches primarily focus on utilizing…

Machine Learning · Computer Science 2025-06-19 Haobo Li , Eunseo Jung , Zixin Chen , Zhaowei Wang , Yueya Wang , Huamin Qu , Alexis Kai Hon Lau

Speckle-based phase-contrast X-ray imaging (SB-PCXI) can reconstruct high-resolution images of weakly-attenuating materials that would otherwise be indistinguishable in conventional attenuation-based imaging. The experimental setup of…

Medical Physics · Physics 2023-07-31 Samantha J. Alloo , Kaye S. Morgan , David M. Paganin , Konstantin M. Pavlov

Self-supervised contrastive learning (SSCL) has achieved significant milestones in remote sensing image (RSI) understanding. Its essence lies in designing an unsupervised instance discrimination pretext task to extract image features from a…

Machine Learning · Computer Science 2023-11-29 Zhaoyang Zhang , Zhen Ren , Chao Tao , Yunsheng Zhang , Chengli Peng , Haifeng Li

Guided depth super-resolution (GDSR) has demonstrated impressive performance across a wide range of domains, with numerous methods being proposed. However, existing methods often treat depth maps as images, where shading values are computed…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jiahui Kang , Qing Cai , Runqing Tan , Yimei Liu , Zhi Liu

This report introduces PixelBytes Embedding, a novel approach for unified multimodal representation learning. Our method captures diverse inputs in a single, cohesive representation, enabling emergent properties for multimodal sequence…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Fabien Furfaro

Single-pixel imaging (SPI) exhibits cost-effectiveness, broad spectrum, and stable sub-Nyquist sampling reconstruction, enabling applications across diverse imaging fields.However, due to the inherent reconstruction mechanism, SPI is not…

Optics · Physics 2025-04-18 Shao Chongwu , Cao Yue , Zhao Qing , Yao Xuri

Multi-view representation learning aims to capture comprehensive information from multiple views of a shared context. Recent works intuitively apply contrastive learning to different views in a pairwise manner, which is still scalable:…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Jiangmeng Li , Hang Gao , Wenwen Qiang , Changwen Zheng

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins

Remote sensing image interpretation plays a critical role in environmental monitoring, urban planning, and disaster assessment. However, acquiring high-quality labeled data is often costly and time-consuming. To address this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tong Wang , Guanzhou Chen , Xiaodong Zhang , Chenxi Liu , Jiaqi Wang , Xiaoliang Tan , Wenchao Guo , Qingyuan Yang , Kaiqi Zhang

Self-supervised representation learning techniques utilize large datasets without semantic annotations to learn meaningful, universal features that can be conveniently transferred to solve a wide variety of downstream supervised tasks. In…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Swetava Ganguli , C. V. Krishnakumar Iyer , Vipul Pandey

It is practical to assume that an individual view is unlikely to be sufficient for effective multi-view learning. Therefore, integration of multi-view information is both valuable and necessary. In this paper, we propose the Multi-view…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Chang Xu , Dacheng Tao , Chao Xu