English
Related papers

Related papers: Zero-Shot Satellite Image Retrieval through Joint …

200 papers

Passage retrieval addresses the problem of locating relevant passages, usually from a large corpus, given a query. In practice, lexical term-matching algorithms like BM25 are popular choices for retrieval owing to their efficiency. However,…

Information Retrieval · Computer Science 2020-09-23 Davis Liang , Peng Xu , Siamak Shakeri , Cicero Nogueira dos Santos , Ramesh Nallapati , Zhiheng Huang , Bing Xiang

In this work we pretrain a CLIP/ViT based model using three different modalities of satellite imagery across five AOIs covering over ~10\% of Earth's total landmass, namely Sentinel 2 RGB optical imagery, Sentinel 1 SAR radar amplitude and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Matt Allen , Francisco Dorr , Joseph A. Gallego-Mejia , Laura Martínez-Ferrer , Anna Jungbluth , Freddie Kalaitzis , Raúl Ramos-Pollán

The problem of organizing and finding images in a user's directory has become increasingly challenging due to the rapid growth in the number of images captured on personal devices. This paper presents a solution that utilizes zero shot…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jatin Nainani , Abhishek Mazumdar , Viraj Sheth

Visual question answering (VQA) is a fundamental and essential AI task, and VQA-based disaster scenario understanding is a hot research topic. For instance, we can ask questions about a disaster image by the VQA model and the answer can…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yimin Sun , Chao Wang , Yan Peng

We study the zero-shot Composed Image Retrieval (ZS-CIR) task, which is to retrieve the target image given a reference image and a description without training on the triplet datasets. Previous works generate pseudo-word tokens by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yucheng Suo , Fan Ma , Linchao Zhu , Yi Yang

Zero-shot referring expression comprehension aims at localizing bounding boxes in an image corresponding to provided textual prompts, which requires: (i) a fine-grained disentanglement of complex visual scene and textual context, and (ii) a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zeyu Han , Fangrui Zhu , Qianru Lao , Huaizu Jiang

State-of-the-art supervised stereo matching methods have achieved remarkable performance on various benchmarks. However, their generalization to real-world scenarios remains challenging due to the scarcity of annotated real-world stereo…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Xianqi Wang , Hao Yang , Gangwei Xu , Junda Cheng , Min Lin , Yong Deng , Jinliang Zang , Yurui Chen , Xin Yang

Generalizable object fetching in cluttered scenes remains a fundamental and application-critical challenge in embodied AI. Closely packed objects cause inevitable occlusions, making safe action generation particularly difficult. Under such…

The integration of geometric reconstruction and generative modeling remains a critical challenge in developing AI systems capable of human-like spatial reasoning. This paper proposes Aether, a unified framework that enables geometry-aware…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Aether Team , Haoyi Zhu , Yifan Wang , Jianjun Zhou , Wenzheng Chang , Yang Zhou , Zizun Li , Junyi Chen , Chunhua Shen , Jiangmiao Pang , Tong He

We explore the task of geometric reconstruction of images captured from a mixture of ground and aerial views. Current state-of-the-art learning-based approaches fail to handle the extreme viewpoint variation between aerial-ground image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Khiem Vuong , Anurag Ghosh , Deva Ramanan , Srinivasa Narasimhan , Shubham Tulsiani

This report presents a solution for the zero-shot referring expression comprehension task. Visual-language multimodal base models (such as CLIP, SAM) have gained significant attention in recent years as a cornerstone of mainstream research.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Longfei Huang , Feng Yu , Zhihao Guan , Zhonghua Wan , Yang Yang

Image retrieval enables an efficient search through vast amounts of satellite imagery and returns similar images to a query. Deep learning models can identify images across various semantic concepts without the need for annotations. This…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Benedikt Blumenstiel , Viktoria Moor , Romeo Kienzler , Thomas Brunschwiler

State-of-the-art 3D point cloud registration methods rely on labeled 3D datasets for training, which limits their practical applications in real-world scenarios and often hinders generalization to unseen scenes. Leveraging the zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Weijie Wang , Wenqi Ren , Guofeng Mei , Bin Ren , Xiaoshui Huang , Fabio Poiesi , Nicu Sebe , Bruno Lepri

Remote sensing composed image retrieval (RSCIR) enables search in large satellite image archives using composed queries that combine a reference image with a textual modifier. Although RSCIR offers a flexible interface for expressing…

Leveraging class semantic descriptions and examples of known objects, zero-shot learning makes it possible to train a recognition model for an object class whose examples are not available. In this paper, we propose a novel zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Soravit Changpinyo , Wei-Lun Chao , Fei Sha

Living in a changing climate, human society now faces more frequent and severe natural disasters than ever before. As a consequence, rapid disaster response during the "Golden 72 Hours" of search and rescue becomes a vital humanitarian…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Hao Li , Liwei Zou , Wenping Yin , Gulsen Taskin , Naoto Yokoya , Danfeng Hong , Wufan Zhao

While dense retrieval has been shown effective and efficient across tasks and languages, it remains difficult to create effective fully zero-shot dense retrieval systems when no relevance label is available. In this paper, we recognize the…

Information Retrieval · Computer Science 2022-12-21 Luyu Gao , Xueguang Ma , Jimmy Lin , Jamie Callan

Worldwide image geolocalization, which aims to predict the GPS coordinates of any image on Earth, remains challenging due to global visual diversity. Recent generative approaches based on Retrieval-Augmented Generation (RAG) and Large…

Information Retrieval · Computer Science 2026-04-29 Tung-Duong Le-Duc , Hoang-Quoc Nguyen-Son , Minh-Son Dao

Accurate surround-view depth estimation provides a competitive alternative to laser-based sensors and is essential for 3D scene understanding in autonomous driving. While empirical studies have proposed various approaches that primarily…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Weimin Liu , Wenjun Wang , Joshua H. Meng

Reference-driven image completion, which restores missing regions in a target view using additional images, is particularly challenging when the target view differs significantly from the references. Existing generative methods rely solely…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Beibei Lin , Tingting Chen , Robby T. Tan