English
Related papers

Related papers: Falcon: A Remote Sensing Vision-Language Foundatio…

200 papers

Medical foundation models show promise to learn broadly generalizable features from large, diverse datasets. This could be the base for reliable cross-modality generalization and rapid adaptation to new, task-specific goals, with only a few…

We introduce a method to train vision-language models for remote-sensing images without using any textual annotations. Our key insight is to use co-located internet imagery taken on the ground as an intermediary for connecting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Utkarsh Mall , Cheng Perng Phoo , Meilin Kelsey Liu , Carl Vondrick , Bharath Hariharan , Kavita Bala

Vision-Language-Action (VLA) models have recently advanced robotic manipulation by translating natural-language instructions and visual observations into control actions. However, existing VLAs are primarily trained on successful expert…

Robotics · Computer Science 2026-03-24 Zewei Ye , Weifeng Lu , Minghao Ye , Tao Lin , Shuo Yang , Junchi Yan , Bo Zhao

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins

Large AI models have been widely adopted in wireless communications for channel modeling, beamforming, and resource optimization. However, most existing efforts remain limited to single-modality inputs and channel-specific objec- tives,…

Machine Learning · Computer Science 2025-11-18 Zhizhen Li , Xuanhao Luo , Xueren Ge , Longyu Zhou , Xingqin Lin , Yuchen Liu

Much of vision-and-language research focuses on a small but diverse set of independent tasks and supporting datasets often studied in isolation; however, the visually-grounded language understanding skills required for success at these…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Jiasen Lu , Vedanuj Goswami , Marcus Rohrbach , Devi Parikh , Stefan Lee

The intelligent interpretation of buildings plays a significant role in urban planning and management, macroeconomic analysis, population dynamics, etc. Remote sensing image building interpretation primarily encompasses building extraction…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Mingze Wang , Lili Su , Cilin Yan , Sheng Xu , Pengcheng Yuan , Xiaolong Jiang , Baochang Zhang

Remote sensing image change captioning (RSICC) aims to automatically generate sentences that describe content differences in remote sensing bitemporal images. Recently, attention-based transformers have become a prevalent idea for capturing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Dongwei Sun , Yajie Bao , Junmin Liu , Xiangyong Cao

Remote sensing image captioning has advanced rapidly through encoder--decoder models, although the reliance on large annotated datasets and the focus on English restricts global applicability. To address these limitations, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Carlos Rebelo , Gil Rocha , João Daniel Silva , Bruno Martins

Cloud segmentation is a critical challenge in remote sensing image interpretation, as its accuracy directly impacts the effectiveness of subsequent data processing and analysis. Recently, vision foundation models (VFM) have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Xuechao Zou , Shun Zhang , Kai Li , Shiying Wang , Junliang Xing , Lei Jin , Congyan Lang , Pin Tao

Language-conditioned robotic manipulation in open-world settings requires not only accurate task execution but also the ability to detect failures for robust deployment in real-world environments. Although recent advances in vision-language…

Robotics · Computer Science 2026-02-20 Clemence Grislain , Hamed Rahimi , Olivier Sigaud , Mohamed Chetouani

Foundation Models (FMs) are increasingly integrated into remote sensing (RS) pipelines. These models include unimodal vision encoders and multimodal architectures. FMs are adapted to diverse perception tasks, such as image classification,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Binger Chen , Tacettin Emre Bök , Behnood Rasti , Volker Markl , Begüm Demir

The evaluation of object detection models is usually performed by optimizing a single metric, e.g. mAP, on a fixed set of datasets, e.g. Microsoft COCO and Pascal VOC. Due to image retrieval and annotation costs, these datasets consist…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Floriana Ciaglia , Francesco Saverio Zuppichini , Paul Guerrie , Mark McQuade , Jacob Solawetz

Automatic image captioning is a promising technique for conveying visual information using natural language. It can benefit various tasks in satellite remote sensing, such as environmental monitoring, resource management, disaster…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Yingxu He , Qiqi Sun

Effective foundation modeling in remote sensing requires spatially aligned heterogeneous modalities coupled with semantically grounded supervision, yet such resources remain limited at scale. We present GeoMeld, a large-scale multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Maram Hasan , Md Aminur Hossain , Savitra Roy , Souparna Bhowmik , Ayush V. Patel , Mainak Singha , Subhasis Chaudhuri , Muhammad Haris Khan , Biplab Banerjee

An in-depth comprehension of global land cover is essential in Earth observation, forming the foundation for a multitude of applications. Although remote sensing technology has advanced rapidly, leading to a proliferation of satellite…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Zhenghang Yuan , Zhitong Xiong , Lichao Mou , Xiao Xiang Zhu

Generalist models have achieved remarkable success in both language and vision-language tasks, showcasing the potential of unified modeling. However, effectively integrating fine-grained perception tasks like detection and segmentation into…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Hao Tang , Chenwei Xie , Haiyang Wang , Xiaoyi Bao , Tingyu Weng , Pandeng Li , Yun Zheng , Liwei Wang

Foundation models have reshaped the landscape of Remote Sensing (RS) by enhancing various image interpretation tasks. Pretraining is an active research topic, encompassing supervised and self-supervised learning methods to initialize model…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Di Wang , Jing Zhang , Minqiang Xu , Lin Liu , Dongsheng Wang , Erzhong Gao , Chengxi Han , Haonan Guo , Bo Du , Dacheng Tao , Liangpei Zhang

Multi-node communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet-of-Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have…

Machine Learning · Computer Science 2023-08-09 Bingyan Xie , Yongpeng Wu , Yuxuan Shi , Derrick Wing Kwan Ng , Wenjun Zhang

To tackle the prevalence of pseudo changes, the scarcity of labeled samples, and the difficulty of cross-domain generalization in multi-temporal and multi-source remote sensing imagery, we propose PeftCD, a change detection framework built…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Sijun Dong , Yuxuan Hu , LiBo Wang , Geng Chen , Xiaoliang Meng