English
Related papers

Related papers: TimeSenCLIP: A Time Series Vision-Language Model f…

200 papers

Geo-temporal understanding, the ability to infer location, time, and contextual properties from visual input alone, underpins applications such as disaster management, traffic planning, embodied navigation, world modeling, and geography…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Azmine Toushik Wasi , Shahriyar Zaman Ridoy , Koushik Ahamed Tonmoy , Kinga Tshering , S. M. Muhtasimul Hasan , Wahid Faisal , Tasnim Mohiuddin , Md Rizwan Parvez

Contrastive Vision-Language Models (VLMs) have demonstrated strong zero-shot capabilities. However, their cross-modal alignment remains biased toward English due to limited multilingual multimodal data. Recent multilingual extensions have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Junwon You , Dasol Kang , Jae-Hun Jung

Vision-language models for Earth observation (EO) typically rely on the visual spectrum of data as the only model input, thus failing to leverage the rich spectral information available in the multispectral channels recorded by satellites.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Clive Tinashe Marimo , Benedikt Blumenstiel , Maximilian Nitsche , Johannes Jakubik , Thomas Brunschwiler

This study presents a control framework leveraging vision language models (VLMs) for multiple tasks and robots. Notably, existing control methods using VLMs have achieved high performance in various tasks and robots in the training…

Robotics · Computer Science 2024-01-19 Kazuki Shibata , Hideki Deguchi , Shun Taguchi

Dense visual perception tasks have been constrained by their reliance on predefined categories, limiting their applicability in real-world scenarios where visual concepts are unbounded. While Vision-Language Models (VLMs) like CLIP have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Junjie Wang , Keyu Chen , Yulin Li , Bin Chen , Hengshuang Zhao , Xiaojuan Qi , Zhuotao Tian

This paper explores training medical vision-language models (VLMs) -- where the visual and language inputs are embedded into a common space -- with a particular focus on scenarios where training data is limited, as is often the case in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Rhydian Windsor , Amir Jamaludin , Timor Kadir , Andrew Zisserman

Remote sensing change detection (RSCD), a complex multi-image inference task, traditionally uses pixel-based operators or encoder-decoder networks that inadequately capture high-level semantics and are vulnerable to non-semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Xingwei Ma , Shiyang Feng , Bo Zhang , Bin Wang

Pixel-level segmentation is essential in remote sensing, where foundational vision models like CLIP and Segment Anything Model(SAM) have demonstrated significant capabilities in zero-shot segmentation tasks. Despite their advances,…

Multimedia · Computer Science 2025-03-12 Xing Zi , Kairui Jin , Xian Tao , Jun Li , Ali Braytee , Rajiv Ratn Shah , Mukesh Prasad

Vision-language models (VLMs) have emerged as powerful tools for enabling automated traffic analysis; however, current approaches often demand substantial computational resources and struggle with fine-grained spatio-temporal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Tinh-Anh Nguyen-Nhu , Triet Dao Hoang Minh , Dat To-Thanh , Phuc Le-Gia , Tuan Vo-Lan , Tien-Huy Nguyen

Remote Sensing Vision-Language Models (RS VLMs) have made much progress in the tasks of remote sensing (RS) image comprehension. While performing well in multi-modal reasoning and multi-turn conversations, the existing models lack…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Xu Liu , Zhouhui Lian

With Transformers achieving outstanding performance on individual remote sensing (RS) tasks, we are now approaching the realization of a unified model that excels across multiple tasks through multi-task learning (MTL). Compared to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Qingyun Li , Shuran Ma , Junwei Luo , Yi Yu , Yue Zhou , Fengxiang Wang , Xudong Lu , Xiaoxing Wang , Xin He , Yushi Chen , Xue Yang

Bi-temporal satellite imagery supports critical applications such as urbanization monitoring and disaster assessment. Although powerful multimodal large language models~(MLLMs) have been applied in bi-temporal change analysis, previous…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yujie Li , Wenjia Xu , Yuanben Zhang , Zhiwei Wei , Mugen Peng

Dense visual prediction tasks have been constrained by their reliance on predefined categories, limiting their applicability in real-world scenarios where visual concepts are unbounded. While Vision-Language Models (VLMs) like CLIP have…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Junjie Wang , Bin Chen , Yulin Li , Bin Kang , Yichi Chen , Zhuotao Tian

Vision language models (VLMs) are designed to extract relevant visuospatial information from images. Some research suggests that VLMs can exhibit humanlike scene understanding, while other investigations reveal difficulties in their ability…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Sangeet Khemlani , Tyler Tran , Nathaniel Gyory , Anthony M. Harrison , Wallace E. Lawson , Ravenna Thielstrom , Hunter Thompson , Taaren Singh , J. Gregory Trafton

Vision-Language Pre-training (VLP) models like CLIP have significantly advanced Remote Sensing Image-Text Retrieval (RSITR). However, existing methods predominantly rely on coarse-grained global alignment, which often overlooks the dense,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yifan Li , Shiying Wang , Jianqiang Huang

Machine learning for remote sensing imaging relies on up-to-date and accurate labels for model training and testing. Labelling remote sensing imagery is time and cost intensive, requiring expert analysis. Previous labelling tools rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Tulsi Patel , Mark W. Jones , Thomas Redfern

Semantic segmentation of remote sensing images plays a vital role in a wide range of Earth Observation applications, such as land use land cover mapping, environment monitoring, and sustainable development. Driven by rapid developments in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Libo Wang , Sijun Dong , Ying Chen , Xiaoliang Meng , Shenghui Fang , Songlin Fei

Remote sensing has evolved from simple image acquisition to complex systems capable of integrating and processing visual and textual data. This review examines the development and application of multi-modal language models (MLLMs) in remote…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Xintian Sun , Benji Peng , Charles Zhang , Fei Jin , Qian Niu , Junyu Liu , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Ming Liu , Xinyuan Song , Yichao Zhang

Vision-language models (VLMs) have demonstrated remarkable capabilities in understanding and reasoning about visual content, but significant challenges persist in tasks requiring cross-viewpoint understanding and spatial reasoning. We…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Dingming Li , Hongxing Li , Zixuan Wang , Yuchen Yan , Hang Zhang , Siqi Chen , Guiyang Hou , Shengpei Jiang , Wenqi Zhang , Yongliang Shen , Weiming Lu , Yueting Zhuang

Recent advances in Vision Language Models (VLMs) and Vision Foundation Models (VFMs) have opened new opportunities for zero-shot text-guided segmentation of remote sensing imagery. However, most existing approaches still rely on additional…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Jose Sosa , Danila Rukhovich , Anis Kacem , Djamila Aouada