English
Related papers

Related papers: Vision-Language Modeling Meets Remote Sensing: Mod…

200 papers

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins

Large Vision-Language Models (LVLMs) offer remarkable benefits for a variety of vision-language tasks. However, a challenge hindering their application in real-world scenarios, particularly regarding safety, robustness, and reliability, is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jiaying Lu , Jinmeng Rao , Kezhen Chen , Xiaoyuan Guo , Yawen Zhang , Baochen Sun , Carl Yang , Jie Yang

In recent years, multimodal large language models (MLLMs) have shown remarkable capabilities in tasks like visual question answering and common sense reasoning, while visual perception models have made significant strides in perception…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Guanqun Wang , Xinyu Wei , Jiaming Liu , Ray Zhang , Yichi Zhang , Kevin Zhang , Maurice Chong , Shanghang Zhang

Learning generalizable reward functions is a core challenge in embodied intelligence. Recent work leverages contrastive vision language models (VLMs) to obtain dense, domain-agnostic rewards without human supervision. These methods adapt…

Machine Learning · Computer Science 2025-12-25 Simon Roy , Samuel Barbeau , Giovanni Beltrame , Christian Desrosiers , Nicolas Thome

Vision-language models (VLMs) have shown strong performance on static visual understanding, yet they still struggle with dynamic spatial reasoning that requires imagining how scenes evolve under egocentric motion. Recent efforts address…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Wanyue Zhang , Wenxiang Wu , Wang Xu , Jiaxin Luo , Helu Zhi , Yibin Huang , Shuo Ren , Zitao Liu , Jiajun Zhang

Recent advancements in Natural Language Processing (NLP), particularly in Large Language Models (LLMs), associated with deep learning-based computer vision techniques, have shown substantial potential for automating a variety of tasks. One…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Lucas Prado Osco , Eduardo Lopes de Lemos , Wesley Nunes Gonçalves , Ana Paula Marques Ramos , José Marcato Junior

Language provides a natural interface to specify and evaluate performance on visual tasks. To realize this possibility, vision language models (VLMs) must successfully integrate visual and linguistic information. Our work compares VLMs to a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Stephanie Fu , Tyler Bonnen , Devin Guillory , Trevor Darrell

This paper presents novel benchmarks for evaluating vision-language models (VLMs) in zero-shot recognition, focusing on granularity and specificity. Although VLMs excel in tasks like image captioning, they face challenges in open-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhenlin Xu , Yi Zhu , Tiffany Deng , Abhay Mittal , Yanbei Chen , Manchen Wang , Paolo Favaro , Joseph Tighe , Davide Modolo

Vision-language models (VLMs) have advanced rapidly, but their ability to capture spatial relationships remains a blindspot. Current VLMs are typically built with contrastive language-image pretraining (CLIP) style image encoders. The…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Nahid Alam , Leema Krishna Murali , Siddhant Bharadwaj , Patrick Liu , Timothy Chung , Drishti Sharma , Akshata A , Kranthi Kiran , Wesley Tam , Bala Krishna S Vegesna

Vision-Language Models (VLMs) excel at high-level scene understanding but falter on fine-grained perception tasks requiring precise localization. This failure stems from a fundamental mismatch, as generating exact numerical coordinates is a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Peng Liu , Haozhan Shen , Chunxin Fang , Zhicheng Sun , Jiajia Liao , Tiancheng Zhao

This review provides a systematic analysis of comprehensive survey of 3D object detection with vision-language models(VLMs) , a rapidly advancing area at the intersection of 3D vision and multimodal AI. By examining over 100 research…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Ranjan Sapkota , Konstantinos I Roumeliotis , Rahul Harsha Cheppally , Marco Flores Calero , Manoj Karkee

Multimodal fusion of remote sensing images serves as a core technology for overcoming the limitations of single-source data and improving the accuracy of surface information extraction, which exhibits significant application value in fields…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Siyu Zhang , Lianlei Shan , Runhe Qiu

Vision-language models (VLMs) have gained widespread adoption in both industry and academia. In this study, we propose a unified framework for systematically evaluating gender, race, and age biases in VLMs with respect to professions. Our…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Ashutosh Sathe , Prachi Jain , Sunayana Sitaram

A visual-language model (VLM) pre-trained on natural images and text pairs poses a significant barrier when applied to medical contexts due to domain shift. Yet, adapting or fine-tuning these VLMs for medical use presents considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Aisha Urooj Khan , John Garrett , Tyler Bradshaw , Lonie Salkowski , Jiwoong Jason Jeong , Amara Tariq , Imon Banerjee

The domain gap between remote sensing imagery and natural images has recently received widespread attention and Vision-Language Models (VLMs) have demonstrated excellent generalization performance in remote sensing multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yujie Li , Wenjia Xu , Guangzuo Li , Zijian Yu , Zhiwei Wei , Jiuniu Wang , Mugen Peng

Vision language models (VLMs) can flexibly address various vision tasks through text interactions. Although successful in semantic understanding, state-of-the-art VLMs including GPT-5 still struggle in understanding 3D from 2D inputs. On…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zhipeng Cai , Ching-Feng Yeh , Hu Xu , Zhuang Liu , Gregory Meyer , Xinjie Lei , Changsheng Zhao , Shang-Wen Li , Vikas Chandra , Yangyang Shi

Pre-trained Vision-Language Models (VLMs) are becoming increasingly popular across various visual tasks, and several open-sourced VLM variants have been released. However, selecting the best-performing pre-trained VLM for a specific…

Machine Learning · Computer Science 2025-05-08 Hao-Zhe Tan , Zhi Zhou , Yu-Feng Li , Lan-Zhe Guo

Vision-language models (VLMs) have enabled strong zero-shot classification through image-text alignment. Yet, their purely visual inference capabilities remain under-explored. In this work, we conduct a comprehensive evaluation of both…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Illia Volkov , Nikita Kisel , Klara Janouskova , Jiri Matas

Visual-language models (VLM) have emerged as a powerful tool for learning a unified embedding space for vision and language. Inspired by large language models, which have demonstrated strong reasoning and multi-task capabilities, visual…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yifan Li , Zhixin Lai , Wentao Bao , Zhen Tan , Anh Dao , Kewei Sui , Jiayi Shen , Dong Liu , Huan Liu , Yu Kong

Accurately predicting human behaviors is crucial for mobile robots operating in human-populated environments. While prior research primarily focuses on predicting actions in single-human scenarios from an egocentric view, several robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Utsav Panchal , Yuchen Liu , Luigi Palmieri , Ilche Georgievski , Marco Aiello
‹ Prev 1 4 5 6 7 8 10 Next ›