English
Related papers

Related papers: Vision-Language Models for Infrared Industrial Sen…

200 papers

Pre-trained multi-modal vision-language models (VLMs) are becoming increasingly popular due to their exceptional performance on downstream vision applications, particularly in the few- and zero-shot settings. However, selecting the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Orr Zohar , Shih-Cheng Huang , Kuan-Chieh Wang , Serena Yeung

Remote sensing has become a vital tool across sectors such as urban planning, environmental monitoring, and disaster response. While the volume of data generated has increased significantly, traditional vision models are often constrained…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Jia Yun Chua , Argyrios Zolotas , Miguel Arana-Catania

Vision-language models (VLMs) such as CLIP have shown promising performance on a variety of recognition tasks using the standard zero-shot classification procedure -- computing similarity between the query image and the embedded words for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Sachit Menon , Carl Vondrick

The fusion of vision and language has brought about a transformative shift in computer vision through the emergence of Vision-Language Models (VLMs). However, the resource-intensive nature of existing VLMs poses a significant challenge. We…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Jordan Shipard , Arnold Wiliem , Kien Nguyen Thanh , Wei Xiang , Clinton Fookes

Recent research is trying to leverage occupants' demand in the building's control loop to consider individuals' well-being and the buildings' energy savings. To that end, a real-time feedback system is needed to provide data about…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Roshanak Ashrafi , Mona Azarbayjani , Hamed Tabkhi

While recent vision-and-language models (VLMs) like CLIP are a powerful tool for analyzing text and images in a shared semantic space, they do not explicitly model the hierarchical nature of the set of texts which may describe an image.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Morris Alper , Hadar Averbuch-Elor

Vision-Language models (VLMs) that use contrastive language-image pre-training have shown promising zero-shot classification performance. However, their performance on imbalanced dataset is relatively poor, where the distribution of classes…

Artificial Intelligence · Computer Science 2023-06-22 Yidong Wang , Zhuohao Yu , Jindong Wang , Qiang Heng , Hao Chen , Wei Ye , Rui Xie , Xing Xie , Shikun Zhang

The contemporary phenomenon of deepfakes, utilizing GAN or diffusion models for face swapping, presents a substantial and evolving threat in digital media, identity verification, and a multitude of other systems. The majority of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Viacheslav Pirogov

Multimodal fusion of remote sensing images serves as a core technology for overcoming the limitations of single-source data and improving the accuracy of surface information extraction, which exhibits significant application value in fields…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Siyu Zhang , Lianlei Shan , Runhe Qiu

Large-scale visual-language pre-trained models (VLPM) have proven their excellent performance in downstream object detection for natural scenes. However, zero-shot nuclei detection on H\&E images via VLPMs remains underexplored. The large…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Yongjian Wu , Yang Zhou , Jiya Saiyin , Bingzheng Wei , Maode Lai , Jianzhong Shou , Yubo Fan , Yan Xu

Vision-Language Models (VLMs) have demonstrated great potential in interpreting remote sensing (RS) images through language-guided semantic. However, the effectiveness of these VLMs critically depends on high-quality image-text training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Dilxat Muhtar , Enzhuo Zhang , Zhenshi Li , Feng Gu , Yanglangxing He , Pengfeng Xiao , Xueliang Zhang

Situational awareness applications rely heavily on real-time processing of visual and textual data to provide actionable insights. Vision language models (VLMs) have become essential tools for interpreting complex environments by connecting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Md Azim Khan , Aryya Gangopadhyay , Jianwu Wang , Robert F. Erbacher

The success of machine learning models in industrial applications is heavily dependent on the quality of the datasets used to train the models. However, large-scale datasets, specially those constructed from crowd-sourcing and web-scraping,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Nazanin Mahjourian , Vinh Nguyen

Traditional supervised methods for detecting AI-generated images depend on large, curated datasets for training and fail to generalize to novel, out-of-domain image generators. As an alternative, we explore pre-trained Vision-Language…

Machine Learning · Computer Science 2026-01-27 Zoher Kachwala , Danishjeet Singh , Danielle Yang , Filippo Menczer

The growing demand for surveillance in public spaces presents significant challenges due to the shortage of human resources. Current AI-based video surveillance systems heavily rely on core computer vision models that require extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Joao Pereira , Vasco Lopes , David Semedo , Joao Neves

Medical image segmentation has achieved remarkable success through the continuous advancement of UNet-based and Transformer-based foundation backbones. However, clinical diagnosis in the real world often requires integrating domain…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Siyuan Dai , Kai Ye , Guodong Liu , Haoteng Tang , Liang Zhan

Zero-shot scene understanding in real-world settings presents major challenges due to the complexity and variability of natural scenes, where models must recognize new objects, actions, and contexts without prior labeled examples. This work…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Manjunath Prasad Holenarasipura Rajiv , B. M. Vidyavathi

Vision-language models (VLMs) excel at descriptive tasks, but whether they truly understand scenes from visual observations remains uncertain. We introduce IR3D-Bench, a benchmark challenging VLMs to demonstrate understanding through active…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Parker Liu , Chenxin Li , Zhengxin Li , Yipeng Wu , Wuyang Li , Zhiqin Yang , Zhenyuan Zhang , Yunlong Lin , Sirui Han , Brandon Y. Feng

Terahertz (THz) imaging enables non-invasive analysis for applications such as security screening and material classification, but effective image classification remains challenging due to limited annotations, low resolution, and visual…

Computation and Language · Computer Science 2025-07-22 Nicolas Poggi , Shashank Agnihotri , Margret Keuper

Natural and efficient interaction remains a critical challenge for virtual reality and augmented reality (VR/AR) systems. Vision-based gesture recognition suffers from high computational cost, sensitivity to lighting conditions, and privacy…

Human-Computer Interaction · Computer Science 2025-11-11 Xijie Zhang , Fengliang He , Hong-Ning Dai