English
Related papers

Related papers: Spectrally Distilled Representations Aligned with …

200 papers

Learning versatile, fine-grained representations from irregular event streams is pivotal yet nontrivial, primarily due to the heavy annotation that hinders scalability in dataset size, semantic richness, and application scope. To mitigate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Zhiwen Chen , Junhui Hou , Zhiyu Zhu , Jinjian Wu , Guangming Shi

3D vision-language grounding faces a fundamental data bottleneck: while 2D models train on billions of images, 3D models have access to only thousands of labeled scenes--a six-order-of-magnitude gap that severely limits performance. We…

Vision-Language Models (VLMs) excel at zero-shot inference but often degrade under test-time domain shifts. For this reason, episodic test-time adaptation strategies have recently emerged as powerful techniques for adapting VLMs to a single…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Konstantinos M. Dafnis , Dimitris N. Metaxas

Vision-language models (VLMs) have gained widespread attention for their strong zero-shot capabilities across numerous downstream tasks. However, these models assume that each test image's class label is drawn from a predefined label set…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Yongguang Li , Jindong Li , Qi Wang , Qianli Xing , Runliang Niu , Shengsheng Wang , Menglin Yang

Instance segmentation demands costly per-pixel annotations and computationally expensive models. We introduce CAST, a semi-supervised knowledge distillation (SSKD) framework that compresses pre-trained vision foundation models (VFM) into…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Pardis Taghavi , Tian Liu , Renjie Li , Reza Langari , Zhengzhong Tu

Spatial understanding remains a weakness of Large Vision-Language Models (LVLMs). Existing supervised fine-tuning (SFT) and recent reinforcement learning with verifiable rewards (RLVR) pipelines depend on costly supervision, specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yuhong Liu , Beichen Zhang , Yuhang Zang , Yuhang Cao , Long Xing , Xiaoyi Dong , Haodong Duan , Dahua Lin , Jiaqi Wang

The zero-shot performance of existing vision-language models (VLMs) such as CLIP is limited by the availability of large-scale, aligned image and text datasets in specific domains. In this work, we leverage two complementary sources of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Oindrila Saha , Grant Van Horn , Subhransu Maji

Vision-Language Models (VLMs) have shown remarkable performance on diverse visual and linguistic tasks, yet they remain fundamentally limited in their understanding of 3D spatial structures. We propose Geometric Distillation, a lightweight,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Seonho Lee , Jiho Choi , Inha Kang , Jiwook Kim , Junsung Park , Hyunjung Shim

Vision-language models (VLMs) are emerging as powerful generalist tools for remote sensing, capable of integrating information across diverse tasks and enabling flexible, instruction-based interactions via a chat interface. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Aysim Toker , Andreea-Maria Oncescu , Roy Miles , Ismail Elezi , Jiankang Deng

Synthetic Aperture Radar (SAR) is a critical imaging modality due to its all-weather operational capability. Although recent advances in self-supervised learning and masked image modeling (MIM) have enabled SAR foundation models, these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Qiwei Ma , Xukun Lu , Wang Liu , Puhong Duan , Xudong Kang , Shutao Li

Understanding how humans leverage semantic knowledge to navigate unfamiliar environments and decide where to explore next is pivotal for developing robots capable of human-like search behaviors. We introduce a zero-shot navigation approach,…

Robotics · Computer Science 2023-12-07 Naoki Yokoyama , Sehoon Ha , Dhruv Batra , Jiuguang Wang , Bernadette Bucher

Recent advances in large language and vision-language models have enabled strong reasoning capabilities, yet they remain impractical for specialized domains like remote sensing, where annotated data is scarce and expensive. We present the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Aybora Koksal , A. Aydin Alatan

Vision-Language Pretrained (VLP) models have achieved impressive performance on multimodal tasks, including text-image retrieval, based on dense representations. Meanwhile, Learned Sparse Retrieval (LSR) has gained traction in text-only…

Computation and Language · Computer Science 2025-08-26 Jonghyun Song , Youngjune Lee , Gyu-Hwung Cho , Ilhyeon Song , Saehun Kim , Yohan Jo

Synthetic Aperture Radar (SAR) is a crucial remote sensing technology, enabling all-weather, day-and-night observation with strong surface penetration for precise and continuous environmental monitoring and analysis. However, SAR image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Yimin Wei , Aoran Xiao , Yexian Ren , Yuting Zhu , Hongruixuan Chen , Junshi Xia , Naoto Yokoya

Contrastive image-to-LiDAR knowledge transfer, commonly used for learning 3D representations with synchronized images and point clouds, often faces a self-conflict dilemma. This issue arises as contrastive losses unintentionally dissociate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yifan Zhang , Junhui Hou

Vision-language models (VLMs) unify computer vision and natural language processing in a single architecture capable of interpreting and describing images. Most state-of-the-art systems rely on two computationally intensive components:…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Andrew Kiruluta , Priscilla Burity

We introduce a method to train vision-language models for remote-sensing images without using any textual annotations. Our key insight is to use co-located internet imagery taken on the ground as an intermediary for connecting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Utkarsh Mall , Cheng Perng Phoo , Meilin Kelsey Liu , Carl Vondrick , Bharath Hariharan , Kavita Bala

Frame-wise semantic segmentation of indoor lidar scans is a fundamental step toward higher-level 3D scene understanding and mapping applications. However, acquiring frame-wise ground truth for training deep learning models is costly and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Haiyang Wu , Juan J. Gonzales Torres , George Vosselman , Ville Lehtola

Vision-language models (VLMs) frequently produce hallucinations in the form of descriptions of objects, attributes, or relations that do not exist in the image due to over-reliance on language priors and imprecise cross-modal grounding. We…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ameen Ali , Tamim Zoabi , Lior Wolf

Vision-Language Foundation Models (VLFM) have shown a tremendous increase in performance in terms of generating high-resolution, photorealistic natural images. While VLFMs show a rich understanding of semantic content across modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Parham Saremi , Amar Kumar , Mohamed Mohamed , Zahra TehraniNasab , Tal Arbel