English
Related papers

Related papers: SOTA: Self-adaptive Optimal Transport for Zero-Sho…

200 papers

Zero-shot object pose estimation enables the retrieval of object poses from images without necessitating object-specific training. In recent approaches this is facilitated by vision foundation models (VFM), which are pre-trained models that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Bernd Von Gimborn , Philipp Ausserlechner , Markus Vincze , Stefan Thalhammer

Zero-shot referring expression comprehension aims at localizing bounding boxes in an image corresponding to provided textual prompts, which requires: (i) a fine-grained disentanglement of complex visual scene and textual context, and (ii) a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zeyu Han , Fangrui Zhu , Qianru Lao , Huaizu Jiang

One fascinating aspect of pre-trained vision-language models~(VLMs) learning under language supervision is their impressive zero-shot generalization capability. However, this ability is hindered by distribution shifts between the training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Shuai Zhao , Xiaohan Wang , Linchao Zhu , Yi Yang

Tracking small, agile multi-objects (SMOT), such as birds, from an Unmanned Aerial Vehicle (UAV) perspective is a highly challenging computer vision task. The difficulty stems from three main sources: the extreme scarcity of target…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Xiang Yu , Xinyao Liu , Guang Liang

Training-free zero-shot composed image retrieval models are recently gaining increasing research interest due to their generalizability and flexibility in unseen multimodal retrieval. Recent LLM-based advances focus on generating the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Miaoge Li , Dongsheng Wang , Zening Sun , Jinsen Zhang , Wenhan Luo , Jingcai Guo

Few-Shot Remote Sensing Scene Classification (FS-RSSC) presents the challenge of classifying remote sensing images with limited labeled samples. Existing methods typically emphasize single-modal feature learning, neglecting the potential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Zhong Ji , Ci Liu , Jingren Liu , Chen Tang , Yanwei Pang , Xuelong Li

Current multi-object tracking (MOT) algorithms typically overlook issues inherent in low-quality videos, leading to significant degradation in tracking performance when confronted with real-world image deterioration. Therefore, advancing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Jun Du , Weiwei Xing , Ming Li , Fei Richard Yu

Recent advances in few-shot adaptation for Vision-Language Models (VLMs) have greatly expanded their ability to generalize across tasks using only a few labeled examples. However, existing approaches primarily build upon the strong…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Maxime Zanella , Clément Fuchs , Ismail Ben Ayed , Christophe De Vleeschouwer

Urban transportation systems face growing safety challenges that require scalable intelligence for emerging smart mobility infrastructures. While recent advances in foundation models and large-scale multimodal datasets have strengthened…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Wenhui Huang , Songyan Zhang , Collister Chua , Yang Liang , Zhiqi Mao , Heng Yang , Chen Lv

Despite the promise of Vision-Language-Action (VLA) models as generalist robotic controllers, their robustness against perceptual noise and environmental variations in out-of-distribution (OOD) tasks remains fundamentally limited by the…

Robotics · Computer Science 2026-03-30 Zhuoran Li , Zhiyang Li , Kaijun Zhou , Jinyu Gu

Vision-language foundation models (VLMs), such as CLIP, exhibit remarkable performance across a wide range of tasks. However, deploying these models can be unreliable when significant distribution gaps exist between training and test data,…

Machine Learning · Computer Science 2025-09-29 Zongbo Han , Jialong Yang , Guangyu Wang , Junfan Li , Qianli Xu , Mike Zheng Shou , Changqing Zhang

Multi-modal (vision-language) models, such as CLIP, are replacing traditional supervised pre-training models (e.g., ImageNet-based pre-training) as the new generation of visual foundation models. These models with robust and aligned…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Fan Liu , Tianshu Zhang , Wenwen Dai , Wenwen Cai , Xiaocong Zhou , Delong Chen

Terrain traversability estimation is crucial for autonomous robots, especially in unstructured environments where visual cues and reasoning play a key role. While vision-language models (VLMs) offer potential for zero-shot estimation, the…

Robotics · Computer Science 2025-08-05 Ida Germann , Mark O. Mints , Peer Neubert

To transfer knowledge from seen attribute-object compositions to recognize unseen ones, recent compositional zero-shot learning (CZSL) methods mainly discuss the optimal classification branches to identify the elements, leading to the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Fengyuan Dai , Siteng Huang , Min Zhang , Biao Gong , Donglin Wang

We present an optimization study of the Vision-Language Frontier Maps (VLFM) applied to the Object Goal Navigation task in robotics. Our work evaluates the efficiency and performance of various vision-language models, object detectors,…

Robotics · Computer Science 2025-07-03 Dmytro Kuzmenko , Nadiya Shvai

We address the computational and theoretical limitations of current distributional alignment methods for source-free unsupervised domain adaptation (SFUDA) using source class-mean features. In particular, we focus on estimating…

Machine Learning · Computer Science 2026-04-30 Yiming Zhang , Sitong Liu , Alex Cloninger

To perform outdoor visual navigation and search, a robot may leverage satellite imagery to generate visual priors. This can help inform high-level search strategies, even when such images lack sufficient resolution for target recognition.…

Understanding how humans leverage semantic knowledge to navigate unfamiliar environments and decide where to explore next is pivotal for developing robots capable of human-like search behaviors. We introduce a zero-shot navigation approach,…

Robotics · Computer Science 2023-12-07 Naoki Yokoyama , Sehoon Ha , Dhruv Batra , Jiuguang Wang , Bernadette Bucher

Visual domain adaptation aims to learn discriminative and domain-invariant representation for an unlabeled target domain by leveraging knowledge from a labeled source domain. Partial domain adaptation (PDA) is a general and practical…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Yi-Ming Zhai , Chuan-Xian Ren , Hong Yan

Multimodal ophthalmic imaging-based diagnosis integrates color fundus image with optical coherence tomography (OCT) to provide a comprehensive view of ocular pathologies. However, the uneven global distribution of healthcare resources often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Qinkai Yu , Jianyang Xie , Yitian Zhao , Cheng Chen , Lijun Zhang , Liming Chen , Jun Cheng , Lu Liu , Yalin Zheng , Yanda Meng