English
Related papers

Related papers: BiCLIP: Domain Canonicalization via Structured Geo…

200 papers

The recent CLIP-based methods have shown promising zero-shot and few-shot performance on image classification tasks. Existing approaches such as CoOp and Tip-Adapter only focus on high-level visual features that are fully aligned with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiaying Shi , Xuetong Xue , Shenghui Xu

Early detection of eye diseases like glaucoma, macular degeneration, and diabetic retinopathy is crucial for preventing vision loss. While artificial intelligence (AI) foundation models hold significant promise for addressing these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Danli Shi , Weiyi Zhang , Jiancheng Yang , Siyu Huang , Xiaolan Chen , Mayinuer Yusufu , Kai Jin , Shan Lin , Shunming Liu , Qing Zhang , Mingguang He

We propose a novel framework for few-shot learning by leveraging large-scale vision-language models such as CLIP. Motivated by unimodal prototypical networks for few-shot learning, we introduce Proto-CLIP which utilizes image prototypes and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jishnu Jaykumar P , Kamalesh Palanisamy , Yu-Wei Chao , Xinya Du , Yu Xiang

Dense visual perception tasks have been constrained by their reliance on predefined categories, limiting their applicability in real-world scenarios where visual concepts are unbounded. While Vision-Language Models (VLMs) like CLIP have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Junjie Wang , Keyu Chen , Yulin Li , Bin Chen , Hengshuang Zhao , Xiaojuan Qi , Zhuotao Tian

While multi-modal Visual Language Models (VLMs) have demonstrated significant success across various domains, the integration of VLMs into recommendation and retrieval systems remains a challenge, due to issues like training objective…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Josh Beal , Eric Kim , Jinfeng Rao , Rex Wu , Dmitry Kislyuk , Charles Rosenberg

Progress in 3D object understanding has relied on manually canonicalized shape datasets that contain instances with consistent position and orientation (3D pose). This has made it hard to generalize these methods to in-the-wild shapes, eg.,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Rahul Sajnani , Adrien Poulenard , Jivitesh Jain , Radhika Dua , Leonidas J. Guibas , Srinath Sridhar

There is a growing interest in designing models that can deal with images from different visual domains. If there exists a universal structure in different visual domains that can be captured via a common parameterization, then we can use a…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Yunhui Guo , Yandong Li , Rogerio Feris , Liqiang Wang , Tajana Rosing

Continuous Sign Language Recognition (CSLR) has achieved remarkable progress in recent years; however, most existing methods are developed under single-view settings and thus remain insufficiently robust to viewpoint variations in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xu Wang , Shengeng Tang , Wan Jiang , Yaxiong Wang , Lechao Cheng , Richang Hong

Transduction is a powerful paradigm that leverages the structure of unlabeled data to boost predictive accuracy. We present TransCLIP, a novel and computationally efficient transductive approach designed for Vision-Language Models (VLMs).…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Maxime Zanella , Benoît Gérin , Ismail Ben Ayed

Numerous methods have been proposed to adapt a pre-trained foundational CLIP model for few-shot classification. As CLIP is trained on a large corpus, it generalises well through adaptation to few-shot classification. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Alexey Kravets , Vinay Namboodiri

We seek to learn a representation on a large annotated data source that generalizes to a target domain using limited new supervision. Many prior approaches to this problem have focused on learning "disentangled" representations so that as…

Machine Learning · Computer Science 2020-02-28 Or Litany , Ari Morcos , Srinath Sridhar , Leonidas Guibas , Judy Hoffman

Training deep generative models usually requires a large amount of data. To alleviate the data collection cost, the task of zero-shot GAN adaptation aims to reuse well-trained generators to synthesize images of an unseen target domain…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Seogkyu Jeon , Bei Liu , Pilhyeon Lee , Kibeom Hong , Jianlong Fu , Hyeran Byun

Zero-shot anomaly detection (ZSAD) aims to identify anomalies in unseen categories by leveraging CLIP's zero-shot capabilities to match text prompts with visual features. A key challenge in ZSAD is learning general prompts stably and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Donghyeong Kim , Chaewon Park , Suhwan Cho , Hyeonjeong Lim , Minseok Kang , Jungho Lee , Sangyoun Lee

Camera traps are vital for large-scale biodiversity monitoring, yet accurate automated analysis remains challenging due to diverse deployment environments. While the computer vision community has mostly framed this challenge as cross-domain…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Sooyoung Jeon , Hongjie Tian , Lemeng Wang , Zheda Mai , Vidhi Bakshi , Jiacheng Hou , Ping Zhang , Arpita Chowdhury , Jianyang Gu , Wei-Lun Chao

The objective of domain generalization (DG) is to enable models to be robust against domain shift. DG is crucial for deploying vision-language models (VLMs) in real-world applications, yet most existing methods rely on domain labels that…

Machine Learning · Computer Science 2026-02-02 Zhixing Li , Arsham Gholamzadeh Khoee , Yinan Yu

Vision-Language Pretraining (VLP) has achieved remarkable success across various downstream tasks, but such gains are largely driven by scaling up on training data. Yet, literature methods treat image-text pairs as isolated training…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Wenbo Lu

The remarkable generalization performance of contrastive vision-language models like CLIP is often attributed to the diversity of their training distributions. However, key questions remain unanswered: Can CLIP generalize to an entirely…

Machine Learning · Computer Science 2025-09-15 Elias Kempf , Simon Schrodi , Max Argus , Thomas Brox

Large unimodal foundation models for vision and language encode rich semantic structures, yet aligning them typically requires computationally intensive multimodal fine-tuning. Such approaches depend on large-scale parameter updates, are…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Abhishek Dalvi , Vasant Honavar

Zero-shot anomaly detection (ZSAD) enables anomaly detection without normal samples from target categories, addressing scenarios where task-specific training data is unavailable. However, existing ZSAD methods either neglect adaptation of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Kiyoon Jeong , Jaehyuk Heo , Junyeong Son , Pilsung Kang

Thanks to the availability of powerful computing resources, big data and deep learning algorithms, we have made great progress on computer vision in the last few years. Computer vision systems begin to surpass humans in some tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Fupin Yao