English
Related papers

Related papers: Fine-Grained Zero-Shot Learning with Attribute-Cen…

200 papers

Vision-language models (VLMs) like CLIP have been cherished for their ability to perform zero-shot visual recognition on open-vocabulary concepts. This is achieved by selecting the object category whose textual representation bears the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Shaunak Halbe , Junjiao Tian , K J Joseph , James Seale Smith , Katherine Stevo , Vineeth N Balasubramanian , Zsolt Kira

Fine-grained image recognition is a longstanding computer vision challenge that focuses on differentiating objects belonging to multiple subordinate categories within the same meta-category. Since images belonging to the same meta-category…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Yifan Pu , Yizeng Han , Yulin Wang , Junlan Feng , Chao Deng , Gao Huang

We present a novel problem setting in zero-shot learning, zero-shot object recognition and detection in the context. Contrary to the traditional zero-shot learning methods, which simply infers unseen categories by transferring knowledge…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Ruotian Luo , Ning Zhang , Bohyung Han , Linjie Yang

Learning visual representations is foundational for a broad spectrum of downstream tasks. Although recent vision-language contrastive models, such as CLIP and SigLIP, have achieved impressive zero-shot performance via large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yin Xie , Kaicheng Yang , Xiang An , Kun Wu , Yongle Zhao , Weimo Deng , Zimin Ran , Yumeng Wang , Ziyong Feng , Roy Miles , Ismail Elezi , Jiankang Deng

Multimodal representation is crucial for E-commerce tasks such as identical product retrieval. Large representation models (e.g., VLM2Vec) demonstrate strong multimodal understanding capabilities, yet they struggle with fine-grained…

Computation and Language · Computer Science 2026-04-23 Biao Zhang , Lixin Chen , Bin Zhang , Zongwei Wang , Tong Liu , Bo Zheng

The main question we address in this paper is how to scale up visual recognition of unseen classes, also known as zero-shot learning, to tens of thousands of categories as in the ImageNet-21K benchmark. At this scale, especially with many…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Kai Yi , Xiaoqian Shen , Yunhao Gou , Mohamed Elhoseiny

Zero-shot learning (ZSL) aims to recognize unseen image categories by learning an embedding space between image and semantic representations. For years, among existing works, it has been the center task to learn the proper mapping matrices…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Yan Li , Junge Zhang , Jianguo Zhang , Kaiqi Huang

Fine-grained visual classification can be addressed by deep representation learning under supervision of manually pre-defined targets (e.g., one-hot or the Hadamard codes). Such target coding schemes are less flexible to model inter-class…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Kangjun Liu , Ke Chen , Kui Jia

Zero-shot action recognition is the task of recognizingaction classes without visual examples, only with a seman-tic embedding which relates unseen to seen classes. Theproblem can be seen as learning a function which general-izes well to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Shreyank N Gowda , Laura Sevilla-Lara , Frank Keller , Marcus Rohrbach

Zero-shot object recognition or zero-shot learning aims to transfer the object recognition ability among the semantically related categories, such as fine-grained animal or bird species. However, the images of different fine-grained objects…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Zongyan Han , Zhenyong Fu , Jian Yang

Face sketches are able to capture the spatial topology of a face while lacking some facial attributes such as race, skin, or hair color. Existing sketch-photo recognition approaches have mostly ignored the importance of facial attributes.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Hadi Kazemi , Sobhan Soleymani , Ali Dabouei , Mehdi Iranmanesh , Nasser M. Nasrabadi

Image-to-image translation is a fundamental task in computer vision. It transforms images from one domain to images in another domain so that they have particular domain-specific characteristics. Most prior works train a generative model to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Sihan Xu , Zelong Jiang , Ruisi Liu , Kaikai Yang , Zhijie Huang

Zero-shot instance segmentation aims to detect and precisely segment objects of unseen categories without any training samples. Since the model is trained on seen categories, there is a strong bias that the model tends to classify all the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Shuting He , Henghui Ding , Wei Jiang

We propose an approach to learn image representations that consist of disentangled factors of variation without exploiting any manual labeling or data domain knowledge. A factor of variation corresponds to an image attribute that can be…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Qiyang Hu , Attila Szabó , Tiziano Portenier , Matthias Zwicker , Paolo Favaro

Zero-shot learning (ZSL) aims to recognize unseen objects using disjoint seen objects via sharing attributes. The generalization performance of ZSL is governed by the attributes, which transfer semantic information from seen classes to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Xiaofeng Xu , Ivor W. Tsang , Chuancai Liu

Zero-Shot Learning (ZSL) is achieved via aligning the semantic relationships between the global image feature vector and the corresponding class semantic descriptions. However, using the global features to represent fine-grained images may…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Yunlong Yu , Zhong Ji , Yanwei Fu , Jichang Guo , Yanwei Pang , Zhongfei Zhang

Although deep learning-based methods have achieved excellent performance on SAR ATR, the fact that it is difficult to acquire and label a lot of SAR images makes these methods, which originally performed well, perform weakly. This may be…

Image and Video Processing · Electrical Eng. & Systems 2023-08-23 Chenwei Wang , Siyi Luo , Jifang Pei , Yulin Huang , Yin Zhang , Jianyu Yang

While vision-language models like CLIP have advanced zero-shot surgical phase recognition, they struggle with fine-grained surgical activities, especially action triplets. This limitation arises because current CLIP formulations rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-30 Saurav Sharma , Didier Mutter , Nicolas Padoy

Recent advances in generative models have highlighted the need for robust detectors capable of distinguishing real images from AI-generated images. While existing methods perform well on known generators, their performance often declines…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Kuo Shi , Jie Lu , Shanshan Ye , Guangquan Zhang , Zhen Fang

When labeled training data is scarce, a promising data augmentation approach is to generate visual features of unknown classes using their attributes. To learn the class conditional distribution of CNN features, these models rely on pairs…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Yongqin Xian , Saurabh Sharma , Bernt Schiele , Zeynep Akata