English
Related papers

Related papers: Bridge the Gap Between Visual and Linguistic Compr…

200 papers

The existing zero-shot detection approaches project visual features to the semantic domain for seen objects, hoping to map unseen objects to their corresponding semantics during inference. However, since the unseen objects are never…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Nasir Hayat , Munawar Hayat , Shafin Rahman , Salman Khan , Syed Waqas Zamir , Fahad Shahbaz Khan

Deep neural networks have achieved promising progress in remote sensing (RS) image classification, for which the training process requires abundant samples for each class. However, it is time-consuming and unrealistic to annotate labels for…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Wenjia Xu , Jiuniu Wang , Zhiwei Wei , Mugen Peng , Yirong Wu

Although automatic emotion recognition from facial expressions and speech has made remarkable progress, emotion recognition from body gestures has not been thoroughly explored. People often use a variety of body language to express…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jinting Wu , Yujia Zhang , Xiaoguang Zhao , Wenbin Gao

Zero-shot Learning (ZSL) aims to enable classifiers to identify unseen classes. This is typically achieved by generating visual features for unseen classes based on learned visual-semantic correlations from seen classes. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Zihan Ye , Shreyank N. Gowda , Xiaowei Huang , Haotian Xu , Yaochu Jin , Kaizhu Huang , Xiaobo Jin

Zero-shot learning aims at recognizing unseen classes (no training example) with knowledge transferred from seen classes. This is typically achieved by exploiting a semantic feature space shared by both seen and unseen classes, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-01 Jingcai Guo , Song Guo

Recent advancements in NLP have resulted in models with specialized strengths, such as processing multimodal inputs or excelling in specific domains. However, real-world tasks, like multimodal translation, often require a combination of…

Computation and Language · Computer Science 2024-11-05 Sai Koneru , Matthias Huck , Miriam Exel , Jan Niehues

The fusion of vision and language has brought about a transformative shift in computer vision through the emergence of Vision-Language Models (VLMs). However, the resource-intensive nature of existing VLMs poses a significant challenge. We…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Jordan Shipard , Arnold Wiliem , Kien Nguyen Thanh , Wei Xiang , Clinton Fookes

3D part segmentation is a crucial and challenging task in 3D perception, playing a vital role in applications such as robotics, 3D generation, and 3D editing. Recent methods harness the powerful Vision Language Models (VLMs) for 2D-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yunhan Yang , Yukun Huang , Yuan-Chen Guo , Liangjun Lu , Xiaoyang Wu , Edmund Y. Lam , Yan-Pei Cao , Xihui Liu

Zero-shot learning (ZSL) models rely on learning a joint embedding space where both textual/semantic description of object classes and visual representation of object images can be projected to for nearest neighbour search. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-22 Li Zhang , Tao Xiang , Shaogang Gong

Zero-shot learning (ZSL) aims to transfer knowledge from seen classes to unseen ones so that the latter can be recognised without any training samples. This is made possible by learning a projection function between a feature space and a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Aoxue Li , Zhiwu Lu , Jiechao Guan , Tao Xiang , Liwei Wang , Ji-Rong Wen

In this paper, we propose a Distributed Zero-Shot Learning (DistZSL) framework that can fully exploit decentralized data to learn an effective model for unseen classes. Considering the data heterogeneity issues across distributed nodes, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhi Chen , Yadan Luo , Zi Huang , Jingjing Li , Sen Wang , Xin Yu

Zero-shot learning (ZSL) aims to recognize unseen classes by exploiting semantic descriptions shared between seen classes and unseen classes. Current methods show that it is effective to learn visual-semantic alignment by projecting…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Zaiquan Yang , Yang Liu , Wenjia Xu , Chong Huang , Lei Zhou , Chao Tong

In zero-shot image retrieval (ZSIR) task, embedding learning becomes more attractive, however, many methods follow the traditional metric learning idea and omit the problems behind zero-shot settings. In this paper, we first emphasize the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Binghui Chen , Weihong Deng

Vision-language models (VLMs) classify the query video by calculating a similarity score between the visual features and text-based class label representations. Recently, large language models (LLMs) have been used to enrich the text-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Adeel Yousaf , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

Leveraging class semantic descriptions and examples of known objects, zero-shot learning makes it possible to train a recognition model for an object class whose examples are not available. In this paper, we propose a novel zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Soravit Changpinyo , Wei-Lun Chao , Fei Sha

Recent advancements in text-to-image generative models have demonstrated a remarkable ability to capture a deep semantic understanding of images. In this work, we leverage this semantic knowledge to transfer the visual appearance between…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yuval Alaluf , Daniel Garibi , Or Patashnik , Hadar Averbuch-Elor , Daniel Cohen-Or

In Computer Vision, Zero-Shot Learning (ZSL) aims at classifying unseen classes -- classes for which no matching training image exists. Most of ZSL works learn a cross-modal mapping between images and class labels for seen classes. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-16 Patrick Bordes , Eloi Zablocki , Benjamin Piwowarski , Patrick Gallinari

Zero-shot learning aims to classify visual objects without any training data via knowledge transfer between seen and unseen classes. This is typically achieved by exploring a semantic embedding space where the seen and unseen classes can be…

Computer Vision and Pattern Recognition · Computer Science 2015-06-04 Zhen-Yong Fu , Tao Xiang , Shaogang Gong

Vision-language models (VLMs) are impactful in part because they can be applied to a variety of visual understanding tasks in a zero-shot fashion, without any fine-tuning. We study $\textit{generative VLMs}$ that are trained for next-word…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Zhiqiu Lin , Xinyue Chen , Deepak Pathak , Pengchuan Zhang , Deva Ramanan

Zero-Shot Learning (ZSL) in video classification is a promising research direction, which aims to tackle the challenge from explosive growth of video categories. Most existing methods exploit seen-to-unseen correlation via learning a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Chenrui Zhang , Yuxin Peng