English
Related papers

Related papers: Sketch3T: Test-Time Training for Zero-Shot SBIR

200 papers

Zero-shot learning (ZSL) enables solving a task without the need to see its examples. In this paper, we propose two ZSL frameworks that learn to synthesize parameters for novel unseen classes. First, we propose to cast the problem of ZSL as…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Soravit Changpinyo , Wei-Lun Chao , Boqing Gong , Fei Sha

Zero-shot learning methods typically assume that the new, unseen classes encountered during deployment come from the same distribution as the the classes in the training set. However, real-world scenarios often involve class distribution…

Machine Learning · Computer Science 2024-12-11 Yuli Slavutsky , Yuval Benjamini

We propose and evaluate several triplet CNN architectures for measuring the similarity between sketches and photographs, within the context of the sketch based image retrieval (SBIR) task. In contrast to recent fine-grained SBIR work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Tu Bui , Leonardo Ribeiro , Moacir Ponti , John Collomosse

Zero-shot learning (ZSL) aims to transfer knowledge from seen classes to unseen ones so that the latter can be recognised without any training samples. This is made possible by learning a projection function between a feature space and a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Aoxue Li , Zhiwu Lu , Jiechao Guan , Tao Xiang , Liwei Wang , Ji-Rong Wen

Zero-shot learning (ZSL) makes object recognition in images possible in absence of visual training data for a part of the classes from a dataset. When the number of classes is large, classes are usually represented by semantic class…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Yannick Le Cacheux , Adrian Popescu , Hervé Le Borgne

Zero-shot intent classification is a vital and challenging task in dialogue systems, which aims to deal with numerous fast-emerging unacquainted intents without annotated training data. To obtain more satisfactory performance, the crucial…

Computation and Language · Computer Science 2022-06-07 Han Liu , Siyang Zhao , Xiaotong Zhang , Feng Zhang , Junjie Sun , Hong Yu , Xianchao Zhang

In zero-shot image retrieval (ZSIR) task, embedding learning becomes more attractive, however, many methods follow the traditional metric learning idea and omit the problems behind zero-shot settings. In this paper, we first emphasize the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Binghui Chen , Weihong Deng

We present a novel latent embedding model for learning a compatibility function between image and class embeddings, in the context of zero-shot classification. The proposed method augments the state-of-the-art bilinear compatibility model…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Yongqin Xian , Zeynep Akata , Gaurav Sharma , Quynh Nguyen , Matthias Hein , Bernt Schiele

Current visual detectors, though impressive within their training distribution, often fail to parse out-of-distribution scenes into their constituent entities. Recent test-time adaptation methods use auxiliary self-supervised losses to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Mihir Prabhudesai , Anirudh Goyal , Sujoy Paul , Sjoerd van Steenkiste , Mehdi S. M. Sajjadi , Gaurav Aggarwal , Thomas Kipf , Deepak Pathak , Katerina Fragkiadaki

Zero-Shot Composed Image Retrieval (ZS-CIR) aims to retrieve target images given a multimodal query (comprising a reference image and a modification text), without training on annotated triplets. Existing methods typically convert the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Tianyue Wang , Leigang Qu , Tianyu Yang , Xiangzhao Hao , Yifan Xu , Haiyun Guo , Jinqiao Wang

We present a cross-modal Transformer-based framework, which jointly encodes video data and text labels for zero-shot action recognition (ZSAR). Our model employs a conceptually new pipeline by which visual representations are learned in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Chung-Ching Lin , Kevin Lin , Linjie Li , Lijuan Wang , Zicheng Liu

Zero-shot classification is a generalization task where no instance from the target classes is seen during training. To allow for test-time transfer, each class is annotated with semantic information, commonly in the form of attributes or…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Tristan Sylvain , Linda Petrini , R Devon Hjelm

Zero-shot learning (ZSL) aims at understanding unseen categories with no training examples from class-level descriptions. To improve the discriminative power of zero-shot learning, we model the visual learning process of unseen categories…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Mohamed Elhoseiny , Mohamed Elfeki

As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunlong Yu , Zhong Ji , Xi Li , Jichang Guo , Zhongfei Zhang , Haibin Ling , Fei Wu

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims at finding a specific image from a large gallery given a query sketch. Despite the widespread applicability of FG-SBIR in many critical domains (e.g., crime activity tracking),…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Dingrong Wang , Hitesh Sapkota , Xumin Liu , Qi Yu

This paper proposes a novel Zero-Shot Action Recognition~(ZSAR) method based on contrastive learning. In ZSAR, we aim to classify examples from classes that were missing during training. Two well-known problems remain in ZSAR: the semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Valter Estevam , Rayson Laroca , Helio Pedrini , David Menotti

In this paper, we address an open problem of zero-shot learning. Its principle is based on learning a mapping that associates feature vectors extracted from i.e. images and attribute vectors that describe objects and/or scenes of interest.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Hongguang Zhang , Piotr Koniusz

Recently introduced zero-shot self-supervised learning (ZS-SSL) has shown potential in accelerated MRI in a scan-specific scenario, which enabled high-quality reconstructions without access to a large training dataset. ZS-SSL has been…

Image and Video Processing · Electrical Eng. & Systems 2023-11-30 Heng Yu , Yamin Arefeen , Berkin Bilgic

Supervised learning is well-known to fail at generalization under distribution shifts. In typical clinical settings, the source data is inaccessible and the target distribution is represented with a handful of samples: adaptation can only…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Mathilde Bateson , Hervé Lombaert , Ismail Ben Ayed

Zero-shot Composed Image Retrieval (ZS-CIR) aims to retrieve a target image given a reference image and a relative text, without relying on costly triplet annotations. Existing CLIP-based methods face two core challenges: (1) union-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuqi Xiao , Yingying Zhu