English
Related papers

Related papers: Hyperbolic Audio-visual Zero-shot Learning

200 papers

Vision-Language Models (VLMs) show promise as zero-shot goal-conditioned value functions, but their frozen pre-trained representations limit generalization and temporal reasoning. We introduce VITA, a zero-shot value function learning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Christos Ziakas , Alessandra Russo

Generalized zero-shot learning (GZSL) is one of the most realistic but challenging problems due to the partiality of the classifier to supervised classes, especially under the class-inductive instance-inductive (CIII) training setting,…

Machine Learning · Computer Science 2021-08-24 Xiaowei Chen

Deep learning techniques for separating audio into different sound sources face several challenges. Standard architectures require training separate models for different types of audio sources. Although some universal separators employ a…

Sound · Computer Science 2022-02-15 Ke Chen , Xingjian Du , Bilei Zhu , Zejun Ma , Taylor Berg-Kirkpatrick , Shlomo Dubnov

Generalized Zero-Shot Learning (GZSL) has emerged as a pivotal research domain in computer vision, owing to its capability to recognize objects that have not been seen during training. Despite the significant progress achieved by generative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Shreyank N Gowda

Collecting training images for all visual categories is not only expensive but also impractical. Zero-shot learning (ZSL), especially using attributes, offers a pragmatic solution to this problem. However, at test time most attribute-based…

Computer Vision and Pattern Recognition · Computer Science 2016-10-18 Ziad Al-Halah , Makarand Tapaswi , Rainer Stiefelhagen

Classification based on Zero-shot Learning (ZSL) is the ability of a model to classify inputs into novel classes on which the model has not previously seen any training examples. Providing an auxiliary descriptor in the form of a set of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Samuele Ruffino , Geethan Karunaratne , Michael Hersche , Luca Benini , Abu Sebastian , Abbas Rahimi

The purpose of generative Zero-shot learning (ZSL) is to learning from seen classes, transfer the learned knowledge, and create samples of unseen classes from the description of these unseen categories. To achieve better ZSL accuracies,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Shayan Kousha , Marcus A. Brubaker

Generalized zero-shot learning (GZSL) is the problem of learning a classifier where some classes have samples and others are learned from side information, like semantic attributes or text description, in a zero-shot learning fashion (ZSL).…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Yuval Atzmon , Gal Chechik

Purpose: The treatment of cardiovascular diseases requires complex and challenging navigation of a guidewire and catheter. This often leads to lengthy interventions during which the patient and clinician are exposed to X-ray radiation. Deep…

Machine Learning · Computer Science 2024-03-06 Valentina Scarponi , Michel Duprez , Florent Nageotte , Stéphane Cotin

Learning novel concepts, remembering previous knowledge, and adapting it to future tasks occur simultaneously throughout a human's lifetime. To model such comprehensive abilities, continual zero-shot learning (CZSL) has recently been…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Wenxuan Zhang , Paul Janson , Kai Yi , Ivan Skorokhodov , Mohamed Elhoseiny

Due to the importance of zero-shot learning, i.e. classifying images where there is a lack of labeled training data, the number of proposed approaches has recently increased steadily. We argue that it is time to take a step back and to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Yongqin Xian , Christoph H. Lampert , Bernt Schiele , Zeynep Akata

Zero-shot learning (ZSL) aims to recognize unseen objects (test classes) given some other seen objects (training classes), by sharing information of attributes between different objects. Attributes are artificially annotated for objects and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Xiaofeng Xu , Ivor W. Tsang , Chuancai Liu

Compositional Zero-Shot Learning (CZSL) aims to recognize novel attribute-object compositions by leveraging knowledge from seen compositions. Current methods align textual prototypes with visual features via Vision-Language Models (VLMs),…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Shiyu Zhang , Cheng Yan , Yang Liu , Chenchen Jing , Lei Zhou , Wenjun Wang

Forklifts are used extensively in various industrial settings and are in high demand for automation. In particular, counterbalance forklifts are highly versatile and employed in diverse scenarios. However, efforts to automate these…

Robotics · Computer Science 2025-05-07 Koshi Oishi , Teruki Kato , Hiroya Makino , Seigo Ito

We tackle continual adaptation of vision-language models to new attributes, objects, and their compositions in Compositional Zero-Shot Learning (CZSL), while preventing forgetting of prior knowledge. Unlike classical continual learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Sauda Maryam , Sara Nadeem , Faisal Qureshi , Mohsen Ali

In this paper, we study zero-shot learning in audio classification through factored linear and nonlinear acoustic-semantic projections between audio instances and sound classes. Zero-shot learning in audio classification refers to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-03 Huang Xie , Okko Räsänen , Tuomas Virtanen

Zero-shot object recognition or zero-shot learning aims to transfer the object recognition ability among the semantically related categories, such as fine-grained animal or bird species. However, the images of different fine-grained objects…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Zongyan Han , Zhenyong Fu , Jian Yang

Most of the existing artificial neural networks(ANNs) fail to learn continually due to catastrophic forgetting, while humans can do the same by maintaining previous tasks' performances. Although storing all the previous data can alleviate…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Subhankar Ghosh

With recent progress in large-scale map maintenance and long-term map learning, the task of change detection on a large-scale map from a visual image captured by a mobile robot has become a problem of increasing criticality. Previous…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Tanaka Kanji

The task of Visual Sound Source Localization (VSSL) involves identifying the location of sound sources in visual scenes, integrating audio-visual data for enhanced scene understanding. Despite advancements in state-of-the-art (SOTA) models,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xavier Juanola , Gloria Haro , Magdalena Fuentes