English
Related papers

Related papers: Spatial-Aware Object Embeddings for Zero-Shot Loca…

200 papers

Human-annotated attributes serve as powerful semantic embeddings in zero-shot learning. However, their annotation process is labor-intensive and needs expert supervision. Current unsupervised semantic embeddings, i.e., word embeddings,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Wenjia Xu , Yongqin Xian , Jiuniu Wang , Bernt Schiele , Zeynep Akata

It is widely accepted that reasoning about object shape is important for object recognition. However, the most powerful object recognition methods today do not explicitly make use of object shape during learning. In this work, motivated by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Stefan Stojanov , Anh Thai , James M. Rehg

In this paper, we examined the zero-shot activity recognition task with the usage of videos. We introduce an auto-encoder based model to construct a multimodal joint embedding space between the visual and textual manifolds. On the visual…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Evin Pinar Ornek

The success of Zero-shot Action Recognition (ZSAR) methods is intrinsically related to the nature of semantic side information used to transfer knowledge, although this aspect has not been primarily investigated in the literature. This work…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Valter Estevam , Rayson Laroca , Helio Pedrini , David Menotti

This paper addresses the problem of spatiotemporal localization of actions in videos. Compared to leading approaches, which all learn to localize based on carefully annotated boxes on training video frames, we adhere to a weakly-supervised…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Victor Escorcia , Cuong D. Dao , Mihir Jain , Bernard Ghanem , Cees Snoek

We present a novel problem setting in zero-shot learning, zero-shot object recognition and detection in the context. Contrary to the traditional zero-shot learning methods, which simply infers unseen categories by transferring knowledge…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Ruotian Luo , Ning Zhang , Bohyung Han , Linjie Yang

In video analysis, understanding the temporal context is crucial for recognizing object interactions, event patterns, and contextual changes over time. The proposed model leverages adjacency and semantic similarities between objects from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Ahnaf Farhan , M. Shahriar Hossain

We present a novel latent embedding model for learning a compatibility function between image and class embeddings, in the context of zero-shot classification. The proposed method augments the state-of-the-art bilinear compatibility model…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Yongqin Xian , Zeynep Akata , Gaurav Sharma , Quynh Nguyen , Matthias Hein , Bernt Schiele

Zero-Shot Learning (ZSL) aims at classifying unlabeled objects by leveraging auxiliary knowledge, such as semantic representations. A limitation of previous approaches is that only intrinsic properties of objects, e.g. their visual…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Eloi Zablocki , Patrick Bordes , Benjamin Piwowarski , Laure Soulier , Patrick Gallinari

Zero-Shot Action Recognition has attracted attention in the last years and many approaches have been proposed for recognition of objects, events and actions in images and videos. There is a demand for methods that can classify instances…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Valter Estevam , Helio Pedrini , David Menotti

We propose a new zero-shot Event Detection method by Multi-modal Distributional Semantic embedding of videos. Our model embeds object and action concepts as well as other available modalities from videos into a distributional semantic…

Computer Vision and Pattern Recognition · Computer Science 2015-12-17 Mohamed Elhoseiny , Jingen Liu , Hui Cheng , Harpreet Sawhney , Ahmed Elgammal

The aim of object-centric vision is to construct an explicit representation of the objects in a scene. This representation is obtained via a set of interchangeable modules called \emph{slots} or \emph{object files} that compete for local…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Ayush Chakravarthy , Trang Nguyen , Anirudh Goyal , Yoshua Bengio , Michael C. Mozer

Large scale vision and language models can achieve impressive zero-shot recognition performance by mapping class specific text queries to image content. Two distinct challenges that remain however, are high sensitivity to the choice of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Sarah Parisot , Yongxin Yang , Steven McDonagh

This work addresses the problem of recognizing action categories in videos when no training examples are available. The current state-of-the-art enables such a zero-shot recognition by learning universal mappings from videos to a semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Pascal Mettes

Given semantic descriptions of object classes, zero-shot learning aims to accurately recognize objects of the unseen classes, from which no examples are available at the training stage, by associating them to the seen classes, from which…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Soravit Changpinyo , Wei-Lun Chao , Boqing Gong , Fei Sha

The goal of object-centric representation learning is to decompose visual scenes into a structured representation that isolates the entities. Recent successes have shown that object-centric representation learning can be scaled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aniket Didolkar , Andrii Zadaianchuk , Anirudh Goyal , Mike Mozer , Yoshua Bengio , Georg Martius , Maximilian Seitzer

Current Zero-Shot Learning (ZSL) approaches are restricted to recognition of a single dominant unseen object category in a test image. We hypothesize that this setting is ill-suited for real-world applications where unseen objects appear…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Shafin Rahman , Salman Khan , Fatih Porikli

The task of action recognition or action detection involves analyzing videos and determining what action or motion is being performed. The primary subject of these videos are predominantly humans performing some action. However, this…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Amlaan Bhoi

Scaling up visual category recognition to large numbers of classes remains challenging. A promising research direction is zero-shot learning, which does not require any training data to recognize new classes, but rather relies on some form…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Zeynep Akata , Mateusz Malinowski , Mario Fritz , Bernt Schiele

Action recognition in surveillance video makes our life safer by detecting the criminal events or predicting violent emergencies. However, efficient action recognition is not free of difficulty. First, there are so many action classes in…

Computer Vision and Pattern Recognition · Computer Science 2017-10-23 Kun Liu , Wu Liu , Huadong Ma , Wenbing Huang , Xiongxiong Dong