English
Related papers

Related papers: Zero-Shot Action Recognition from Diverse Object-S…

200 papers

Recent approaches have shown that training deep neural networks directly on large-scale image-text pair collections enables zero-shot transfer on various recognition tasks. One central issue is how this can be generalized to object…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Johnathan Xie , Shuai Zheng

Open-World Compositional Zero-Shot Learning (OW-CZSL) addresses the challenge of recognizing novel compositions of known primitives and entities. Even though prior works utilize language knowledge for recognition, such approaches exhibit…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Hirunima Jayasekara , Khoi Pham , Nirat Saini , Abhinav Shrivastava

Recent methods for video action recognition have reached outstanding performances on existing benchmarks. However, they tend to leverage context such as scenes or objects instead of focusing on understanding the human action itself. For…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Philippe Weinzaepfel , Grégory Rogez

Semantic 3D scene understanding is a problem of critical importance in robotics. While significant advances have been made in simultaneous localization and mapping algorithms, robots are still far from having the common sense knowledge…

Robotics · Computer Science 2022-06-22 William Chen , Siyi Hu , Rajat Talak , Luca Carlone

Few-shot video action recognition is an effective approach to recognizing new categories with only a few labeled examples, thereby reducing the challenges associated with collecting and annotating large-scale video datasets. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Sarinda Samarasinghe , Mamshad Nayeem Rizve , Navid Kardan , Mubarak Shah

Recent advancements in text-to-image generative models have demonstrated a remarkable ability to capture a deep semantic understanding of images. In this work, we leverage this semantic knowledge to transfer the visual appearance between…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yuval Alaluf , Daniel Garibi , Or Patashnik , Hadar Averbuch-Elor , Daniel Cohen-Or

Zero-shot Learners are models capable of predicting unseen classes. In this work, we propose a Zero-shot Learning approach for text categorization. Our method involves training model on a large corpus of sentences to learn the relationship…

Computation and Language · Computer Science 2017-12-27 Pushpankar Kumar Pushp , Muktabh Mayank Srivastava

In this paper, we investigate large-scale zero-shot activity recognition by modeling the visual and linguistic attributes of action verbs. For example, the verb "salute" has several properties, such as being a light movement, a social act,…

Computation and Language · Computer Science 2017-09-05 Rowan Zellers , Yejin Choi

Few-shot learning aims to recognize instances from novel classes with few labeled samples, which has great value in research and application. Although there has been a lot of work in this area recently, most of the existing work is based on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Congqi Cao , Yajuan Li , Qinyi Lv , Peng Wang , Yanning Zhang

A large amount of recent research has focused on tasks that combine language and vision, resulting in a proliferation of datasets and methods. One such task is action recognition, whose applications include image annotation, scene under-…

Computation and Language · Computer Science 2017-04-25 Spandana Gella , Frank Keller

Vision-Language Models for remote sensing have shown promising uses thanks to their extensive pretraining. However, their conventional usage in zero-shot scene classification methods still involves dividing large images into patches and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Karim El Khoury , Maxime Zanella , Benoît Gérin , Tiffanie Godelaine , Benoît Macq , Saïd Mahmoudi , Christophe De Vleeschouwer , Ismail Ben Ayed

Detecting object-level changes between two images across possibly different views is a core task in many applications that involve visual inspection or camera surveillance. Existing change-detection approaches suffer from three major…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Hung Huy Nguyen , Pooyan Rahmanzadehgervi , Long Mai , Anh Totti Nguyen

Action in video usually involves the interaction of human with objects. Action labels are typically composed of various combinations of verbs and nouns, but we may not have training data for all possible combinations. In this paper, we aim…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Zhekun Luo , Shalini Ghosh , Devin Guillory , Keizo Kato , Trevor Darrell , Huijuan Xu

In Generalized Zero-Shot Learning (GZSL), unseen categories (for which no visual data are available at training time) can be predicted by leveraging their class embeddings (e.g., a list of attributes describing them) together with a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Federico Marmoreo , Julio Ivan Davila Carrazco , Vittorio Murino , Jacopo Cavazza

Compositional Zero-Shot Learning (CZSL) aims to recognize unseen compositions formed from seen state and object during training. Since the same state may be various in the visual appearance while entangled with different objects, CZSL is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Xiangyu Li , Xu Yang , Kun Wei , Cheng Deng , Muli Yang

This work strives for the classification and localization of human actions in videos, without the need for any labeled video training examples. Where existing work relies on transferring global attribute or object information from seen to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Pascal Mettes , William Thong , Cees G. M. Snoek

This paper addresses the task of zero-shot image classification. The key contribution of the proposed approach is to control the semantic embedding of images -- one of the main ingredients of zero-shot learning -- by formulating it as a…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Maxime Bucher , Stéphane Herbin , Frédéric Jurie

Conventional object detection models require large amounts of training data. In comparison, humans can recognize previously unseen objects by merely knowing their semantic description. To mimic similar behaviour, zero-shot object detection…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Shafin Rahman , Salman Khan , Nick Barnes

Humans exhibit an innate capacity to rapidly perceive and segment objects from video observations, and even mentally assemble them into structured 3D scenes. Replicating such capability, termed compositional 3D reconstruction, is pivotal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Mingyu Dong , Chong Xia , Mingyuan Jia , Weichen Lyu , Long Xu , Zheng Zhu , Yueqi Duan

This paper presents a method of zero-shot learning (ZSL) which poses ZSL as the missing data problem, rather than the missing label problem. Specifically, most existing ZSL methods focus on learning mapping functions from the image feature…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Botong Wu , Tianfu Wu , Yizhou Wang