English
Related papers

Related papers: Zero-Shot Object-Centric Representation Learning

200 papers

Purpose: Advances in deep learning have resulted in effective models for surgical video analysis; however, these models often fail to generalize across medical centers due to domain shift caused by variations in surgical workflow, camera…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Siddhant Satyanaik , Aditya Murali , Deepak Alapatt , Xin Wang , Pietro Mascagni , Nicolas Padoy

With the explosive 3D data growth, the urgency of utilizing zero-shot learning to facilitate data labeling becomes evident. Recently, methods transferring language or language-image pre-training models like Contrastive Language-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Weiguang Zhao , Guanyu Yang , Rui Zhang , Chenru Jiang , Chaolong Yang , Yuyao Yan , Amir Hussain , Kaizhu Huang

Zero-shot action recognition is the task of recognizingaction classes without visual examples, only with a seman-tic embedding which relates unseen to seen classes. Theproblem can be seen as learning a function which general-izes well to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Shreyank N Gowda , Laura Sevilla-Lara , Frank Keller , Marcus Rohrbach

Object-centric learning (OCL) aims to learn structured scene representations that support compositional generalization and robustness to out-of-distribution (OOD) data. However, OCL models are often not evaluated regarding these goals.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Krishnakant Singh , Simone Schaub-Meyer , Stefan Roth

Object detection, one of the most fundamental and challenging problems in computer vision, seeks to locate object instances from a large number of predefined categories in natural images. Deep learning techniques have emerged as a powerful…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Li Liu , Wanli Ouyang , Xiaogang Wang , Paul Fieguth , Jie Chen , Xinwang Liu , Matti Pietikäinen

To recognize objects of the unseen classes, most existing Zero-Shot Learning(ZSL) methods first learn a compatible projection function between the common semantic space and the visual space based on the data of source seen classes, then…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Ziyu Wan , Dongdong Chen , Yan Li , Xingguang Yan , Junge Zhang , Yizhou Yu , Jing Liao

In real-world recognition/classification tasks, limited by various objective factors, it is usually difficult to collect training samples to exhaust all classes when training a recognizer or classifier. A more realistic scenario is open set…

Machine Learning · Computer Science 2020-03-24 Chuanxing Geng , Sheng-jun Huang , Songcan Chen

Zero-shot learning (ZSL) has received increasing attention in recent years especially in areas of fine-grained object recognition, retrieval, and image captioning. The key to ZSL is to transfer knowledge from the seen to the unseen classes…

Machine Learning · Computer Science 2020-02-12 Zhizhe Liu , Xingxing Zhang , Zhenfeng Zhu , Shuai Zheng , Yao Zhao , Jian Cheng

Zero-shot learning, which studies the problem of object classification for categories for which we have no training examples, is gaining increasing attention from community. Most existing ZSL methods exploit deterministic transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Yanan Li , Donghui Wang

Because it is not feasible to collect training data for every language, there is a growing interest in cross-lingual transfer learning. In this paper, we systematically explore zero-shot cross-lingual transfer learning on reading…

Computation and Language · Computer Science 2019-09-23 Tsung-yuan Hsu , Chi-liang Liu , Hung-yi Lee

The performance of generative zero-shot methods mainly depends on the quality of generated features and how well the model facilitates knowledge transfer between visual and semantic domains. The quality of generated features is a direct…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Shivam Chandhok , Vineeth N Balasubramanian

The aim of object-centric vision is to construct an explicit representation of the objects in a scene. This representation is obtained via a set of interchangeable modules called \emph{slots} or \emph{object files} that compete for local…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Ayush Chakravarthy , Trang Nguyen , Anirudh Goyal , Yoshua Bengio , Michael C. Mozer

Given the complexities inherent in visual scenes, such as object occlusion, a comprehensive understanding often requires observation from multiple viewpoints. Existing multi-viewpoint object-centric learning methods typically employ random…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Yinxuan Huang , Chengmin Gao , Bin Li , Xiangyang Xue

We report on an extensive study of the benefits and limitations of current deep learning approaches to object recognition in robot vision scenarios, introducing a novel dataset used for our investigation. To avoid the biases in currently…

Robotics · Computer Science 2021-08-25 Giulia Pasquale , Carlo Ciliberto , Francesca Odone , Lorenzo Rosasco , Lorenzo Natale

We tackle the task of scalable unsupervised object-centric representation learning on 3D scenes. Existing approaches to object-centric representation learning show limitations in generalizing to larger scenes as their learning processes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Tianyu Wang , Kee Siong Ng , Miaomiao Liu

Learning an egocentric action recognition model from video data is challenging due to distractors (e.g., irrelevant objects) in the background. Further integrating object information into an action model is hence beneficial. Existing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Victor Escorcia , Ricardo Guerrero , Xiatian Zhu , Brais Martinez

Generalized zero-shot learning recognizes inputs from both seen and unseen classes. Yet, existing methods tend to be biased towards the classes seen during training. In this paper, we strive to mitigate this bias. We propose a bias-aware…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 William Thong , Cees G. M. Snoek

Zero-shot learning (ZSL) aims to recognize unseen image categories by learning an embedding space between image and semantic representations. For years, among existing works, it has been the center task to learn the proper mapping matrices…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Yan Li , Junge Zhang , Jianguo Zhang , Kaiqi Huang

We study inferring 3D object-centric scene representations from a single image. While recent methods have shown potential in unsupervised 3D object discovery from simple synthetic images, they fail to generalize to real-world scenes with…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Rundong Luo , Hong-Xing Yu , Jiajun Wu

Developing deep learning models that effectively learn object-centric representations, akin to human cognition, remains a challenging task. Existing approaches facilitate object discovery by representing objects as fixed-size vectors,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Aniket Didolkar , Anirudh Goyal , Yoshua Bengio