English
Related papers

Related papers: Zero-shot generalization across architectures for …

200 papers

A major challenge in understanding the generalization of deep learning is to explain why (stochastic) gradient descent can exploit the network architecture to find solutions that have good generalization performance when using high capacity…

Machine Learning · Computer Science 2019-02-12 Yifan Wu , Barnabas Poczos , Aarti Singh

Zero-shot learning relies on semantic class representations such as hand-engineered attributes or learned embeddings to predict classes without any labeled examples. We propose to learn class representations by embedding nodes from common…

Machine Learning · Computer Science 2022-08-29 Nihal V. Nayak , Stephen H. Bach

Zero-shot object recognition or zero-shot learning aims to transfer the object recognition ability among the semantically related categories, such as fine-grained animal or bird species. However, the images of different fine-grained objects…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Zongyan Han , Zhenyong Fu , Jian Yang

Zero-shot learning (ZSL) is a challenging problem that aims to recognize the target categories without seen data, where semantic information is leveraged to transfer knowledge from some source classes. Although ZSL has made great progress…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Huajie Jiang , Ruiping Wang , Shiguang Shan , Xilin Chen

Despite their overwhelming capacity to overfit, deep learning architectures tend to generalize relatively well to unseen data, allowing them to be deployed in practice. However, explaining why this is the case is still an open area of…

Machine Learning · Computer Science 2017-11-15 Laurent Dinh , Razvan Pascanu , Samy Bengio , Yoshua Bengio

Multi-label zero-shot classification aims to predict multiple unseen class labels for an input image. It is more challenging than its single-label counterpart. On one hand, the unconstrained number of labels assigned to each image makes the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 He Huang , Yuanwei Chen , Wei Tang , Wenhao Zheng , Qing-Guo Chen , Yao Hu , Philip Yu

In recent years, there has been a surge in applying deep learning to various challenging design problems in communication networks. The early attempts adopt neural architectures inherited from applications such as computer vision, which…

Information Theory · Computer Science 2022-03-22 Yifei Shen , Jun Zhang , Khaled B. Letaief

Zero-Shot Learning (ZSL) aims to transfer classification capability from seen to unseen classes. Recent methods have proved that generalization and specialization are two essential abilities to achieve good performance in ZSL. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Yun Li , Zhe Liu , Xiaojun Chang , Julian McAuley , Lina Yao

A well trained and generalized deep neural network (DNN) should be robust to both seen and unseen classes. However, the performance of most of the existing supervised DNN algorithms degrade for classes which are unseen in the training set.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Rohit Keshari , Richa Singh , Mayank Vatsa

This paper studies the problem of generalized zero-shot learning which requires the model to train on image-label pairs from some seen classes and test on the task of classifying new images from both seen and unseen classes. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 He Huang , Changhu Wang , Philip S. Yu , Chang-Dong Wang

Networks are a powerful tool to model complex systems, and the definition of many Graph Neural Networks (GNN), Deep Learning algorithms that can handle networks, has opened a new way to approach many real-world problems that would be hardly…

Machine Learning · Computer Science 2021-09-28 Marco Grassia , Manlio De Domenico , Giuseppe Mangioni

The last decade has seen blossoming research in deep learning theory attempting to answer, "Why does deep learning generalize?" A powerful shift in perspective precipitated this progress: the study of overparametrized models in the…

Machine Learning · Statistics 2024-06-18 Patrik Reizinger , Szilvia Ujváry , Anna Mészáros , Anna Kerekes , Wieland Brendel , Ferenc Huszár

Deep learning has been widely applied and brought breakthroughs in speech recognition, computer vision, and many other domains. The involved deep neural network architectures and computational issues have been well studied in machine…

Machine Learning · Computer Science 2018-07-23 Ding-Xuan Zhou

In Zero-shot learning (ZSL), we classify unseen categories using textual descriptions about their expected appearance when observed (class embeddings) and a disjoint pool of seen classes, for which annotated visual data are accessible. We…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Jacopo Cavazza

Zero-shot learning (ZSL) aims to classify images of an unseen class only based on a few attributes describing that class but no access to any training sample. A popular strategy is to learn a mapping between the semantic space of class…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Lu Liu , Tianyi Zhou , Guodong Long , Jing Jiang , Xuanyi Dong , Chengqi Zhang

Zero-shot learning (ZSL) is concerned with the recognition of previously unseen classes. It relies on additional semantic knowledge for which a mapping can be learned with training examples of seen classes. While classical ZSL considers the…

Machine Learning · Computer Science 2019-01-16 Yannick Le Cacheux , Hervé Le Borgne , Michel Crucianu

Despite the celebrated popularity of Graph Neural Networks (GNNs) across numerous applications, the ability of GNNs to generalize remains less explored. In this work, we propose to study the generalization of GNNs through a novel…

Machine Learning · Computer Science 2024-04-17 Shouheng Li , Dongwoo Kim , Qing Wang

While convolutional neural networks (CNNs) have recently made great strides in supervised classification of data structured on a grid (e.g. images composed of pixel grids), in several interesting datasets, the relations between features can…

Machine Learning · Computer Science 2018-11-02 Shrey Gadiya , Deepak Anand , Amit Sethi

That shared features between train and test data are required for generalisation in artificial neural networks has been a common assumption of both proponents and critics of these models. Here, we show that convolutional architectures avoid…

Neural and Evolutionary Computing · Computer Science 2021-07-15 Jeff Mitchell , Jeffrey S. Bowers

Graph Convolutional Networks (GCNs) are a class of general models that can learn from graph structured data. Despite being general, GCNs are admittedly inferior to convolutional neural networks (CNNs) when applied to vision tasks, mainly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Boris Knyazev , Xiao Lin , Mohamed R. Amer , Graham W. Taylor