English
Related papers

Related papers: Choose Your Neuron: Incorporating Domain Knowledge…

200 papers

Zero-shot learning relies on semantic class representations such as hand-engineered attributes or learned embeddings to predict classes without any labeled examples. We propose to learn class representations by embedding nodes from common…

Machine Learning · Computer Science 2022-08-29 Nihal V. Nayak , Stephen H. Bach

The role of semantics in zero-shot learning is considered. The effectiveness of previous approaches is analyzed according to the form of supervision provided. While some learn semantics independently, others only supervise the semantic…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Pedro Morgado , Nuno Vasconcelos

Neural machine translation (NMT) models learn representations containing substantial linguistic information. However, it is not clear if such information is fully distributed or if some of it can be attributed to individual neurons. We…

Computation and Language · Computer Science 2018-11-06 Anthony Bau , Yonatan Belinkov , Hassan Sajjad , Nadir Durrani , Fahim Dalvi , James Glass

The need to address the scarcity of task-specific annotated data has resulted in concerted efforts in recent years for specific settings such as zero-shot learning (ZSL) and domain generalization (DG), to separately address the issues of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shivam Chandhok , Sanath Narayan , Hisham Cholakkal , Rao Muhammad Anwer , Vineeth N Balasubramanian , Fahad Shahbaz Khan , Ling Shao

We introduce the isoperimetric loss as a regularization criterion for learning the map from a visual representation to a semantic embedding, to be used to transfer knowledge to unknown classes in a zero-shot learning setting. We use a…

Machine Learning · Computer Science 2019-12-05 Shay Deutsch , Andrea Bertozzi , Stefano Soatto

One of the main challenges in Zero-Shot Learning of visual categories is gathering semantic attributes to accompany images. Recent work has shown that learning from textual descriptions, such as Wikipedia articles, avoids the problem of…

Machine Learning · Computer Science 2015-09-28 Jimmy Ba , Kevin Swersky , Sanja Fidler , Ruslan Salakhutdinov

A significant shortcoming of current state-of-the-art (SOTA) named-entity recognition (NER) systems is their lack of generalization to unseen domains, which poses a major problem since obtaining labeled data for NER in a new domain is…

Artificial Intelligence · Computer Science 2021-11-16 Nguyen Van Hoang , Soeren Hougaard Mulvad , Dexter Neo Yuan Rong , Yang Yue

We introduce a framework for reasoning about what meaning is captured by the neurons in a trained neural network. We provide a strategy for discovering meaning by training a second model (referred to as an observer model) to classify the…

Machine Learning · Computer Science 2021-03-16 Eric E. Allen

The recent successful deep neural networks are largely trained in a supervised manner. It {\it associates} complex patterns of input samples with neurons in the last layer, which form representations of {\it concepts}. In spite of their…

Machine Learning · Computer Science 2017-01-13 Shuai Li , Kui Jia , Xiaogang Wang

Zero-shot learning (ZSL) aims to recognize unseen image categories by learning an embedding space between image and semantic representations. For years, among existing works, it has been the center task to learn the proper mapping matrices…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Yan Li , Junge Zhang , Jianguo Zhang , Kaiqi Huang

Generalized zero-shot learning recognizes inputs from both seen and unseen classes. Yet, existing methods tend to be biased towards the classes seen during training. In this paper, we strive to mitigate this bias. We propose a bias-aware…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 William Thong , Cees G. M. Snoek

Several recent publications have proposed methods for mapping images into continuous semantic embedding spaces. In some cases the embedding space is trained jointly with the image transformation. In other cases the semantic embedding space…

Machine Learning · Computer Science 2017-02-28 Mohammad Norouzi , Tomas Mikolov , Samy Bengio , Yoram Singer , Jonathon Shlens , Andrea Frome , Greg S. Corrado , Jeffrey Dean

Zero-shot learning (ZSL) aims to recognize objects of novel classes without any training samples of specific classes, which is achieved by exploiting the semantic information and auxiliary datasets. Recently most ZSL approaches focus on…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Huajie Jiang , Ruiping Wang , Shiguang Shan , Xilin Chen

Existing semantic segmentation models heavily rely on dense pixel-wise annotations. To reduce the annotation pressure, we focus on a challenging task named zero-shot semantic segmentation, which aims to segment unseen objects with zero…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Zhangxuan Gu , Siyuan Zhou , Li Niu , Zihan Zhao , Liqing Zhang

We consider the problem of zero-shot recognition: learning a visual classifier for a category with zero training examples, just using the word embedding of the category and its relationship to other categories, which visual data are…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Xiaolong Wang , Yufei Ye , Abhinav Gupta

The ability of neural networks to continuously learn and adapt to new tasks while retaining prior knowledge is crucial for many applications. However, current neural networks tend to forget previously learned tasks when trained on new ones,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Sinan Özgür Özgün , Anne-Marie Rickmann , Abhijit Guha Roy , Christian Wachinger

Semantic Embeddings are a popular way to represent knowledge in the field of zero-shot learning. We observe their interpretability and discuss their potential utility in a safety-critical context. Concretely, we propose to use them to add…

Machine Learning · Statistics 2019-05-21 Thomas Brunner , Frederik Diehl , Michael Truong Le , Alois Knoll

Zero-shot learning (ZSL) aims to recognize unseen object classes without any training samples, which can be regarded as a form of transfer learning from seen classes to unseen ones. This is made possible by learning a projection between a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 An Zhao , Mingyu Ding , Jiechao Guan , Zhiwu Lu , Tao Xiang , Ji-Rong Wen

In this paper, we address an open problem of zero-shot learning. Its principle is based on learning a mapping that associates feature vectors extracted from i.e. images and attribute vectors that describe objects and/or scenes of interest.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Hongguang Zhang , Piotr Koniusz

Training deep neural networks from few examples is a highly challenging and key problem for many computer vision tasks. In this context, we are targeting knowledge transfer from a set with abundant data to other sets with few available…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard , Andrei Bursuc