English
Related papers

Related papers: Beyond One-Hot-Encoding: Injecting Semantics to Dr…

200 papers

Sequence classification is the supervised learning task of building models that predict class labels of unseen sequences of symbols. Although accuracy is paramount, in certain scenarios interpretability is a must. Unfortunately, such…

Machine Learning · Computer Science 2020-06-26 Severin Gsponer , Luca Costabello , Chan Le Van , Sumit Pai , Christophe Gueret , Georgiana Ifrim , Freddy Lecue

Using class labels to represent class similarity is a typical approach to training deep hashing systems for retrieval; samples from the same or different classes take binary 1 or 0 similarity values. This similarity does not model the full…

Information Retrieval · Computer Science 2019-08-16 Heikki Arponen , Tom E Bishop

Modelling taxonomic and thematic relatedness is important for building AI with comprehensive natural language understanding. The goal of this paper is to learn more about how taxonomic information is structurally encoded in embeddings. To…

Computation and Language · Computer Science 2023-01-26 Filip Klubička , John D. Kelleher

Heatmaps generated on inputs of image classification networks via explainable AI methods like Grad-CAM and LRP have been observed to resemble segmentations of input images in many cases. Consequently, heatmaps have also been leveraged for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Xiaoyan Yu , Jannik Franzen , Wojciech Samek , Marina M. -C. Höhne , Dagmar Kainmueller

Large multimodal models such as Stable Diffusion can generate, detect, and classify new visual concepts after fine-tuning just a single word embedding. Do models learn similar words for the same concepts (i.e. <orange-cat> = orange + cat)?…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Brandon Trabucco , Max Gurinas , Kyle Doherty , Ruslan Salakhutdinov

It has been reliably shown that the similarity of word embeddings obtained from popular neural models such as BERT approximates effectively a form of semantic similarity of the meaning of those words. It is therefore natural to wonder if…

Artificial Intelligence · Computer Science 2024-08-02 Mathieu d'Aquin , Emmanuel Nauer

Most of existing work learn sentiment-specific word representation for improving Twitter sentiment classification, which encoded both n-gram and distant supervised tweet sentiment information in learning process. They assume all words…

Computation and Language · Computer Science 2018-05-30 Shufeng Xiong

This paper presents an approach for investigating the nature of semantic information captured by word embeddings. We propose a method that extends an existing human-elicited semantic property dataset with gold negative examples using crowd…

Computation and Language · Computer Science 2018-09-06 Pia Sommerauer , Antske Fokkens

Text-to-image generation models suffer from alignment problems, where generated images fail to accurately capture the objects and relations in the text prompt. Prior work has focused on improving alignment by refining the diffusion process,…

Computation and Language · Computer Science 2026-04-20 Guy Kaplan , Michael Toker , Yuval Reif , Yonatan Belinkov , Roy Schwartz

The words of a language reflect the structure of the human mind, allowing us to transmit thoughts between individuals. However, language can represent only a subset of our rich and detailed cognitive architecture. Here, we ask what kinds of…

Computation and Language · Computer Science 2018-03-07 Gabriel Grand , Idan Asher Blank , Francisco Pereira , Evelina Fedorenko

Leveraging multiple training datasets to scale up image segmentation models is beneficial for increasing robustness and semantic understanding. Individual datasets have well-defined ground truth with non-overlapping mask layouts and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Di Liu , Abhishek Aich , Dimitris Metaxas , Samuel Schulter

In this work, we propose a novel supervised contrastive loss that enables the integration of taxonomic hierarchy information during the representation learning process. A supervised contrastive loss operates by enforcing that images with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Kiran Kokilepersaud , Yavuz Yarici , Mohit Prabhushankar , Ghassan AlRegib

Recent work shows that documents from encyclopedias serve as helpful auxiliary information for zero-shot learning. Existing methods align the entire semantics of a document with corresponding images to transfer knowledge. However, they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Xiangyan Qu , Jing Yu , Keke Gai , Jiamin Zhuang , Yuanmin Tang , Gang Xiong , Gaopeng Gou , Qi Wu

There is extensive interest in metric learning methods for image retrieval. Many metric learning loss functions focus on learning a correct ranking of training samples, but strongly overfit semantically inconsistent labels and require a…

Machine Learning · Computer Science 2023-06-05 Christopher Liao , Theodoros Tsiligkaridis , Brian Kulis

We study the problem of automatically building hypernym taxonomies from textual and visual data. Previous works in taxonomy induction generally ignore the increasingly prominent visual data, which encode important perceptual semantics.…

Computation and Language · Computer Science 2016-06-30 Hao Zhang , Zhiting Hu , Yuntian Deng , Mrinmaya Sachan , Zhicheng Yan , Eric P. Xing

Class labels used for machine learning are relatable to each other, with certain class labels being more similar to each other than others (e.g. images of cats and dogs are more similar to each other than those of cats and cars). Such…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Gautam Rajendrakumar Gare , John Michael Galeotti

Current approaches to learning semantic representations of sentences often use prior word-level knowledge. The current study aims to leverage visual information in order to capture sentence level semantics without the need for word…

Computation and Language · Computer Science 2019-09-25 Danny Merkx , Stefan Frank

Using a vocabulary that is shared across languages is common practice in Multilingual Neural Machine Translation (MNMT). In addition to its simple design, shared tokens play an important role in positive knowledge transfer, assuming that…

Computation and Language · Computer Science 2024-01-23 Di Wu , Christof Monz

Image classification has advanced significantly in recent years with the availability of large-scale image sets. However, fine-grained classification remains a major challenge due to the annotation cost of large numbers of fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2016-04-21 Zeynep Akata , Scott Reed , Daniel Walter , Honglak Lee , Bernt Schiele

Many approaches to semantic image hashing have been formulated as supervised learning problems that utilize images and label information to learn the binary hash codes. However, large-scale labeled image data is expensive to obtain, thus…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Vijetha Gattupalli , Yaoxin Zhuo , Baoxin Li