English
Related papers

Related papers: Learning to embed semantic similarity for joint im…

200 papers

In natural language processing (NLP) of spoken languages, word embeddings have been shown to be a useful method to encode the meaning of words. Sign languages are visual languages, which require sign embeddings to capture the visual and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Ryan Wong , Necati Cihan Camgoz , Richard Bowden

Assessing the degree of semantic relatedness between words is an important task with a variety of semantic applications, such as ontology learning for the Semantic Web, semantic search or query expansion. To accomplish this in an automated…

Computation and Language · Computer Science 2017-05-25 Thomas Niebler , Martin Becker , Christian Pölitz , Andreas Hotho

Named Entity Disambiguation (NED) refers to the task of resolving multiple named entity mentions in a document to their correct references in a knowledge base (KB) (e.g., Wikipedia). In this paper, we propose a novel embedding method…

Computation and Language · Computer Science 2016-06-13 Ikuya Yamada , Hiroyuki Shindo , Hideaki Takeda , Yoshiyasu Takefuji

Unsupervised text embedding has shown great power in a wide range of NLP tasks. While text embeddings are typically learned in the Euclidean space, directional similarity is often more effective in tasks such as word similarity and document…

Computation and Language · Computer Science 2019-11-05 Yu Meng , Jiaxin Huang , Guangyuan Wang , Chao Zhang , Honglei Zhuang , Lance Kaplan , Jiawei Han

In this paper, we focus on training and evaluating effective word embeddings with both text and visual information. More specifically, we introduce a large-scale dataset with 300 million sentences describing over 40 million images crawled…

Machine Learning · Computer Science 2016-11-28 Junhua Mao , Jiajing Xu , Yushi Jing , Alan Yuille

Data similarity is a key concept in many data-driven applications. Many algorithms are sensitive to similarity measures. To tackle this fundamental problem, automatically learning of similarity information from data via self-expression has…

Machine Learning · Computer Science 2019-03-12 Zhao Kang , Yiwei Lu , Yuanzhang Su , Changsheng Li , Zenglin Xu

In most image retrieval systems, images include various high-level semantics, called tags or annotations. Virtually all the state-of-the-art image annotation methods that handle imbalanced labeling are search-based techniques which are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Seyed Mahdi Roostaiyan , Mohammad Mehdi Hosseini , Mahya Mohammadi Kashani , S. Hamid Amiri

To improve the classification performance in the context of hyperspectral image processing, many works have been developed based on two common strategies, namely the spatial-spectral information integration and the utilization of neural…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Yi Liang , Xin Zhao , Alan J. X. Guo , Fei Zhu

Recent advances in AI have catalyzed the adoption of intelligent educational tools, yet many semantic retrieval systems remain ill-suited to the unique linguistic and structural characteristics of academic content. This study presents two…

Computation and Language · Computer Science 2025-05-09 Ramteja Sajja , Yusuf Sermet , Ibrahim Demir

Recent methods for deep metric learning have been focusing on designing different contrastive loss functions between positive and negative pairs of samples so that the learned feature embedding is able to pull positive samples of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Shichao Kan , Zhiquan He , Yigang Cen , Yang Li , Vladimir Mladenovic , Zhihai He

Word embedding is designed to represent the semantic meaning of a word with low dimensional vectors. The state-of-the-art methods of learning word embeddings (word2vec and GloVe) only use the word co-occurrence information. The learned…

Computation and Language · Computer Science 2018-09-11 Ruixuan Luo

There has been significant interest recently in learning multilingual word embeddings -- in which semantically similar words across languages have similar embeddings. State-of-the-art approaches have relied on expensive labeled data, which…

Computation and Language · Computer Science 2020-07-02 Karan Singhal , Karthik Raman , Balder ten Cate

Learning the representation and the similarity metric in an end-to-end fashion with deep networks have demonstrated outstanding results for clustering and retrieval. However, these recent approaches still suffer from the performance…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Hyun Oh Song , Stefanie Jegelka , Vivek Rathod , Kevin Murphy

As is expressed in the adage "a picture is worth a thousand words", when using spoken language to communicate visual information, brevity can be a challenge. This work describes a novel technique for leveraging machine-learned feature…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-27 Andrew Port , Chelhwon Kim , Mitesh Patel

Learning depth from a single image, as an important issue in scene understanding, has attracted a lot of attention in the past decade. The accuracy of the depth estimation has been improved from conditional Markov random fields,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Lei He , Guanghui Wang , Zhanyi Hu

Learning similarity is a key aspect in medical image analysis, particularly in recommendation systems or in uncovering the interpretation of anatomical data in images. Most existing methods learn such similarities in the embedding space…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Sukesh Adiga , Jose Dolz , Herve Lombaert

Recent studies have shown that many deep metric learning loss functions perform very similarly under the same experimental conditions. One potential reason for this unexpected result is that all losses let the network focus on similar image…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Konstantin Kobs , Michael Steininger , Andrzej Dulny , Andreas Hotho

Cross-modal retrieval across image and text modalities is a challenging task due to its inherent ambiguity: An image often exhibits various situations, and a caption can be coupled with diverse images. Set-based embedding has been studied…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Dongwon Kim , Namyup Kim , Suha Kwak

Deep metric learning algorithms have been utilized to learn discriminative and generalizable models which are effective for classifying unseen classes. In this paper, a novel noise tolerant deep metric learning algorithm is proposed. The…

Machine Learning · Computer Science 2019-04-09 Soumyadeep Ghosh , Richa Singh , Mayank Vatsa

With the rapid development of multimodal learning, the image-text matching task, as a bridge connecting vision and language, has become increasingly important. Based on existing research, this study proposes an innovative visual semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Wenjing Chen