English
Related papers

Related papers: Exploring Neural Entity Representations for Semant…

200 papers

Text embedding representing natural language documents in a semantic vector space can be used for document retrieval using nearest neighbor lookup. In order to study the feasibility of neural models specialized for retrieval in a…

Information Retrieval · Computer Science 2019-05-03 Tolgahan Cakaloglu , Christian Szegedy , Xiaowei Xu

Modelling semantic similarity plays a fundamental role in lexical semantic applications. A natural way of calculating semantic similarity is to access handcrafted semantic networks, but similarity prediction can also be anticipated in a…

Computation and Language · Computer Science 2022-10-03 Dongqiang Yang , Yanqin Yin

This paper describes a hypernym discovery system for our participation in the SemEval-2018 Task 9, which aims to discover the best (set of) candidate hypernyms for input concepts or entities, given the search space of a pre-defined…

Computation and Language · Computer Science 2018-05-29 Zhuosheng Zhang , Jiangtong Li , Hai Zhao , Bingjie Tang

Neural network techniques are widely applied to obtain high-quality distributed representations of words, i.e., word embeddings, to address text mining, information retrieval, and natural language processing tasks. Recently, efficient…

Computation and Language · Computer Science 2014-09-08 Qing Cui , Bin Gao , Jiang Bian , Siyu Qiu , Tie-Yan Liu

We propose a new uniform framework for text classification and ranking that can automate the process of identifying check-worthy sentences in political debates and speech transcripts. Our framework combines the semantic analysis of the…

Computation and Language · Computer Science 2022-11-22 Ting Su , Craig Macdonald , Iadh Ounis

Word embeddings are already well studied in the general domain, usually trained on large text corpora, and have been evaluated for example on word similarity and analogy tasks, but also as an input to downstream NLP processes. In contrast,…

Computation and Language · Computer Science 2023-10-04 Gerhard Wohlgenannt , Ariadna Barinova , Dmitry Ilvovsky , Ekaterina Chernyak

We propose a lightly-supervised approach for information extraction, in particular named entity classification, which combines the benefits of traditional bootstrapping, i.e., use of limited annotations and interpretability of extraction…

Computation and Language · Computer Science 2018-05-30 Marco A. Valenzuela-Escárcega , Ajay Nagesh , Mihai Surdeanu

Word embeddings have advanced the state of the art in NLP across numerous tasks. Understanding the contents of dense neural representations is of utmost interest to the computational semantics community. We propose to focus on relating…

Computation and Language · Computer Science 2022-05-30 Timothee Mickus , Kees van Deemter , Mathieu Constant , Denis Paperno

Embeddings have become a pivotal means to represent complex, multi-faceted information about entities, concepts, and relationships in a condensed and useful format. Nevertheless, they often preclude direct interpretation. While downstream…

Deep Learning and Machine Learning based models have become extremely popular in text processing and information retrieval. However, the non-linear structures present inside the networks make these models largely inscrutable. A significant…

Information Retrieval · Computer Science 2026-03-12 Sourav Saha , Debapriyo Majumdar , Mandar Mitra

Entity alignment (EA) aims to find equivalent entities between two Knowledge Graphs. Existing embedding-based EA methods usually encode entities as embeddings, triples as embeddings' constraint and learn to align the embeddings. However,…

Computation and Language · Computer Science 2024-11-28 Chuanhao Xu , Jingwei Cheng , Fu Zhang

Entity disambiguation, or mapping a phrase to its canonical representation in a knowledge base, is a fundamental step in many natural language processing applications. Existing techniques based on global ranking models fail to capture the…

Computation and Language · Computer Science 2016-04-21 Tiep Mai , Bichen Shi , Patrick K. Nicholson , Deepak Ajwani , Alessandra Sala

Deep learning currently dominates the benchmarks for various NLP tasks and, at the basis of such systems, words are frequently represented as embeddings --vectors in a low dimensional space-- learned from large text corpora and various…

Computation and Language · Computer Science 2019-09-25 Ronald Denaux , Jose Manuel Gomez-Perez

Word embeddings are widely used in Natural Language Processing, mainly due to their success in capturing semantic information from massive corpora. However, their creation process does not allow the different meanings of a word to be…

Computation and Language · Computer Science 2017-06-22 Massimiliano Mancini , Jose Camacho-Collados , Ignacio Iacobacci , Roberto Navigli

Neural entity typing models typically represent fine-grained entity types as vectors in a high-dimensional space, but such spaces are not well-suited to modeling these types' complex interdependencies. We study the ability of box…

Computation and Language · Computer Science 2021-06-04 Yasumasa Onoe , Michael Boratko , Andrew McCallum , Greg Durrett

There have been many successful applications of sentence embedding methods. However, it has not been well understood what properties are captured in the resulting sentence embeddings depending on the supervision signals. In this paper, we…

Computation and Language · Computer Science 2022-06-13 Hayato Tsukagoshi , Ryohei Sasano , Koichi Takeda

We present an unsupervised approach for discovering semantic representations of mathematical equations. Equations are challenging to analyze because each is unique, or nearly unique. Our method, which we call equation embeddings, finds good…

Machine Learning · Statistics 2018-03-28 Kriste Krstovski , David M. Blei

This paper introduces a novel neural network model for question answering, the \emph{entity-based memory network}. It enhances neural networks' ability of representing and calculating information over a long period by keeping records of…

Computation and Language · Computer Science 2024-02-23 Xun Wang , Katsuhito Sudoh , Masaaki Nagata , Tomohide Shibata , Daisuke Kawahara , Sadao Kurohashi

Traditional neural embeddings represent concepts as points, excelling at similarity but struggling with higher-level reasoning and asymmetric relationships. We introduce a novel paradigm: embedding concepts as linear subspaces. This…

Machine Learning · Computer Science 2025-08-26 Gabriel Moreira , Zita Marinho , Manuel Marques , João Paulo Costeira , Chenyan Xiong

Neural language models learn word representations that capture rich linguistic and conceptual information. Here we investigate the embeddings learned by neural machine translation models. We show that translation-based embeddings outperform…

Computation and Language · Computer Science 2014-11-14 Felix Hill , KyungHyun Cho , Sebastien Jean , Coline Devin , Yoshua Bengio