English
Related papers

Related papers: Open Named Entity Modeling from Embedding Distribu…

200 papers

We introduce a new entity typing task: given a sentence with an entity mention, the goal is to predict a set of free-form phrases (e.g. skyscraper, songwriter, or criminal) that describe appropriate types for the target entity. This…

Computation and Language · Computer Science 2018-07-16 Eunsol Choi , Omer Levy , Yejin Choi , Luke Zettlemoyer

The task of Named Entity Recognition (NER) is an important component of many natural language processing systems, such as relation extraction and knowledge graph construction. In this work, we present a simple and effective approach for…

Computation and Language · Computer Science 2022-03-29 Urchade Zaratiana , Pierre Holat , Nadi Tomeh , Thierry Charnois

As a fundamental natural language processing task and one of core knowledge extraction techniques, named entity recognition (NER) is widely used to extract information from texts for downstream tasks. Nested NER is a branch of NER in which…

Computation and Language · Computer Science 2022-04-19 Yifei Yang , Zuchao Li , Hai Zhao

Most unsupervised NLP models represent each word with a single point or single region in semantic space, while the existing multi-sense word embeddings cannot represent longer word sequences like phrases or sentences. We propose a novel…

Computation and Language · Computer Science 2021-12-30 Haw-Shiuan Chang , Amol Agrawal , Andrew McCallum

In this work we approach the task of learning multilingual word representations in an offline manner by fitting a generative latent variable model to a multilingual dictionary. We model equivalent words in different languages as different…

Machine Learning · Computer Science 2019-10-25 Francisco Vargas , Kamen Brestnichki , Alex Papadopoulos-Korfiatis , Nils Hammerla

Word embeddings have become a standard resource in the toolset of any Natural Language Processing practitioner. While monolingual word embeddings encode information about words in the context of a particular language, cross-lingual…

Computation and Language · Computer Science 2020-11-12 Yerai Doval , Jose Camacho-Collados , Luis Espinosa-Anke , Steven Schockaert

Natural language definitions possess a recursive, self-explanatory semantic structure that can support representation learning methods able to preserve explicit conceptual relations and constraints in the latent space. This paper presents a…

Computation and Language · Computer Science 2024-02-19 Marco Valentino , Danilo S. Carvalho , André Freitas

Statements about entities occur everywhere, from newspapers and web pages to structured databases. Correlating references to entities across systems that use different identifiers or names for them is a widespread problem. In this paper, we…

Artificial Intelligence · Computer Science 2014-06-27 R. V. Guha

The meaning of a word often varies depending on its usage in different domains. The standard word embedding models struggle to represent this variation, as they learn a single global representation for a word. We propose a method to learn…

Computation and Language · Computer Science 2019-10-22 Lahari Poddar , Gyorgy Szarvas , Lea Frermann

Most of the Natural Language Processing systems are involved in entity-based processing for several tasks like Information Extraction, Question-Answering, Text-Summarization and so on. A new challenge comes when entities play roles…

Computation and Language · Computer Science 2025-11-11 Neelesh Kumar Shukla , Sanasam Ranbir Singh

There are two main approaches to the distributed representation of words: low-dimensional deep learning embeddings and high-dimensional distributional models, in which each dimension corresponds to a context word. In this paper, we combine…

Computation and Language · Computer Science 2014-02-19 Irina Sergienya , Hinrich Schütze

In this research, we improve upon the current state of the art in entity retrieval by re-ranking the result list using graph embeddings. The paper shows that graph embeddings are useful for entity-oriented search tasks. We demonstrate…

Information Retrieval · Computer Science 2020-05-07 Emma J. Gerritse , Faegheh Hasibi , Arjen P. de Vries

Traditional language models are unable to efficiently model entity names observed in text. All but the most popular named entities appear infrequently in text providing insufficient context. Recent efforts have recognized that context can…

Computation and Language · Computer Science 2019-06-25 Angli Liu , Jingfei Du , Veselin Stoyanov

In the last years, the consolidation of deep neural network architectures for information extraction in document images has brought big improvements in the performance of each of the tasks involved in this process, consisting of text…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Manuel Carbonell , Alicia Fornés , Mauricio Villegas , Josep Lladós

Word embeddings are usually derived from corpora containing text from many individuals, thus leading to general purpose representations rather than individually personalized representations. While personalized embeddings can be useful to…

Computation and Language · Computer Science 2020-11-22 Charles Welch , Jonathan K. Kummerfeld , Verónica Pérez-Rosas , Rada Mihalcea

Word Embeddings are used widely in multiple Natural Language Processing (NLP) applications. They are coordinates associated with each word in a dictionary, inferred from statistical properties of these words in a large corpus. In this paper…

Computation and Language · Computer Science 2020-06-18 Adam Sutton , Nello Cristianini

Despite their remarkable ability to capture linguistic nuances across diverse languages, questions persist regarding the degree of alignment between languages in multilingual embeddings. Drawing inspiration from research on high-dimensional…

Computation and Language · Computer Science 2024-05-24 Basel Mousi , Nadir Durrani , Fahim Dalvi , Majd Hawasly , Ahmed Abdelali

How can we represent hierarchical information present in large type inventories for entity typing? We study the ability of hyperbolic embeddings to capture hierarchical relations between mentions in context and their target types in a…

Computation and Language · Computer Science 2019-06-07 Federico López , Benjamin Heinzerling , Michael Strube

The hypergraph-of-entity was conceptually proposed as a general model for entity-oriented search. However, only the performance for ad hoc document retrieval had been assessed. We continue this line of research by also evaluating ad hoc…

Information Retrieval · Computer Science 2021-09-02 José Devezas , Sérgio Nunes

Topic modeling analyzes documents to learn meaningful patterns of words. However, existing topic models fail to learn interpretable topics when working with large and heavy-tailed vocabularies. To this end, we develop the Embedded Topic…

Information Retrieval · Computer Science 2019-07-12 Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei