English
Related papers

Related papers: Ered: Enhanced Text Representations with Entities …

200 papers

Low-dimensional embeddings of knowledge graphs and behavior graphs have proved remarkably powerful in varieties of tasks, from predicting unobserved edges between entities to content recommendation. The two types of graphs can contain…

Machine Learning · Computer Science 2019-08-29 Yuting Ye , Xuwu Wang , Jiangchao Yao , Kunyang Jia , Jingren Zhou , Yanghua Xiao , Hongxia Yang

Named entity recognition in real-world applications suffers from the diversity of entity types, the emergence of new entity types, and the lack of high-quality annotations. To address the above problems, this paper proposes an in-context…

Computation and Language · Computer Science 2023-05-29 Jiawei Chen , Yaojie Lu , Hongyu Lin , Jie Lou , Wei Jia , Dai Dai , Hua Wu , Boxi Cao , Xianpei Han , Le Sun

We introduce the task of entity-centric query refinement. Given an input query whose answer is a (potentially large) collection of entities, the task output is a small set of query refinements meant to assist the user in efficient domain…

Computation and Language · Computer Science 2022-09-19 David Wadden , Nikita Gupta , Kenton Lee , Kristina Toutanova

Much of human knowledge is encoded in text, available in scientific publications, books, and the web. Given the rapid growth of these resources, we need automated methods to extract such knowledge into machine-processable structures, such…

Information Retrieval · Computer Science 2019-07-02 Shobeir Fakhraei , Joel Mathew , Jose Luis Ambite

Ever-larger language models with ever-increasing capabilities are by now well-established text processing tools. Alas, information extraction tasks such as named entity recognition are still largely unaffected by this progress as they are…

Computation and Language · Computer Science 2023-08-16 Tobias Deußer , Lars Hillebrand , Christian Bauckhage , Rafet Sifa

We present a novel language representation model enhanced by knowledge called ERNIE (Enhanced Representation through kNowledge IntEgration). Inspired by the masking strategy of BERT, ERNIE is designed to learn language representation…

Computation and Language · Computer Science 2019-04-22 Yu Sun , Shuohuan Wang , Yukun Li , Shikun Feng , Xuyi Chen , Han Zhang , Xin Tian , Danxiang Zhu , Hao Tian , Hua Wu

Entity resolution (ER) is the task of identifying different representations of the same real-world entities across databases. It is a key step for knowledge base creation and text mining. Recent adaptation of deep learning methods for ER…

Databases · Computer Science 2019-06-20 Jungo Kasai , Kun Qian , Sairam Gurajada , Yunyao Li , Lucian Popa

Entity linking (EL) is the task of automatically identifying entity mentions in text and resolving them to a corresponding entity in a reference knowledge base like Wikipedia. Throughout the past decade, a plethora of EL systems and…

Computation and Language · Computer Science 2021-01-15 Renato Stoffalette João , Pavlos Fafalios , Stefan Dietze

Knowledge graphs can represent information about the real-world using entities and their relations in a structured and semantically rich manner and they enable a variety of downstream applications such as question-answering, recommendation…

Computation and Language · Computer Science 2023-05-16 Hanieh Khorashadizadeh , Nandana Mihindukulasooriya , Sanju Tiwari , Jinghua Groppe , Sven Groppe

Recent works on representation learning for Knowledge Graphs have moved beyond the problem of link prediction, to answering queries of an arbitrary structure. Existing methods are based on ad-hoc mechanisms that require training with a…

Artificial Intelligence · Computer Science 2020-06-25 Daniel Daza , Michael Cochez

Large language models (LLMs) acquire knowledge across diverse domains such as science, history, and geography encountered during generative pre-training. However, due to their stochasticity, it is difficult to predict what LLMs have…

Computation and Language · Computer Science 2026-01-27 Kartik Sharma , Yiqiao Jin , Rakshit Trivedi , Srijan Kumar

Entity alignment is to find identical entities in different knowledge graphs (KGs) that refer to the same real-world object. Embedding-based entity alignment techniques have been drawing a lot of attention recently because they can help…

Computation and Language · Computer Science 2022-11-08 Xiaobin Tian , Zequn Sun , Guangyao Li , Wei Hu

When training data is scarce, the incorporation of additional prior knowledge can assist the learning process. While it is common to initialize neural networks with weights that have been pre-trained on other large data sets, pre-training…

Machine Learning · Computer Science 2022-05-24 Laura von Rueden , Sebastian Houben , Kostadin Cvejoski , Christian Bauckhage , Nico Piatkowski

Knowledge editing methods for large language models are commonly evaluated using predefined benchmarks that assess edited facts together with a limited set of related or neighboring knowledge. While effective, such evaluations remain…

Computation and Language · Computer Science 2026-05-12 Shuainan Liu , Xuanang Chen , Ben He , Le Sun

Knowledge graph (KG) entity typing aims at inferring possible missing entity type instances in KG, which is a very significant but still under-explored subtask of knowledge graph completion. In this paper, we propose a novel approach for KG…

Computation and Language · Computer Science 2020-07-22 Yu Zhao , Anxiang Zhang , Ruobing Xie , Kang Liu , Xiaojie Wang

Fine-grained entity typing is the task of assigning fine-grained semantic types to entity mentions. We propose a neural architecture which learns a distributional semantic representation that leverages a greater amount of semantic context…

Computation and Language · Computer Science 2018-04-24 Sheng Zhang , Kevin Duh , Benjamin Van Durme

Due to their capacity to acquire world knowledge from large corpora, pre-trained language models (PLMs) are extensively used in ultra-fine entity typing tasks where the space of labels is extremely large. In this work, we explore the…

Computation and Language · Computer Science 2026-04-28 Advait Deshmukh , Ashwin Umadi , Dananjay Srinivas , Maria Leonor Pacheco

Entity Typing (ET) is the process of identifying the semantic types of every entity within a corpus. In contrast to Named Entity Recognition, where each token in a sentence is labelled with zero or one class label, ET involves labelling…

Computation and Language · Computer Science 2020-03-24 Michael Stewart , Wei Liu

Entity disambiguation (ED), which links the mentions of ambiguous entities to their referent entities in a knowledge base, serves as a core component in entity linking (EL). Existing generative approaches demonstrate improved accuracy…

Computation and Language · Computer Science 2024-05-09 Junxiong Wang , Ali Mousavi , Omar Attia , Ronak Pradeep , Saloni Potdar , Alexander M. Rush , Umar Farooq Minhas , Yunyao Li

Word embeddings have gained significant attention as learnable representations of semantic relations between words, and have been shown to improve upon the results of traditional word representations. However, little effort has been devoted…

Information Retrieval · Computer Science 2019-05-23 Gloria Feher , Andreas Spitz , Michael Gertz