English
Related papers

Related papers: Empirical Evaluation of Pretraining Strategies for…

200 papers

In this work, we present a web application named DBLPLink, which performs entity linking over the DBLP scholarly knowledge graph. DBLPLink uses text-to-text pre-trained language models, such as T5, to produce entity label spans from an…

Computation and Language · Computer Science 2023-09-26 Debayan Banerjee , Arefa , Ricardo Usbeck , Chris Biemann

Pre-trained language models such as BERT have been a key ingredient to achieve state-of-the-art results on a variety of tasks in natural language processing and, more recently, also in information retrieval.Recent research even claims that…

Information Retrieval · Computer Science 2022-05-03 Emma J. Gerritse , Faegheh Hasibi , Arjen P. de Vries

Named Entity Recognition (NER) is a fundamental Natural Language Processing (NLP) task to extract entities from unstructured data. The previous methods for NER were based on machine learning or deep learning. Recently, pre-training models…

Computation and Language · Computer Science 2020-02-21 Yu Wang , Yining Sun , Zuchang Ma , Lisheng Gao , Yang Xu , Ting Sun

Inductive link prediction is emerging as a key paradigm for real-world knowledge graphs (KGs), where new entities frequently appear and models must generalize to them without retraining. Predicting links in a KG faces the challenge of…

Computation and Language · Computer Science 2025-10-01 Alessandro De Bellis , Salvatore Bufi , Giovanni Servedio , Vito Walter Anelli , Tommaso Di Noia , Eugenio Di Sciascio

Question Answering systems are generally modelled as a pipeline consisting of a sequence of steps. In such a pipeline, Entity Linking (EL) is often the first step. Several EL models first perform span detection and then entity…

Computation and Language · Computer Science 2020-09-02 Debayan Banerjee , Debanjan Chaudhuri , Mohnish Dubey , Jens Lehmann

We investigate the knowledge graph entity typing task which aims at inferring plausible entity types. In this paper, we propose a novel Transformer-based Entity Typing (TET) approach, effectively encoding the content of neighbors of an…

Artificial Intelligence · Computer Science 2022-10-21 Zhiwei Hu , Víctor Gutiérrez-Basulto , Zhiliang Xiang , Ru Li , Jeff Z. Pan

We propose an entity-centric neural cross-lingual coreference model that builds on multi-lingual embeddings and language-independent features. We perform both intrinsic and extrinsic evaluations of our model. In the intrinsic evaluation, we…

Computation and Language · Computer Science 2018-06-28 Gourab Kundu , Avirup Sil , Radu Florian , Wael Hamza

In this work, we focus on the problem of entity alignment in Knowledge Graphs (KG) and we report on our experiences when applying a Graph Convolutional Network (GCN) based model for this task. Variants of GCN are used in multiple…

Machine Learning · Computer Science 2021-05-27 Max Berrendorf , Evgeniy Faerman , Valentyn Melnychuk , Volker Tresp , Thomas Seidl

Structured information about entities is critical for many semantic parsing tasks. We present an approach that uses a Graph Neural Network (GNN) architecture to incorporate information about relevant entities and their relations during…

Computation and Language · Computer Science 2019-09-27 Peter Shaw , Philip Massey , Angelica Chen , Francesco Piccinno , Yasemin Altun

Recently, the development of pre-trained language models has brought natural language processing (NLP) tasks to the new state-of-the-art. In this paper we explore the efficiency of various pre-trained language models. We pre-train a list of…

Computation and Language · Computer Science 2023-07-27 Tong Guo

Clinical text is rich in information, with mentions of treatment, medication and anatomy among many other clinical terms. Multiple terms can refer to the same core concepts which can be referred as a clinical entity. Ontologies like the…

Computation and Language · Computer Science 2024-05-28 Akshit Achara , Sanand Sasidharan , Gagan N

Many data sets contain rich information about objects, as well as pairwise relations between them. For instance, in networks of websites, scientific papers, and other documents, each node has content consisting of a collection of words, as…

Machine Learning · Computer Science 2014-10-30 Yaojia Zhu , Xiaoran Yan , Lise Getoor , Cristopher Moore

Named entity recognition (NER) and relation extraction (RE) are two important tasks in information extraction and retrieval (IE \& IR). Recent work has demonstrated that it is beneficial to learn these tasks jointly, which avoids the…

Computation and Language · Computer Science 2020-01-01 John Giorgi , Xindi Wang , Nicola Sahar , Won Young Shin , Gary D. Bader , Bo Wang

How much knowledge do pretrained language models hold? Recent research observed that pretrained transformers are adept at modeling semantics but it is unclear to what degree they grasp human knowledge, or how to ensure they do so. In this…

Computation and Language · Computer Science 2021-02-05 Corby Rosset , Chenyan Xiong , Minh Phan , Xia Song , Paul Bennett , Saurabh Tiwary

Machine understanding of user utterances in conversational systems is of utmost importance for enabling engaging and meaningful conversations with users. Entity Linking (EL) is one of the means of text understanding, with proven efficacy…

Computation and Language · Computer Science 2021-05-12 Hideaki Joko , Faegheh Hasibi , Krisztian Balog , Arjen P. de Vries

Entity matching is the task of linking records from different sources that refer to the same real-world entity. Past work has primarily treated entity linking as a standard supervised learning problem. However, supervised entity matching…

Computation and Language · Computer Science 2024-10-01 Somin Wadhwa , Adit Krishnan , Runhui Wang , Byron C. Wallace , Chris Kong

While recent research on natural language inference has considerably benefited from large annotated datasets, the amount of inference-related knowledge (including commonsense) provided in the annotated data is still rather limited. There…

Computation and Language · Computer Science 2021-09-10 Xiaoyu Yang , Xiaodan Zhu , Zhan Shi , Tianda Li

Named Entity Disambiguation (NED) refers to the task of resolving multiple named entity mentions in a document to their correct references in a knowledge base (KB) (e.g., Wikipedia). In this paper, we propose a novel embedding method…

Computation and Language · Computer Science 2016-06-13 Ikuya Yamada , Hiroyuki Shindo , Hideaki Takeda , Yoshiyasu Takefuji

Entity linking (or Normalization) is an essential task in text mining that maps the entity mentions in the medical text to standard entities in a given Knowledge Base (KB). This task is of great importance in the medical domain. It can also…

Computation and Language · Computer Science 2020-12-22 Ishani Mondal , Sukannya Purkayastha , Sudeshna Sarkar , Pawan Goyal , Jitesh Pillai , Amitava Bhattacharyya , Mahanandeeshwar Gattu

Existing evaluations of entity linking systems often say little about how the system is going to perform for a particular application. There are two fundamental reasons for this. One is that many evaluations only use aggregate measures…

Computation and Language · Computer Science 2023-11-20 Hannah Bast , Matthias Hertel , Natalie Prange