English
Related papers

Related papers: Self-Attention Gazetteer Embeddings for Named-Enti…

200 papers

Contextualized embeddings use unsupervised language model pretraining to compute word representations depending on their context. This is intuitively useful for generalization, especially in Named-Entity Recognition where it is crucial to…

Computation and Language · Computer Science 2020-01-23 Bruno Taillé , Vincent Guigue , Patrick Gallinari

Content on the Internet is heterogeneous and arises from various domains like News, Entertainment, Finance and Technology. Understanding such content requires identifying named entities (persons, places and organizations) as one of the key…

Computation and Language · Computer Science 2016-12-02 Vivek Kulkarni , Yashar Mehdad , Troy Chevalier

Nested Named Entity Recognition (NNER) focuses on addressing overlapped entity recognition. Compared to Flat Named Entity Recognition (FNER), annotated resources are scarce in the corpus for NNER. Data augmentation is an effective approach…

Computation and Language · Computer Science 2024-06-19 Xingming Liao , Nankai Lin , Haowen Li , Lianglun Cheng , Zhuowei Wang , Chong Chen

Entity alignment is a viable means for integrating heterogeneous knowledge among different knowledge graphs (KGs). Recent developments in the field often take an embedding-based approach to model the structural information of KGs so that…

Computation and Language · Computer Science 2019-09-23 Yuting Wu , Xiao Liu , Yansong Feng , Zheng Wang , Dongyan Zhao

We introduce a simple yet effective method of integrating contextual embeddings with commonsense graph embeddings, dubbed BERT Infused Graphs: Matching Over Other embeDdings. First, we introduce a preprocessing method to improve the speed…

Computation and Language · Computer Science 2019-10-18 Jeff Da

Named Entity Recognition (NER), a classic sequence labelling task, is an essential component of natural language understanding (NLU) systems in task-oriented dialog systems for slot filling. For well over a decade, different methods from…

Computation and Language · Computer Science 2018-12-07 Pratik Jayarao , Chirag Jain , Aman Srivastava

Word embeddings have gained significant attention as learnable representations of semantic relations between words, and have been shown to improve upon the results of traditional word representations. However, little effort has been devoted…

Information Retrieval · Computer Science 2019-05-23 Gloria Feher , Andreas Spitz , Michael Gertz

Most weakly supervised named entity recognition (NER) models rely on domain-specific dictionaries provided by experts. This approach is infeasible in many domains where dictionaries do not exist. While a phrase retrieval model was used to…

Computation and Language · Computer Science 2023-06-02 Hyunjae Kim , Jaehyo Yoo , Seunghyun Yoon , Jaewoo Kang

We propose the Gaussian attention model for content-based neural memory access. With the proposed attention model, a neural network has the additional degree of freedom to control the focus of its attention from a laser sharp attention to a…

Machine Learning · Statistics 2016-12-01 Liwen Zhang , John Winn , Ryota Tomioka

Entity alignment seeks to find entities in different knowledge graphs (KGs) that refer to the same real-world object. Recent advancement in KG embedding impels the advent of embedding-based entity alignment, which encodes entities in a…

Computation and Language · Computer Science 2020-07-21 Zequn Sun , Qingheng Zhang , Wei Hu , Chengming Wang , Muhao Chen , Farahnaz Akrami , Chengkai Li

Recent advances in machine learning, particularly Large Language Models (LLMs) such as BERT and GPT, provide rich contextual embeddings that improve text representation. However, current document clustering approaches often ignore the…

Computation and Language · Computer Science 2024-12-20 Imed Keraghel , Mohamed Nadif

We propose a simple and practical method for named entity linking (NEL), based on entity representation by multiple embeddings. To explore this method, and to review its dependency on parameters, we measure its performance on Namesakes, a…

Computation and Language · Computer Science 2022-11-22 Oleg Vasilyev , Alex Dauenhauer , Vedant Dharnidharka , John Bohannon

Named entity typing (NET) is a classification task of assigning an entity mention in the context with given semantic types. However, with the growing size and granularity of the entity types, rare researches in previous concern with newly…

Computation and Language · Computer Science 2020-11-04 Tao Zhang , Congying Xia , Chun-Ta Lu , Philip Yu

Named Entity Recognition seeks to extract substrings within a text that name real-world objects and to determine their type (for example, whether they refer to persons or organizations). In this survey, we first present an overview of…

Computation and Language · Computer Science 2024-12-23 Imed Keraghel , Stanislas Morbieu , Mohamed Nadif

Named entity linking is to map an ambiguous mention in documents to an entity in a knowledge base. The named entity linking is challenging, given the fact that there are multiple candidate entities for a mention in a document. It is…

Computation and Language · Computer Science 2020-02-13 Wei Shi , Siyuan Zhang , Zhiwei Zhang , Hong Cheng , Jeffrey Xu Yu

Named entity recognition (NER) task aims at identifying entities from a piece of text that belong to predefined semantic types such as person, location, organization, etc. The state-of-the-art solutions for flat entities NER commonly suffer…

Computation and Language · Computer Science 2022-08-08 Jianlin Su , Ahmed Murtadha , Shengfeng Pan , Jing Hou , Jun Sun , Wanwei Huang , Bo Wen , Yunfeng Liu

Self-attention is a method of encoding sequences of vectors by relating these vectors to each-other based on pairwise similarities. These models have recently shown promising results for modeling discrete sequences, but they are non-trivial…

Computation and Language · Computer Science 2018-06-19 Matthias Sperber , Jan Niehues , Graham Neubig , Sebastian Stüker , Alex Waibel

With the fast development of Deep Learning techniques, Named Entity Recognition (NER) is becoming more and more important in the information extraction task. The greatest difficulty that the NER task faces is to keep the detectability even…

Computation and Language · Computer Science 2024-01-23 Xin Chen , Qi Zhao , Xinyang Liu

Named entity recognition (NER) is the task to detect and classify the entity spans in the text. When entity spans overlap between each other, this problem is named as nested NER. Span-based methods have been widely used to tackle the nested…

Computation and Language · Computer Science 2022-09-16 Hang Yan , Yu Sun , Xiaonan Li , Xipeng Qiu

Retrieval-Augmented Generation systems depend on retrieving semantically relevant document chunks to support accurate, grounded outputs from large language models. In structured and repetitive corpora such as regulatory filings, chunk…

Information Retrieval · Computer Science 2026-01-21 Raquib Bin Yousuf , Shengzhe Xu , Mandar Sharma , Andrew Neeser , Chris Latimer , Naren Ramakrishnan