English
Related papers

Related papers: Transformer-based Named Entity Recognition with Co…

200 papers

Subword regularizations use multiple subword segmentations during training to improve the robustness of neural machine translation models. In previous subword regularizations, we use multiple segmentations in the training process but use…

Computation and Language · Computer Science 2022-03-28 Sho Takase , Tatsuya Hiraoka , Naoaki Okazaki

We present a multilingual Named Entity Recognition approach based on a robust and general set of features across languages and datasets. Our system combines shallow local information with clustering semi-supervised features induced on large…

Computation and Language · Computer Science 2017-02-03 Rodrigo Agerri , German Rigau

Named Entity Recognition and Intent Classification are among the most important subfields of the field of Natural Language Processing. Recent research has lead to the development of faster, more sophisticated and efficient models to tackle…

Computation and Language · Computer Science 2022-11-07 Sofia Rizou , Antonia Paflioti , Angelos Theofilatos , Athena Vakali , George Sarigiannidis , Konstantinos Ch. Chatzisavvas

In this paper, the authors propose TriBERTa, a supervised entity resolution system that utilizes a pre-trained large language model and a triplet loss function to learn representations for entity matching. The system consists of two steps:…

Computation and Language · Computer Science 2024-11-19 Xiaowei Xu , Bi T. Foua , Xingqiao Wang , Vivek Gunasekaran , John R. Talburt

Word embeddings -- distributed representations of words -- in deep learning are beneficial for many tasks in natural language processing (NLP). However, different embedding sets vary greatly in quality and characteristics of the captured…

Computation and Language · Computer Science 2015-12-31 Wenpeng Yin , Hinrich Schütze

In this report, we describe our participant named-entity recognition system at VLSP 2018 evaluation campaign. We formalized the task as a sequence labeling problem using BIO encoding scheme. We applied a feature-based model which combines…

Computation and Language · Computer Science 2018-03-23 Pham Quang Nhat Minh

Recent work in learning vector-space embeddings for multi-relational data has focused on combining relational information derived from knowledge bases with distributional information derived from large text corpora. We propose a simple…

Computation and Language · Computer Science 2016-05-19 Teng Long , Ryan Lowe , Jackie Chi Kit Cheung , Doina Precup

Increased adaptability of RNN language models leads to improved predictions that benefit many applications. However, current methods do not take full advantage of the RNN structure. We show that the most widely-used approach to adaptation…

Computation and Language · Computer Science 2017-04-24 Aaron Jaech , Mari Ostendorf

We evaluate named entity representations of BERT-based NLP models by investigating their robustness to replacements from the same typed class in the input. We highlight that on several tasks while such perturbations are natural, state of…

Computation and Language · Computer Science 2020-07-15 Sriram Balasubramanian , Naman Jain , Gaurav Jindal , Abhijeet Awasthi , Sunita Sarawagi

Nested Named Entity Recognition (NNER) focuses on addressing overlapped entity recognition. Compared to Flat Named Entity Recognition (FNER), annotated resources are scarce in the corpus for NNER. Data augmentation is an effective approach…

Computation and Language · Computer Science 2024-06-19 Xingming Liao , Nankai Lin , Haowen Li , Lianglun Cheng , Zhuowei Wang , Chong Chen

The benefit of multi-task learning over single-task learning relies on the ability to use relations across tasks to improve performance on any single task. While sharing representations is an important mechanism to share information across…

Machine Learning · Computer Science 2021-06-14 Shagun Sodhani , Amy Zhang , Joelle Pineau

Modern automatic translation systems aim at place the human at the center by providing contextual support and knowledge. In this context, a critical task is enriching the output with information regarding the mentioned entities, which is…

Computation and Language · Computer Science 2023-10-09 Marco Gaido , Sara Papi , Matteo Negri , Marco Turchi

Named entity recognition (NER) is a fundamental task in natural language processing that involves identifying and classifying entities in sentences into pre-defined types. It plays a crucial role in various research fields, including entity…

Computation and Language · Computer Science 2024-04-29 Dongsheng Wang , Xiaoqin Feng , Zeming Liu , Chuan Wang

In recent years, the fine-tuned generative models have been proven more powerful than the previous tagging-based or span-based models on named entity recognition (NER) task. It has also been found that the information related to entities,…

Computation and Language · Computer Science 2024-06-12 Guochao Jiang , Ziqin Luo , Yuchen Shi , Dixuan Wang , Jiaqing Liang , Deqing Yang

The purpose of this paper is to use reinforcement learning to model learning agents which can recognize formal languages. Agents are modeled as simple multi-head automaton, a new model of finite automaton that uses multiple heads, and six…

Machine Learning · Computer Science 2020-10-21 Alper Şekerci , Özlem Salehi

In this work, we propose an effective approach for training unique embedding representations by combining three simultaneous modalities: image and spoken and textual narratives. The proposed methodology departs from a baseline system that…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Benet Oriol , Jordi Luque , Ferran Diego , Xavier Giro-i-Nieto

In recent years, large pre-trained language models (PLMs) have achieved remarkable performance on many natural language processing benchmarks. Despite their success, prior studies have shown that PLMs are vulnerable to attacks from…

Computation and Language · Computer Science 2024-02-06 Shuguang Chen , Leonardo Neves , Thamar Solorio

Recent advances in language modeling using deep neural networks have shown that these models learn representations, that vary with the network depth from morphology to semantic relationships like co-reference. We apply pre-trained language…

Computation and Language · Computer Science 2019-06-19 Stefan Schweter , Johannes Baiter

Context-aware Machine Translation aims to improve translations of sentences by incorporating surrounding sentences as context. Towards this task, two main architectures have been applied, namely single-encoder (based on concatenation) and…

Computation and Language · Computer Science 2024-02-05 Paweł Mąka , Yusuf Can Semerci , Jan Scholtes , Gerasimos Spanakis

Named entity recognition (NER) is a widely studied task in natural language processing. Recently, a growing number of studies have focused on the nested NER. The span-based methods, considering the entity recognition as a span…

Computation and Language · Computer Science 2021-06-22 Zeqi Tan , Yongliang Shen , Shuai Zhang , Weiming Lu , Yueting Zhuang