English
Related papers

Related papers: Portuguese Named Entity Recognition using BERT-CRF

200 papers

Building named entity recognition (NER) models for languages that do not have much training data is a challenging task. While recent work has shown promising results on cross-lingual transfer from high-resource languages to low-resource…

Computation and Language · Computer Science 2019-09-10 Xiaolei Huang , Jonathan May , Nanyun Peng

Named Entity Recognition systems achieve remarkable performance on domains such as English news. It is natural to ask: What are these models actually learning to achieve this? Are they merely memorizing the names themselves? Or are they…

Computation and Language · Computer Science 2021-01-05 Oshin Agarwal , Yinfei Yang , Byron C. Wallace , Ani Nenkova

The Bidirectional Encoder Representations from Transformers (BERT) model has achieved the state-of-the-art performance for many natural language processing (NLP) tasks. Yet, limited research has been contributed to studying its…

Computation and Language · Computer Science 2021-09-23 Zimin Wan , Chenchen Xu , Hanna Suominen

Named-entity recognition (NER) detects texts with predefined semantic labels and is an essential building block for natural language processing (NLP). Notably, recent NER research focuses on utilizing massive extra data, including…

Computation and Language · Computer Science 2023-05-09 Yuxiang Zhang , Junjie Wang , Xinyu Zhu , Tetsuya Sakai , Hayato Yamana

Deep learning approaches are superior in NLP due to their ability to extract informative features and patterns from languages. The two most successful neural architectures are LSTM and transformers, used in large pretrained language models…

Computation and Language · Computer Science 2022-03-03 Matej Klemen , Luka Krsnik , Marko Robnik-Šikonja

We present a simple few-shot named entity recognition (NER) system based on nearest neighbor learning and structured inference. Our system uses a supervised NER model trained on the source domain, as a feature extractor. Across several test…

Computation and Language · Computer Science 2020-10-07 Yi Yang , Arzoo Katiyar

We study clinical Named Entity Recognition (NER) on the CADEC corpus and compare three families of approaches: (i) BERT-style encoders (BERT Base, BioClinicalBERT, RoBERTa-large), (ii) GPT-4o used with few-shot in-context learning (ICL)…

Computation and Language · Computer Science 2025-10-28 Andrei Baroian

Named entity recognition (NER) is used to identify relevant entities in text. A bidirectional LSTM (long short term memory) encoder with a neural conditional random fields (CRF) decoder (biLSTM-CRF) is the state of the art methodology. In…

Computation and Language · Computer Science 2018-08-15 Antonio Jimeno Yepes

Although modern named entity recognition (NER) systems show impressive performance on standard datasets, they perform poorly when presented with noisy data. In particular, capitalization is a strong signal for entities in many languages,…

Computation and Language · Computer Science 2019-12-17 Stephen Mayhew , Nitish Gupta , Dan Roth

The availability of large amounts of computer-readable textual data and hardware that can process the data has shifted the focus of knowledge projects towards deep learning architecture. Natural Language Processing, particularly the task of…

Computation and Language · Computer Science 2021-01-28 Arya Roy

Named entity recognition is a natural language processing task to recognize and extract spans of text associated with named entities and classify them in semantic Categories. Google BERT is a deep bidirectional language model, pre-trained…

Computation and Language · Computer Science 2020-03-20 Ehsan Taher , Seyed Abbas Hoseini , Mehrnoush Shamsfard

Named Entity Recognition (NER) is a useful component in Natural Language Processing (NLP) applications. It is used in various tasks such as Machine Translation, Summarization, Information Retrieval, and Question-Answering systems. The…

As a step toward better document-level understanding, we explore classification of a sequence of sentences into their corresponding categories, a task that requires understanding sentences in context of the document. Recent successful…

Computation and Language · Computer Science 2021-03-24 Arman Cohan , Iz Beltagy , Daniel King , Bhavana Dalvi , Daniel S. Weld

Deep neural network models have recently achieved state-of-the-art performance gains in a variety of natural language processing (NLP) tasks (Young, Hazarika, Poria, & Cambria, 2017). However, these gains rely on the availability of large…

Computation and Language · Computer Science 2018-11-15 Maximilian Hofer , Andrey Kormilitzin , Paul Goldberg , Alejo Nevado-Holgado

Recently, leveraging pre-trained Transformer based language models in down stream, task specific models has advanced state of the art results in natural language understanding tasks. However, only a little research has explored the…

Computation and Language · Computer Science 2020-12-07 Daniel Grießhaber , Johannes Maucher , Ngoc Thang Vu

The use of LLMs for natural language processing has become a popular trend in the past two years, driven by their formidable capacity for context comprehension and learning, which has inspired a wave of research from academics and industry…

Computation and Language · Computer Science 2024-04-09 Faren Yan , Peng Yu , Xin Chen

Spoken language understanding (SLU) tasks involve mapping from speech audio signals to semantic labels. Given the complexity of such tasks, good performance might be expected to require large labeled datasets, which are difficult to collect…

Computation and Language · Computer Science 2022-07-12 Ankita Pasad , Felix Wu , Suwon Shon , Karen Livescu , Kyu J. Han

Named Entity Recognition (NER) is a fundamental task in NLP that is used to locate the key information in text and is primarily applied in conversational and search systems. In commercial applications, NER or comparable slot-filling methods…

Computation and Language · Computer Science 2023-06-13 Maithili Sabane , Aparna Ranade , Onkar Litake , Parth Patil , Raviraj Joshi , Dipali Kadam

Previous works on emotion recognition in conversation (ERC) follow a two-step paradigm, which can be summarized as first producing context-independent features via fine-tuning pretrained language models (PLMs) and then analyzing contextual…

Computation and Language · Computer Science 2023-01-18 Xiangyu Qin , Zhiyu Wu , Jinshi Cui , Tingting Zhang , Yanran Li , Jian Luan , Bin Wang , Li Wang

Most pre-trained language models (PLMs) construct word representations at subword level with Byte-Pair Encoding (BPE) or its variations, by which OOV (out-of-vocab) words are almost avoidable. However, those methods split a word into…

Computation and Language · Computer Science 2021-05-17 Wentao Ma , Yiming Cui , Chenglei Si , Ting Liu , Shijin Wang , Guoping Hu