English
Related papers

Related papers: Sharing Network Parameters for Crosslingual Named …

200 papers

In low-resource natural language processing (NLP), the key problems are a lack of target language training data, and a lack of native speakers to create it. Cross-lingual methods have had notable success in addressing these concerns, but in…

Computation and Language · Computer Science 2021-04-27 Tatiana Tsygankova , Francesca Marini , Stephen Mayhew , Dan Roth

The state-of-the-art named entity recognition (NER) systems are supervised machine learning models that require large amounts of manually annotated data to achieve high accuracy. However, annotating NER data by human is expensive and…

Computation and Language · Computer Science 2019-11-04 Jian Ni , Georgiana Dinu , Radu Florian

Deep neural network models have recently achieved state-of-the-art performance gains in a variety of natural language processing (NLP) tasks (Young, Hazarika, Poria, & Cambria, 2017). However, these gains rely on the availability of large…

Computation and Language · Computer Science 2018-11-15 Maximilian Hofer , Andrey Kormilitzin , Paul Goldberg , Alejo Nevado-Holgado

Pre-trained models such as BERT are widely used in NLP tasks and are fine-tuned to improve the performance of various NLP tasks consistently. Nevertheless, the fine-tuned BERT model trained on our protocol corpus still has a weak…

Computation and Language · Computer Science 2020-02-04 Shoubin Li , Wenzao Cui , Yujiang Liu , Xuran Ming , Jun Hu , YuanzheHu , Qing Wang

Pre-trained language models (PLM) are effective components of few-shot named entity recognition (NER) approaches when augmented with continued pre-training on task-specific out-of-domain data or fine-tuning on in-domain data. However, their…

Computation and Language · Computer Science 2022-04-12 Yuxuan Chen , Jonas Mikkelsen , Arne Binder , Christoph Alt , Leonhard Hennig

Named entity recognition (NER) and relation extraction (RE) are two important tasks in information extraction and retrieval (IE \& IR). Recent work has demonstrated that it is beneficial to learn these tasks jointly, which avoids the…

Computation and Language · Computer Science 2020-01-01 John Giorgi , Xindi Wang , Nicola Sahar , Won Young Shin , Gary D. Bader , Bo Wang

In the last years, the consolidation of deep neural network architectures for information extraction in document images has brought big improvements in the performance of each of the tasks involved in this process, consisting of text…

Computer Vision and Pattern Recognition · Computer Science 2020-05-05 Manuel Carbonell , Alicia Fornés , Mauricio Villegas , Josep Lladós

Information extraction is an important task in NLP, enabling the automatic extraction of data for relational database filling. Historically, research and data was produced for English text, followed in subsequent years by datasets in…

Computation and Language · Computer Science 2019-12-13 Taesun Moon , Parul Awasthy , Jian Ni , Radu Florian

This study examines transformer-based models and their effectiveness in named entity recognition tasks. The study investigates data representation strategies, including single, merged, and context, which respectively use one sentence,…

Computation and Language · Computer Science 2024-06-26 Michał Marcińczuk

We propose a segmental neural language model that combines the generalization power of neural networks with the ability to discover word-like units that are latent in unsegmented character sequences. In contrast to previous segmentation…

Computation and Language · Computer Science 2019-06-19 Kazuya Kawakami , Chris Dyer , Phil Blunsom

Manually labeled corpora are expensive to create and often not available for low-resource languages or domains. Automatic labeling approaches are an alternative way to obtain labeled data in a quicker and cheaper way. However, these labels…

Machine Learning · Computer Science 2018-07-24 Michael A. Hedderich , Dietrich Klakow

Named Entity Recognition (NER) is the task of identifying and classifying named entities in large-scale texts into predefined classes. NER in French and other relatively limited-resource languages cannot always benefit from approaches…

Computation and Language · Computer Science 2023-01-13 Arjun Choudhry , Inder Khatri , Pankaj Gupta , Aaryan Gupta , Maxime Nicol , Marie-Jean Meurs , Dinesh Kumar Vishwakarma

Even for common NLP tasks, sufficient supervision is not available in many languages -- morphological tagging is no exception. In the work presented here, we explore a transfer learning scheme, whereby we train character-level recurrent…

Computation and Language · Computer Science 2025-04-25 Ryan Cotterell , Georg Heigold

Research in Computational Linguistics is dependent on text corpora for training and testing new tools and methodologies. While there exists a plethora of annotated linguistic information, these corpora are often not interoperable without…

Computation and Language · Computer Science 2020-11-03 Timo Lek , Anna de Groot , Tobias Kuhn , Roser Morante

Learned vector representations of words are useful tools for many information retrieval and natural language processing tasks due to their ability to capture lexical semantics. However, while many such tasks involve or even rely on named…

Computation and Language · Computer Science 2020-02-13 Satya Almasian , Andreas Spitz , Michael Gertz

We propose a new approach for learning contextualised cross-lingual word embeddings based on a small parallel corpus (e.g. a few hundred sentence pairs). Our method obtains word embeddings via an LSTM encoder-decoder model that…

Computation and Language · Computer Science 2021-10-22 Takashi Wada , Tomoharu Iwata , Yuji Matsumoto , Timothy Baldwin , Jey Han Lau

Although over 100 languages are supported by strong off-the-shelf machine translation systems, only a subset of them possess large annotated corpora for named entity recognition. Motivated by this fact, we leverage machine translation to…

Computation and Language · Computer Science 2019-09-16 Alankar Jain , Bhargavi Paranjape , Zachary C. Lipton

Named entity recognition (NER) systems that perform well require task-related and manually annotated datasets. However, they are expensive to develop, and are thus limited in size. As there already exists a large number of NER datasets that…

Computation and Language · Computer Science 2019-04-23 Nargiza Nosirova , Mingbin Xu , Hui Jiang

Named entity recognition (NER) is highly sensitive to sentential syntactic and semantic properties where entities may be extracted according to how they are used and placed in the running text. To model such properties, one could rely on…

Computation and Language · Computer Science 2020-10-30 Yuyang Nie , Yuanhe Tian , Yan Song , Xiang Ao , Xiang Wan

State of the art Named Entity Recognition (NER) models have achieved an impressive ability to extract common phrases from text that belong to labels such as location, organization, time, and person. However, typical NER systems that rely on…

Computation and Language · Computer Science 2024-01-24 Alexandra Loessberg-Zahl