English
Related papers

Related papers: hmBERT: Historical Multilingual Language Models fo…

200 papers

For languages with no annotated resources, unsupervised transfer of natural language processing models such as named-entity recognition (NER) from resource-rich languages would be an appealing capability. However, differences in words and…

Computation and Language · Computer Science 2018-09-13 Jiateng Xie , Zhilin Yang , Graham Neubig , Noah A. Smith , Jaime Carbonell

Background: Identifying relationships between clinical events and temporal expressions is a key challenge in meaningfully analyzing clinical text for use in advanced AI applications. While previous studies exist, the state-of-the-art…

Computation and Language · Computer Science 2020-04-15 Hong Guan , Jianfu Li , Hua Xu , Murthy Devarakonda

The extraction and analysis of insights from medical data, primarily stored in free-text formats by healthcare workers, presents significant challenges due to its unstructured nature. Medical coding, a crucial process in healthcare, remains…

Computation and Language · Computer Science 2024-05-28 Mikhail Kulyabin , Gleb Sokolov , Aleksandr Galaida , Andreas Maier , Tomas Arias-Vergara

Named Entity Recognition (NER) is a fundamental task in natural language processing that involves identifying and classifying named entities in text. But much work hasn't been done for complex named entity recognition in Bangla, despite…

Computation and Language · Computer Science 2023-03-20 HAZ Sameen Shahgir , Ramisa Alam , Md. Zarif Ul Alam

Recently, neural methods have achieved state-of-the-art (SOTA) results in Named Entity Recognition (NER) tasks for many languages without the need for manually crafted features. However, these models still require manually annotated…

Computation and Language · Computer Science 2019-11-25 M Saiful Bari , Shafiq Joty , Prathyusha Jwalapuram

We explore how multimodal Large Language Models (mLLMs) can help researchers transcribe historical documents, extract relevant historical information, and construct datasets from historical sources. Specifically, we investigate the…

Computation and Language · Computer Science 2025-04-02 Gavin Greif , Niclas Griesshaber , Robin Greif

Motivation: State-of-the-art biomedical named entity recognition (BioNER) systems often require handcrafted features specific to each entity type, such as genes, chemicals and diseases. Although recent studies explored using neural network…

Information Retrieval · Computer Science 2018-10-09 Xuan Wang , Yu Zhang , Xiang Ren , Yuhao Zhang , Marinka Zitnik , Jingbo Shang , Curtis Langlotz , Jiawei Han

Scarcity of resources such as annotated text corpora for under-resourced languages like Albanian is a serious impediment in computational linguistics and natural language processing research. This paper presents AlbNER, a corpus of 900…

Computation and Language · Computer Science 2023-09-19 Erion Çano

Named Entity Recognition has traditionally been a key task in natural language processing, aiming to identify and extract important terms from unstructured text data. However, a notable challenge for contemporary deep-learning NER models…

Computation and Language · Computer Science 2025-08-19 Tzu-Chieh Chen , Wen-Yang Lin

Multilingual BERT (mBERT) trained on 104 languages has shown surprisingly good cross-lingual performance on several NLP tasks, even without explicit cross-lingual signals. However, these evaluations have focused on cross-lingual transfer…

Computation and Language · Computer Science 2020-10-02 Shijie Wu , Mark Dredze

Identifying named entities such as a person, location or organization, in documents can highlight key information to readers. Training Named Entity Recognition (NER) models requires an annotated data set, which can be a time-consuming…

Computation and Language · Computer Science 2022-12-20 Ting Wai Terence Au , Ingemar J. Cox , Vasileios Lampos

We introduce HUBERT which combines the structured-representational power of Tensor-Product Representations (TPRs) and BERT, a pre-trained bidirectional Transformer language model. We show that there is shared structure between different NLP…

Computation and Language · Computer Science 2021-04-27 Mehrad Moradshahi , Hamid Palangi , Monica S. Lam , Paul Smolensky , Jianfeng Gao

For several purposes in Natural Language Processing (NLP), such as Information Extraction, Sentiment Analysis or Chatbot, Named Entity Recognition (NER) holds an important role as it helps to determine and categorize entities in text into…

Computation and Language · Computer Science 2020-03-24 Thong Nguyen , Duy Nguyen , Pramod Rao

In countries that speak multiple main languages, mixing up different languages within a conversation is commonly called code-switching. Previous works addressing this challenge mainly focused on word-level aspects such as word embeddings.…

Computation and Language · Computer Science 2019-09-19 Genta Indra Winata , Zhaojiang Lin , Jamin Shin , Zihan Liu , Pascale Fung

Word embeddings, made widely popular in 2013 with the release of word2vec, have become a mainstay of NLP engineering pipelines. Recently, with the release of BERT, word embeddings have moved from the term-based embedding space to the…

Information Retrieval · Computer Science 2022-02-17 Arthur Câmara , Claudia Hauff

In this paper we examine the benefit of performing named entity recognition (NER) and co-reference resolution to an English and a Greek corpus used for text segmentation. The aim here is to examine whether the combination of text…

Computation and Language · Computer Science 2016-10-31 Pavlina Fragkou

Traditional information retrieval treats named entity recognition as a pre-indexing corpus annotation task, allowing entity tags to be indexed and used during search. Named entity taggers themselves are typically trained on thousands or…

Information Retrieval · Computer Science 2018-06-14 John Foley , Sheikh Muhammad Sarwar , James Allan

The Arabic language is a morphologically rich language with relatively few resources and a less explored syntax compared to English. Given these limitations, Arabic Natural Language Processing (NLP) tasks like Sentiment Analysis (SA), Named…

Computation and Language · Computer Science 2021-03-09 Wissam Antoun , Fady Baly , Hazem Hajj

This work introduces HistNERo, the first Romanian corpus for Named Entity Recognition (NER) in historical newspapers. The dataset contains 323k tokens of text, covering more than half of the 19th century (i.e., 1817) until the late part of…

Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use LLMs to create NuNER, a compact language representation…

Computation and Language · Computer Science 2024-02-26 Sergei Bogdanov , Alexandre Constantin , Timothée Bernard , Benoit Crabbé , Etienne Bernard