English
Related papers

Related papers: HiligayNER: A Baseline Named Entity Recognition Mo…

200 papers

Recent advances in large language models (LLMs) have demonstrated remarkable capabilities on widely benchmarked high-resource languages. However, linguistic nuances of under-resourced languages remain unexplored. We introduce Batayan, a…

Named-entity recognition (NER) in low-resource languages is usually tackled by finetuning very large multilingual LMs, an option that is often infeasible in memory- or latency-constrained settings. We ask whether small decoder LMs can be…

Computation and Language · Computer Science 2025-10-07 David Demitri Africa , Suchir Salhan , Yuval Weiss , Paula Buttery , Richard Diehl Martinez

Named Entity Recognition (NER) is a fundamental task in natural language processing that involves identifying and classifying named entities in text. But much work hasn't been done for complex named entity recognition in Bangla, despite…

Computation and Language · Computer Science 2023-03-20 HAZ Sameen Shahgir , Ramisa Alam , Md. Zarif Ul Alam

Recent Named Entity Recognition (NER) advancements have significantly enhanced text classification capabilities. This paper focuses on spoken NER, aimed explicitly at spoken document retrieval, an area not widely studied due to the lack of…

Computation and Language · Computer Science 2024-09-12 Moncef Benaicha , David Thulke , M. A. Tuğtekin Turan

There is an increasing interest in studying natural language and computer code together, as large corpora of programming texts become readily available on the Internet. For example, StackOverflow currently has over 15 million programming…

Computation and Language · Computer Science 2020-11-17 Jeniya Tabassum , Mounica Maddela , Wei Xu , Alan Ritter

Named-entities are inherently multilingual, and annotations in any given language may be limited. This motivates us to consider polyglot named-entity recognition (NER), where one model is trained using annotated data drawn from more than…

Computation and Language · Computer Science 2020-05-05 David Mueller , Nicholas Andrews , Mark Dredze

Although over 100 languages are supported by strong off-the-shelf machine translation systems, only a subset of them possess large annotated corpora for named entity recognition. Motivated by this fact, we leverage machine translation to…

Computation and Language · Computer Science 2019-09-16 Alankar Jain , Bhargavi Paranjape , Zachary C. Lipton

We present the AsNER, a named entity annotation dataset for low resource Assamese language with a baseline Assamese NER model. The dataset contains about 99k tokens comprised of text from the speech of the Prime Minister of India and…

Computation and Language · Computer Science 2022-12-22 Dhrubajyoti Pathak , Sukumar Nandi , Priyankoo Sarmah

While multilingual language models promise to bring the benefits of LLMs to speakers of many languages, gold-standard evaluation benchmarks in most languages to interrogate these assumptions remain scarce. The Universal NER project, now…

Recent years have seen the paradigm shift of Named Entity Recognition (NER) systems from sequence labeling to span prediction. Despite its preliminary effectiveness, the span prediction model's architectural bias has not been fully…

Computation and Language · Computer Science 2021-06-08 Jinlan Fu , Xuanjing Huang , Pengfei Liu

We present OpenNER 1.0, a standardized collection of openly-available named entity recognition (NER) datasets. OpenNER contains 36 NER corpora that span 52 languages, human-annotated in varying named entity ontologies. We correct annotation…

Computation and Language · Computer Science 2025-12-19 Chester Palen-Michel , Maxwell Pickering , Maya Kruse , Jonne Sälevä , Constantine Lignos

Large Language Models (LLMs) have shown impressive abilities in data annotation, opening the way for new approaches to solve classic NLP problems. In this paper, we show how to use LLMs to create NuNER, a compact language representation…

Computation and Language · Computer Science 2024-02-26 Sergei Bogdanov , Alexandre Constantin , Timothée Bernard , Benoit Crabbé , Etienne Bernard

This work introduces HistNERo, the first Romanian corpus for Named Entity Recognition (NER) in historical newspapers. The dataset contains 323k tokens of text, covering more than half of the 19th century (i.e., 1817) until the late part of…

Integrating named entity recognition (NER) with automatic speech recognition (ASR) can significantly enhance transcription accuracy and informativeness. In this paper, we introduce WhisperNER, a novel model that allows joint speech…

Computation and Language · Computer Science 2025-08-08 Gil Ayache , Menachem Pirchi , Aviv Navon , Aviv Shamsian , Gill Hetz , Joseph Keshet

Current research on automatic readability assessment (ARA) has focused on improving the performance of models in high-resource languages such as English. In this work, we introduce and release BasahaCorpus as part of an initiative aimed at…

Computation and Language · Computer Science 2023-10-19 Joseph Marvin Imperial , Ekaterina Kochmar

The advancements of Large Language Models (LLMs) have spurred a growing interest in their application to Named Entity Recognition (NER) methods. However, existing datasets are primarily designed for traditional machine learning methods and…

Computation and Language · Computer Science 2026-05-18 Hanjun Luo , Yingbin Jin , Xinfeng Li , Xuecheng Liu , Ruizhe Chen , Tong Shang , Kun Wang , Qingsong Wen , Zuozhu Liu

Large Language Models (LLMs, e.g., ChatGPT) have shown impressive zero- and few-shot capabilities in Named Entity Recognition (NER). However, these models can only be accessed via online APIs, which may cause data leak and non-reproducible…

Computation and Language · Computer Science 2023-05-08 Bin Ji

Named Entity Recognition (NER) is essential in various Natural Language Processing (NLP) applications. Traditional NER models are effective but limited to a set of predefined entity types. In contrast, Large Language Models (LLMs) can…

Computation and Language · Computer Science 2023-11-16 Urchade Zaratiana , Nadi Tomeh , Pierre Holat , Thierry Charnois

Named entity recognition (NER) identifies typed entity mentions in raw text. While the task is well-established, there is no universally used tagset: often, datasets are annotated for use in downstream applications and accordingly only…

Computation and Language · Computer Science 2019-10-08 Xiao Huang , Li Dong , Elizabeth Boschee , Nanyun Peng

Named Entity Recognition NER is very crucial for various natural language processing applications, including information extraction, machine translation, and sentiment analysis. Despite the ever-increasing interest in African languages…

Computation and Language · Computer Science 2025-05-14 S. E Emedem , I. E Onyenwe , E. G Onyedinma