English
Related papers

Related papers: Konooz: Multi-domain Multi-dialect Corpus for Name…

200 papers

Most state of the art approaches for Named Entity Recognition rely on hand crafted features and annotated corpora. Recently Neural network based models have been proposed which do not require handcrafted features but still require annotated…

Computation and Language · Computer Science 2016-07-04 Rudra Murthy , Mitesh Khapra , Pushpak Bhattacharyya

We present the development of a dataset for Kazakh named entity recognition. The dataset was built as there is a clear need for publicly available annotated corpora in Kazakh, as well as annotation guidelines containing straightforward--but…

Computation and Language · Computer Science 2022-04-08 Rustem Yeshpanov , Yerbolat Khassanov , Huseyin Atakan Varol

We present M2D2, a fine-grained, massively multi-domain corpus for studying domain adaptation in language models (LMs). M2D2 consists of 8.5B tokens and spans 145 domains extracted from Wikipedia and Semantic Scholar. Using ontologies…

Computation and Language · Computer Science 2022-10-17 Machel Reid , Victor Zhong , Suchin Gururangan , Luke Zettlemoyer

Named entity recognition (NER) is a vital task in spoken language understanding, which aims to identify mentions of named entities in text e.g., from transcribed speech. Existing neural models for NER rely mostly on dedicated word-level…

Computation and Language · Computer Science 2019-09-24 Abdalghani Abujabal , Judith Gaspers

The recognition of Arabic Named Entities (NE) is a problem in different domains of Natural Language Processing (NLP) like automatic translation. Indeed, NE translation allows the access to multilingual in-formation. This translation doesn't…

Computation and Language · Computer Science 2010-07-28 Abdelmajid Ben Hamadou , Odile Piton , Héla Fehri

In this paper, we make freely accessible ANETAC our English-Arabic named entity transliteration and classification dataset that we built from freely available parallel translation corpora. The dataset contains 79,924 instances, each…

Computation and Language · Computer Science 2019-07-09 Mohamed Seghir Hadj Ameur , Farid Meziane , Ahmed Guessoum

We present our effort to create a large Multi-Layered representational repository of Linguistic Code-Switched Arabic data. The process involves developing clear annotation standards and Guidelines, streamlining the annotation process, and…

Computation and Language · Computer Science 2019-10-01 Mona Diab , Mahmoud Ghoneim , Abdelati Hawwari , Fahad AlGhamdi , Nada AlMarwani , Mohamed Al-Badrashiny

The MultiCoNER shared task aims at detecting semantically ambiguous and complex named entities in short and low-context settings for multiple languages. The lack of contexts makes the recognition of ambiguous named entities challenging. To…

Computation and Language · Computer Science 2022-06-28 Xinyu Wang , Yongliang Shen , Jiong Cai , Tao Wang , Xiaobin Wang , Pengjun Xie , Fei Huang , Weiming Lu , Yueting Zhuang , Kewei Tu , Wei Lu , Yong Jiang

Scarcity of resources such as annotated text corpora for under-resourced languages like Albanian is a serious impediment in computational linguistics and natural language processing research. This paper presents AlbNER, a corpus of 900…

Computation and Language · Computer Science 2023-09-19 Erion Çano

This paper presents a novel approach to fine-tuning the Qwen2-1.5B model for Arabic language processing using Quantized Low-Rank Adaptation (QLoRA) on a system with only 4GB VRAM. We detail the process of adapting this large language model…

Computation and Language · Computer Science 2024-12-24 Prakash Aryan

We present MULTICONER V2, a dataset for fine-grained Named Entity Recognition covering 33 entity classes across 12 languages, in both monolingual and multilingual settings. This dataset aims to tackle the following practical challenges in…

Computation and Language · Computer Science 2023-10-23 Besnik Fetahu , Zhiyu Chen , Sudipta Kar , Oleg Rokhlenko , Shervin Malmasi

Nowadays, Natural Language Processing (NLP) is an important tool for most people's daily life routines, ranging from understanding speech, translation, named entity recognition (NER), and text categorization, to generative text models such…

Discriminating between closely-related language varieties is considered a challenging and important task. This paper describes our submission to the DSL 2016 shared-task, which included two sub-tasks: one on discriminating similar languages…

Computation and Language · Computer Science 2016-09-27 Yonatan Belinkov , James Glass

Named Entity Recognition (NER) in regional dialects is a critical yet underexplored area in Natural Language Processing (NLP), especially for low-resource languages like Bangla. While NER systems for Standard Bangla have made progress, no…

We present Arabic-Nougat, a suite of OCR models for converting Arabic book pages into structured Markdown text. Based on Meta's Nougat architecture, Arabic-Nougat includes three specialized models: arabic-small-nougat, arabic-base-nougat,…

Computation and Language · Computer Science 2024-11-28 Mohamed Rashad

Contextual embedding-based language models trained on large data sets, such as BERT and RoBERTa, provide strong performance across a wide range of tasks and are ubiquitous in modern NLP. It has been observed that fine-tuning these models on…

Computation and Language · Computer Science 2021-09-16 Vin Sachidananda , Jason S. Kessler , Yi-an Lai

We present a multilingual Named Entity Recognition approach based on a robust and general set of features across languages and datasets. Our system combines shallow local information with clustering semi-supervised features induced on large…

Computation and Language · Computer Science 2017-02-03 Rodrigo Agerri , German Rigau

This thesis presents a language-independent text classification model by introduced two new encoding methods "BUNOW" and "BUNOC" used for feeding the raw text data into a new CNN spatial architecture with vertical and horizontal…

Computation and Language · Computer Science 2019-03-19 Amr Adel Helmy

We present the results and findings of the First Nuanced Arabic Dialect Identification Shared Task (NADI). This Shared Task includes two subtasks: country-level dialect identification (Subtask 1) and province-level sub-dialect…

Computation and Language · Computer Science 2020-11-11 Muhammad Abdul-Mageed , Chiyu Zhang , Houda Bouamor , Nizar Habash

This study investigates logistic regression, linear support vector machine, multinomial Naive Bayes, and Bernoulli Naive Bayes for classifying Libyan dialect utterances gathered from Twitter. The dataset used is the QADI corpus, which…

Computation and Language · Computer Science 2025-12-05 Mansour Essgaer , Khamis Massud , Rabia Al Mamlook , Najah Ghmaid