English
Related papers

Related papers: Konooz: Multi-domain Multi-dialect Corpus for Name…

200 papers

We propose a new formulation for multilingual entity linking, where language-specific mentions resolve to a language-agnostic Knowledge Base. We train a dual encoder in this new setting, building on prior work with improved feature…

Computation and Language · Computer Science 2020-11-06 Jan A. Botha , Zifei Shan , Daniel Gillick

Urdu, spoken by 230 million people worldwide, lacks dedicated transformer-based language models and curated corpora. While multilingual models provide limited Urdu support, they suffer from poor performance, high computational costs, and…

Computation and Language · Computer Science 2026-01-27 Syed Muhammad Ali , Hammad Sajid , Zainab Haider , Ali Muhammad Asad , Haya Fatima , Abdul Samad

We present Qabas, a novel open-source Arabic lexicon designed for NLP applications. The novelty of Qabas lies in its synthesis of 110 lexicons. Specifically, Qabas lexical entries (lemmas) are assembled by linking lemmas from 110 lexicons.…

Computation and Language · Computer Science 2024-06-12 Mustafa Jarrar , Tymaa Hammouda

We present the full-size Russian complexly NER-labeled corpus of Internet user reviews, along with an evaluation of accuracy levels reached on this corpus by a set of advanced deep learning neural networks to extract the pharmacologically…

Recent advances in deep neural models allow us to build reliable named entity recognition (NER) systems without handcrafting features. However, such methods require large amounts of manually-labeled training data. There have been efforts on…

Computation and Language · Computer Science 2018-09-12 Jingbo Shang , Liyuan Liu , Xiang Ren , Xiaotao Gu , Teng Ren , Jiawei Han

India's linguistic landscape is one of the most diverse in the world, comprising over 120 major languages and approximately 1,600 additional languages, with 22 officially recognized as scheduled languages in the Indian Constitution. Despite…

We present a comprehensive evaluation of large language models for multilingual readability assessment. Existing evaluation resources lack domain and language diversity, limiting the ability for cross-domain and cross-lingual analyses. This…

Computation and Language · Computer Science 2024-10-17 Tarek Naous , Michael J. Ryan , Anton Lavrouk , Mohit Chandra , Wei Xu

Entity Linking is the task of matching a mention to an entity in a given knowledge base (KB). It contributes to annotating a massive amount of documents existing on the Web to harness new facts about their matched entities. However,…

Computation and Language · Computer Science 2022-10-28 Hassan Soliman

Named Entity Recognition (NER) is a fundamental task in natural language processing that involves identifying and classifying named entities in text. But much work hasn't been done for complex named entity recognition in Bangla, despite…

Computation and Language · Computer Science 2023-03-20 HAZ Sameen Shahgir , Ramisa Alam , Md. Zarif Ul Alam

In this paper, we present the annotation pipeline and the guidelines we wrote as part of an effort to create a large manually annotated Arabic author profiling dataset from various social media sources covering 16 Arabic countries and 11…

Computation and Language · Computer Science 2018-08-24 Wajdi Zaghouani , Anis Charfi

We propose two neural network architectures for nested named entity recognition (NER), a setting in which named entities may overlap and also be labeled with more than one label. We encode the nested labels using a linearized scheme. In our…

Computation and Language · Computer Science 2019-08-20 Jana Straková , Milan Straka , Jan Hajič

Creating high-quality annotated data for task-oriented dialog (ToD) is known to be notoriously difficult, and the challenges are amplified when the goal is to create equitable, culturally adapted, and large-scale ToD datasets for multiple…

Computation and Language · Computer Science 2023-07-27 Songbo Hu , Han Zhou , Mete Hergul , Milan Gritta , Guchun Zhang , Ignacio Iacobacci , Ivan Vulić , Anna Korhonen

Named entity recognition (NER) is a widely studied task in natural language processing. Recently, a growing number of studies have focused on the nested NER. The span-based methods, considering the entity recognition as a span…

Computation and Language · Computer Science 2021-06-22 Zeqi Tan , Yongliang Shen , Shuai Zhang , Weiming Lu , Yueting Zhuang

We present a novel corpus for French dialect identification comprising 413,522 French text samples collected from public news websites in Belgium, Canada, France and Switzerland. To ensure an accurate estimation of the dialect…

Computation and Language · Computer Science 2022-12-16 Mihaela Gaman , Adrian-Gabriel Chifu , William Domingues , Radu Tudor Ionescu

As more and more Arabic texts emerged on the Internet, extracting important information from these Arabic texts is especially useful. As a fundamental technology, Named entity recognition (NER) serves as the core component in information…

Computation and Language · Computer Science 2023-08-09 Xiaoye Qu , Yingjie Gu , Qingrong Xia , Zechang Li , Zhefeng Wang , Baoxing Huai

In the third shared task of the Computational Approaches to Linguistic Code-Switching (CALCS) workshop, we focus on Named Entity Recognition (NER) on code-switched social-media data. We divide the shared task into two competitions based on…

Computation and Language · Computer Science 2019-06-11 Gustavo Aguilar , Fahad AlGhamdi , Victor Soto , Mona Diab , Julia Hirschberg , Thamar Solorio

Recently, considerable literature has grown up around the theme of few-shot named entity recognition (NER), but little published benchmark data specifically focused on the practical and challenging task. Current approaches collect existing…

Computation and Language · Computer Science 2021-09-02 Ning Ding , Guangwei Xu , Yulin Chen , Xiaobin Wang , Xu Han , Pengjun Xie , Hai-Tao Zheng , Zhiyuan Liu

Recent research efforts have shown that neural architectures can be effective in conventional information extraction tasks such as named entity recognition, yielding state-of-the-art results on standard newswire datasets. However, despite…

Computation and Language · Computer Science 2018-10-16 Bill Yuchen Lin , Wei Lu

In terms of annotation structure, most learner corpora rely on holistic flat label inventories which, even when extensive, do not explicitly separate multiple linguistic dimensions. This makes linguistically deep annotation difficult and…

Computation and Language · Computer Science 2026-02-04 Elif Sayar , Tolgahan Türker , Anna Golynskaia Knezhevich , Bihter Dereli , Ayşe Demirhas , Lionel Nicolas , Gülşen Eryiğit

For several purposes in Natural Language Processing (NLP), such as Information Extraction, Sentiment Analysis or Chatbot, Named Entity Recognition (NER) holds an important role as it helps to determine and categorize entities in text into…

Computation and Language · Computer Science 2020-03-24 Thong Nguyen , Duy Nguyen , Pramod Rao