English
Related papers

Related papers: ThaiCoref: Thai Coreference Resolution Dataset

200 papers

Datasets are foundational to many breakthroughs in modern artificial intelligence. Many recent achievements in the space of natural language processing (NLP) can be attributed to the finetuning of pre-trained models on a diverse set of…

Bias-measuring datasets play a critical role in detecting biased behavior of language models and in evaluating progress of bias mitigation methods. In this work, we focus on evaluating gender bias through coreference resolution, where…

Computation and Language · Computer Science 2023-02-14 Zhongbin Xie , Vid Kocijan , Thomas Lukasiewicz , Oana-Maria Camburu

Named Entity Recognition (NER) is a fundamental task in natural language processing that involves identifying and classifying named entities in text. But much work hasn't been done for complex named entity recognition in Bangla, despite…

Computation and Language · Computer Science 2023-03-20 HAZ Sameen Shahgir , Ramisa Alam , Md. Zarif Ul Alam

India's rich cultural and linguistic diversity poses various challenges in the domain of Natural Language Processing (NLP), particularly in Named Entity Recognition (NER). NER is a NLP task that aims to identify and classify tokens into…

Computation and Language · Computer Science 2025-02-07 Mohammed Amaan Dhamaskar , Rasika Ransing

Coreference resolution across multiple documents poses a significant challenge in natural language processing, particularly within the domain of knowledge graphs. This study introduces an innovative method aimed at identifying and resolving…

Computation and Language · Computer Science 2025-04-09 Zhang Dong , Mingbang Wang , Songhang deng , Le Dai , Jiyuan Li , Xingzu Liu , Ruilin Nong

Knowledge is central to human and scientific developments. Natural Language Processing (NLP) allows automated analysis and creation of knowledge. Data is a crucial NLP and machine learning ingredient. The scarcity of open datasets is a…

Computation and Language · Computer Science 2022-10-19 Istiak Ahmad , Fahad AlQurashi , Rashid Mehmood

We introduce KyrgyzNER, the first manually annotated named entity recognition dataset for the Kyrgyz language. Comprising 1,499 news articles from the 24.KG news portal, the dataset contains 10,900 sentences and 39,075 entity mentions…

Computation and Language · Computer Science 2025-09-24 Timur Turatali , Anton Alekseev , Gulira Jumalieva , Gulnara Kabaeva , Sergey Nikolenko

Large Language Models (LLMs) excel in general tasks but struggle with domain-specific challenges, such as specialized terminology and localized regulations. Existing financial LLMs, like FinGPT and BloombergGPT, lack support for the Thai…

CODEC is a document and entity ranking benchmark that focuses on complex research topics. We target essay-style information needs of social science researchers, i.e. "How has the UK's Open Banking Regulation benefited Challenger Banks?".…

Information Retrieval · Computer Science 2022-05-18 Iain Mackie , Paul Owoicho , Carlos Gemmell , Sophie Fischer , Sean MacAvaney , Jeffrey Dalton

Southeast Asia (SEA) is a region rich in linguistic diversity and cultural variety, with over 1,300 indigenous languages and a population of 671 million people. However, prevailing AI models suffer from a significant lack of representation…

This paper describes our approach to the CRAC 2022 Shared Task on Multilingual Coreference Resolution. Our model is based on a state-of-the-art end-to-end coreference resolution system. Apart from joined multilingual training, we improved…

Computation and Language · Computer Science 2022-09-27 Ondřej Pražák , Miloslav Konopík

This paper suggests a direction of coreference resolution for online decoding on actively generated input such as dialogue, where the model accepts an utterance and its past context, then finds mentions in the current utterance as well as…

Computation and Language · Computer Science 2022-05-24 Liyan Xu , Jinho D. Choi

In this paper, we present coreference resolution experiments with a newly created multilingual corpus CorefUD. We focus on the following languages: Czech, Russian, Polish, German, Spanish, and Catalan. In addition to monolingual…

Computation and Language · Computer Science 2021-09-06 Ondřej Pražák , Miloslav Konopík , Jakub Sido

High throughput extraction and structured labeling of data from academic articles is critical to enable downstream machine learning applications and secondary analyses. We have embedded multimodal data curation into the academic publishing…

Computation and Language · Computer Science 2024-09-26 Jorge Abreu-Vicente , Hannah Sonntag , Thomas Eidens , Cassie S. Mitchell , Thomas Lemberger

Newly-introduced deep learning architectures, namely BERT, XLNet, RoBERTa and ALBERT, have been proved to be robust on several NLP tasks. However, the datasets trained on these architectures are fixed in terms of size and generalizability.…

Computation and Language · Computer Science 2020-09-29 Jean-Philippe Corbeil , Hadi Abdi Ghadivel

While WangchanBERTa has become the de facto standard in transformer-based Thai language modeling, it still has shortcomings in regard to the understanding of foreign words, most notably English words, which are often borrowed without…

Computation and Language · Computer Science 2025-11-18 Panyut Sriwirote , Jalinee Thapiang , Vasan Timtong , Attapol T. Rutherford

Anthropogenic ecological crisis constitutes a significant challenge that all within the academy must urgently face, including the Natural Language Processing (NLP) community. While recent years have seen increasing work revolving around…

Computation and Language · Computer Science 2025-10-30 Francesca Grasso , Stefano Locci , Giovanni Siragusa , Luigi Di Caro

Pronoun resolution is part of coreference resolution, the task of pairing an expression to its referring entity. This is an important task for natural language understanding and a necessary component of machine translation systems, chat…

Computation and Language · Computer Science 2019-06-14 Matei Ionita , Yury Kashnitsky , Ken Krige , Vladimir Larin , Denis Logvinenko , Atanas Atanasov

Dialogue relation extraction (DRE) that identifies the relations between argument pairs in dialogue text, suffers much from the frequent occurrence of personal pronouns, or entity and speaker coreference. This work introduces a new…

Computation and Language · Computer Science 2023-08-15 Yiyun Xiong , Mengwei Dai , Fei Li , Hao Fei , Bobo Li , Shengqiong Wu , Donghong Ji , Chong Teng

Relation extraction (RE) is a fundamental task in information extraction, whose extension to multilingual settings has been hindered by the lack of supervised resources comparable in size to large English datasets such as TACRED (Zhang et…

Computation and Language · Computer Science 2023-05-16 Leonhard Hennig , Philippe Thomas , Sebastian Möller