English
Related papers

Related papers: CKMorph: A Comprehensive Morphological Analyzer fo…

200 papers

The Lloyd-Max algorithm is a classical approach to perform K-means clustering. Unfortunately, its cost becomes prohibitive as the training dataset grows large. We propose a compressive version of K-means (CKM), that estimates cluster…

Machine Learning · Computer Science 2017-02-13 Nicolas Keriven , Nicolas Tremblay , Yann Traonmilin , Rémi Gribonval

This survey offers a comprehensive overview of Large Language Models (LLMs) designed for Arabic language and its dialects. It covers key architectures, including encoder-only, decoder-only, and encoder-decoder models, along with the…

Computation and Language · Computer Science 2026-05-20 Malak Mashaabi , Shahad Al-Khalifa , Hend Al-Khalifa

Identifying polyps is challenging for automatic analysis of endoscopic images in computer-aided clinical support systems. Models based on convolutional networks (CNN), transformers, and their combinations have been proposed to segment…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Nguyen Thanh Duc , Nguyen Thi Oanh , Nguyen Thi Thuy , Tran Minh Triet , Dinh Viet Sang

Concerns about benchmark leakage in large language models for code (Code LLMs) have raised issues of data contamination and inflated evaluation metrics. The diversity and inaccessibility of many training datasets make it difficult to…

Software Engineering · Computer Science 2025-06-24 Hongzhou Rao , Yanjie Zhao , Wenjie Zhu , Ling Xiao , Meizhen Wang , Haoyu Wang

The outstanding performance of transformer-based language models on a great variety of NLP and NLU tasks has stimulated interest in exploring their inner workings. Recent research has focused primarily on higher-level and complex linguistic…

Computation and Language · Computer Science 2021-05-06 Vladislav Mikhailov , Oleg Serikov , Ekaterina Artemova

The Universal Morphology (UniMorph) project is a collaborative effort providing broad-coverage instantiated normalized morphological inflection tables for hundreds of diverse world languages. The project comprises two major thrusts: a…

Computation and Language · Computer Science 2022-06-22 Khuyagbaatar Batsuren , Omer Goldman , Salam Khalifa , Nizar Habash , Witold Kieraś , Gábor Bella , Brian Leonard , Garrett Nicolai , Kyle Gorman , Yustinus Ghanggo Ate , Maria Ryskina , Sabrina J. Mielke , Elena Budianskaya , Charbel El-Khaissi , Tiago Pimentel , Michael Gasser , William Lane , Mohit Raj , Matt Coler , Jaime Rafael Montoya Samame , Delio Siticonatzi Camaiteri , Benoît Sagot , Esaú Zumaeta Rojas , Didier López Francis , Arturo Oncevay , Juan López Bautista , Gema Celeste Silva Villegas , Lucas Torroba Hennigen , Adam Ek , David Guriel , Peter Dirix , Jean-Philippe Bernardy , Andrey Scherbakov , Aziyana Bayyr-ool , Antonios Anastasopoulos , Roberto Zariquiey , Karina Sheifer , Sofya Ganieva , Hilaria Cruz , Ritván Karahóǧa , Stella Markantonatou , George Pavlidis , Matvey Plugaryov , Elena Klyachko , Ali Salehi , Candy Angulo , Jatayu Baxi , Andrew Krizhanovsky , Natalia Krizhanovskaya , Elizabeth Salesky , Clara Vania , Sardana Ivanova , Jennifer White , Rowan Hall Maudslay , Josef Valvoda , Ran Zmigrod , Paula Czarnowska , Irene Nikkarinen , Aelita Salchak , Brijesh Bhatt , Christopher Straughn , Zoey Liu , Jonathan North Washington , Yuval Pinter , Duygu Ataman , Marcin Wolinski , Totok Suhardijanto , Anna Yablonskaya , Niklas Stoehr , Hossep Dolatian , Zahroh Nuriah , Shyam Ratan , Francis M. Tyers , Edoardo M. Ponti , Grant Aiton , Aryaman Arora , Richard J. Hatcher , Ritesh Kumar , Jeremiah Young , Daria Rodionova , Anastasia Yemelina , Taras Andrushko , Igor Marchenko , Polina Mashkovtseva , Alexandra Serova , Emily Prud'hommeaux , Maria Nepomniashchaya , Fausto Giunchiglia , Eleanor Chodroff , Mans Hulden , Miikka Silfverberg , Arya D. McCarthy , David Yarowsky , Ryan Cotterell , Reut Tsarfaty , Ekaterina Vylomova

Identification of the languages written using cuneiform symbols is a difficult task due to the lack of resources and the problem of tokenization. The Cuneiform Language Identification task in VarDial 2019 addresses the problem of…

Computation and Language · Computer Science 2020-09-24 Ehsan Doostmohammadi , Minoo Nassajian

Large Language Models (LLMs) perform well on many reasoning benchmarks, yet existing evaluations rarely assess their ability to distinguish between meaningful semantic relations and genuine unrelatedness. We introduce CORE (Comprehensive…

Large language models (LLMs) have demonstrated significant progress in various natural language generation and understanding tasks. However, their linguistic generalization capabilities remain questionable, raising doubts about whether…

The Facebook application is used as a resource for collecting the comments of this dataset, The dataset consists of 6756 comments to create a Medical Kurdish Dataset (MKD). The samples are comments of users, which are gathered from…

Computation and Language · Computer Science 2022-04-21 Ari M. Saeed , Shnya R. Hussein , Chro M. Ali , Tarik A. Rashid

We introduced the contemporary Amharic corpus, which is automatically tagged for morpho-syntactic information. Texts are collected from 25,199 documents from different domains and about 24 million orthographic words are tokenized. Since it…

Computation and Language · Computer Science 2021-06-15 Andargachew Mekonnen Gezmu , Binyam Ephrem Seyoum , Michael Gasser , Andreas Nürnberger

Kurdish libraries have many historical publications that were printed back in the early days when printing devices were brought to Kurdistan. Having a good Optical Character Recognition (OCR) to help process these publications and…

Computation and Language · Computer Science 2024-04-10 Blnd Yaseen , Hossein Hassani

While multilingual large language models (LLMs) perform well on high-level tasks like translation and question answering, their ability to handle grammatical gender and morphological agreement remains underexplored. In morphologically rich…

Computation and Language · Computer Science 2026-04-22 Mehul Agarwal , Aditya Aggarwal , Arnav Goel , Medha Hira , Anubha Gupta

In the development of Large Language Models (LLMs), considerable attention has been given to the quality of training datasets. However, the role of tokenizers in the LLM training pipeline, particularly for multilingual models, has received…

Computation and Language · Computer Science 2024-10-18 Iaroslav Chelombitko , Egor Safronov , Aleksey Komissarov

Despite an ever growing number of word representation models introduced for a large number of languages, there is a lack of a standardized technique to provide insights into what is captured by these models. Such insights would help the…

Computation and Language · Computer Science 2019-12-12 Gözde Gül Şahin , Clara Vania , Ilia Kuznetsov , Iryna Gurevych

This paper addresses critical gaps in Arabic language model evaluation by establishing comprehensive theoretical guidelines and introducing a novel evaluation framework. We first analyze existing Arabic evaluation datasets, identifying…

Computation and Language · Computer Science 2025-06-03 Serry Sibaee , Omer Nacar , Adel Ammar , Yasser Al-Habashi , Abdulrahman Al-Batati , Wadii Boulila

This study investigates the relationship between the phonological and morphological structure of Polish words and their meanings using Distributional Semantics. In the present analysis, we ask whether there is a relationship between the…

Computation and Language · Computer Science 2026-04-02 Paula Orzechowska , R. Harald Baayen

This research paper presents a part-of-speech (POS) annotated dataset and tagger tool for the low-resource Uzbek language. The dataset includes 12 tags, which were used to develop a rule-based POS-tagger tool. The corpus text used in the…

Computation and Language · Computer Science 2023-03-02 Maksud Sharipov , Elmurod Kuriyozov , Ollabergan Yuldashev , Ogabek Sobirov

Quantitative chemistry is central to modern chemical research, yet the ability of large language models (LLMs) to perform its rigorous, step-by-step calculations remains underexplored. To fill this blank, we propose QCBench, a Quantitative…

Artificial Intelligence · Computer Science 2025-11-05 Jiaqing Xie , Weida Wang , Ben Gao , Zhuo Yang , Haiyuan Wan , Shufei Zhang , Tianfan Fu , Yuqiang Li

There is no or little work on natural language processing of Tangkhul language. The current work is a humble beginning of morphological processing of this language using an unsupervised approach. We use a small corpus collected from…

Computation and Language · Computer Science 2020-06-30 Mirinso Shadang , Navanath Saharia , Thoudam Doren Singh