English
Related papers

Related papers: Open-Source Web Service with Morphological Diction…

200 papers

We introduce an extensive dataset for multilingual probing of morphological information in language models (247 tasks across 42 languages from 10 families), each consisting of a sentence with a target word and a morphological tag as the…

Computation and Language · Computer Science 2024-11-20 Judit Acs , Endre Hamerlik , Roy Schwartz , Noah A. Smith , Andras Kornai

Morphologically rich languages accentuate two properties of distributional vector space models: 1) the difficulty of inducing accurate representations for low-frequency word forms; and 2) insensitivity to distinct lexical relations that…

Computation and Language · Computer Science 2017-06-02 Ivan Vulić , Nikola Mrkšić , Roi Reichart , Diarmuid Ó Séaghdha , Steve Young , Anna Korhonen

In this resource paper, we present DHPLT, an open collection of diachronic corpora in 41 diverse languages. DHPLT is based on the web-crawled HPLT datasets; we use web crawl timestamps as the approximate signal of document creation time.…

Computation and Language · Computer Science 2026-02-13 Mariia Fedorova , Andrey Kutuzov , Khonzoda Umarova

Universal Language Model for Fine-tuning [arXiv:1801.06146] (ULMFiT) is one of the first NLP methods for efficient inductive transfer learning. Unsupervised pretraining results in improvements on many NLP tasks for English. In this paper,…

Computation and Language · Computer Science 2018-10-25 Piotr Czapla , Jeremy Howard , Marcin Kardas

This paper introduces "Czech Text Document Corpus v 2.0", a collection of text documents for automatic document classification in Czech language. It is composed of the text documents provided by the Czech News Agency and is freely available…

Computation and Language · Computer Science 2018-02-01 Pavel Král , Ladislav Lenc

We present a richly annotated and genre-diversified language resource, the Prague Dependency Treebank-Consolidated 1.0 (PDT-C 1.0), the purpose of which is - as it always been the case for the family of the Prague Dependency Treebanks - to…

Computation and Language · Computer Science 2020-06-09 Jan Hajič , Eduard Bejček , Jaroslava Hlaváčová , Marie Mikulová , Milan Straka , Jan Štěpánek , Barbora Štěpánková

We present a novel framework for learning morphological operators using counter-harmonic mean. It combines concepts from morphology and convolutional neural networks. A thorough experimental validation analyzes basic morphological operators…

Computer Vision and Pattern Recognition · Computer Science 2012-12-12 Jonathan Masci , Jesús Angulo , Jürgen Schmidhuber

This research introduces a state-of-the-art Persian spelling correction system that seamlessly integrates deep learning techniques with phonetic analysis, significantly enhancing the accuracy and efficiency of natural language processing…

Computation and Language · Computer Science 2024-07-23 Seyed Mohammad Sadegh Dashti , Amid Khatibi Bardsiri , Mehdi Jafari Shahbazzadeh

The availability of parallel texts is crucial to the performance of machine translation models. However, most of the world's languages face the predominant challenge of data scarcity. In this paper, we propose strategies to synthesize…

Computation and Language · Computer Science 2024-02-06 Md Mahfuz Ibn Alam , Sina Ahmadi , Antonios Anastasopoulos

Mispronunciation Detection and Diagnosis (MDD) is crucial for language learning and speech therapy. Unlike conventional methods that require scoring models or training phoneme-level models, we propose a novel training-free framework that…

Computation and Language · Computer Science 2025-11-26 Huu Tuong Tu , Ha Viet Khanh , Tran Tien Dat , Vu Huan , Thien Van Luong , Nguyen Tien Cuong , Nguyen Thi Thu Trang

This paper describes CAiRE's submission to the unsupervised machine translation track of the WMT'19 news shared task from German to Czech. We leverage a phrase-based statistical machine translation (PBSMT) model and a pre-trained language…

Computation and Language · Computer Science 2019-11-19 Zihan Liu , Yan Xu , Genta Indra Winata , Pascale Fung

We describe our NMT systems submitted to the WMT19 shared task in English-Czech news translation. Our systems are based on the Transformer model implemented in either Tensor2Tensor (T2T) or Marian framework. We aimed at improving the…

Computation and Language · Computer Science 2019-07-31 Martin Popel , Dominik Macháček , Michal Auersperger , Ondřej Bojar , Pavel Pecina

Pretraining language models directly on web-scale corpora is the de facto paradigm. We study an alternative where the model is initially exposed to abstract structured data to ease the subsequent acquisition of rich semantic knowledge, much…

Computation and Language · Computer Science 2026-05-29 Liangze Jiang , Zachary Shinnick , Anton van den Hengel , Hemanth Saratchandran , Damien Teney

Metaphors are ubiquitous in natural language, and their detection plays an essential role in many natural language processing tasks, such as language understanding, sentiment analysis, etc. Most existing approaches for metaphor detection…

Computation and Language · Computer Science 2020-09-29 Shashwat Aggarwal , Ramesh Singh

In this paper we present Morphy, an integrated tool for German morphology, part-of-speech tagging and context-sensitive lemmatization. Its large lexicon of more than 320,000 word forms plus its ability to process German compound nouns…

Computation and Language · Computer Science 2007-05-23 Wolfgang Lezius , Reinhard Rapp , Manfred Wettler

Cognitive diagnosis model (CDM) is a fundamental and upstream component in intelligent education. It aims to infer students' mastery levels based on historical response logs. However, existing CDMs usually follow the ID-based embedding…

Artificial Intelligence · Computer Science 2024-10-22 Yuanhao Liu , Shuo Liu , Yimeng Liu , Jingwen Yang , Hong Qian

Large Language Models (LLMs) have achieved significant advancements, but the increasing complexity of tasks and higher performance demands highlight the need for continuous improvement. Some approaches utilize synthetic data generated by…

Artificial Intelligence · Computer Science 2025-06-23 Haokun Zhao , Jinyi Han , Jiaqing Liang , Yanghua Xiao , Xiaojun Meng , Jiansheng Wei

This work compares concept models for cross-language retrieval: First, we adapt probabilistic Latent Semantic Analysis (pLSA) for multilingual documents. Experiments with different weighting schemes show that a weighting method favoring…

Information Retrieval · Computer Science 2014-01-13 Benjamin Roth

Deep Learning (DL) components are routinely integrated into software systems that need to perform complex tasks such as image or natural language processing. The adequacy of the test data used to test such systems can be assessed by their…

Software Engineering · Computer Science 2021-09-17 Vincenzo Riccio , Nargiz Humbatova , Gunel Jahangirova , Paolo Tonella

Accessing high-quality, open-access dermatopathology image datasets for learning and cross-referencing is a common challenge for clinicians and dermatopathology trainees. To establish a comprehensive open-access dermatopathology dataset for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Ziyang Xu , Mingquan Lin , Yiliang Zhou , Zihan Xu , Seth J. Orlow , Shane A. Meehan , Alexandra Flamm , Ata S. Moshiri , Yifan Peng