English
Related papers

Related papers: Falling Through the Gaps: Neural Architectures as …

200 papers

Neural networks have long been at the center of a debate around the cognitive mechanism by which humans process inflectional morphology. This debate has gravitated into NLP by way of the question: Are neural networks a feasible account for…

Computation and Language · Computer Science 2022-10-25 Adam Wiemerslage , Shiran Dudy , Katharina Kann

The use of Deep Neural Network architectures for Language Modeling has recently seen a tremendous increase in interest in the field of NLP with the advent of transfer learning and the shift in focus from rule-based and predictive models…

Computation and Language · Computer Science 2019-12-04 Octavia-Maria Sulea , Steve Young

Can artificial neural networks learn to represent inflectional morphology and generalize to new words as human speakers do? Kirov and Cotterell (2018) argue that the answer is yes: modern Encoder-Decoder (ED) architectures learn human-like…

Computation and Language · Computer Science 2020-12-21 Kate McCurdy , Sharon Goldwater , Adam Lopez

There is an ongoing debate on whether neural networks can grasp the quasi-regularities in languages like humans. In a typical quasi-regularity task, English past tense inflections, the neural network model has long been criticized that it…

Computation and Language · Computer Science 2023-05-16 Xiaomeng Ma , Lingyu Gao

Recursive processing is considered a hallmark of human linguistic abilities. A recent study evaluated recursive processing in recurrent neural language models (RNN-LMs) and showed that such models perform below chance level on embedded…

Computation and Language · Computer Science 2021-10-15 Yair Lakretz , Théo Desbordes , Dieuwke Hupkes , Stanislas Dehaene

Inflection is an essential part of every human language's morphology, yet little effort has been made to unify linguistic theory and computational methods in recent years. Methods of string manipulation are used to infer inflectional…

Computation and Language · Computer Science 2020-09-07 Eleni Metheniti , Guenter Neumann , Josef van Genabith

Neural language models trained with a predictive or masked objective have proven successful at capturing short and long distance syntactic dependencies. Here, we focus on verb argument structure in German, which has the interesting property…

Computation and Language · Computer Science 2021-03-05 Charlotte Rochereau , Benoît Sagot , Emmanuel Dupoux

In the domain of Morphology, Inflection is a fundamental and important task that gained a lot of traction in recent years, mostly via SIGMORPHON's shared-tasks. With average accuracy above 0.9 over the scores of all languages, the task is…

Computation and Language · Computer Science 2022-03-22 Omer Goldman , David Guriel , Reut Tsarfaty

Current approaches to incorporating terminology constraints in machine translation (MT) typically assume that the constraint terms are provided in their correct morphological forms. This limits their application to real-world scenarios…

Computation and Language · Computer Science 2021-10-11 Weijia Xu , Marine Carpuat

This study addresses a series of methodological questions that arise when modeling inflectional morphology with Linear Discriminative Learning. Taking the semi-productive German noun system as example, we illustrate how decisions made about…

Computation and Language · Computer Science 2021-11-19 Maria Heitmeier , Yu-Ying Chuang , R. Harald Baayen

Neural morphological generation systems often achieve high aggregate accuracy on benchmark datasets, yet such performance can conceal systematic errors concentrated in rare morphological subclasses. We examine Japanese past-tense verb…

Computation and Language · Computer Science 2026-05-25 Wen Zhang

The cognitive reality of irregular morphological patterns has been debated for decades: do speakers extend them to novel forms, or are they lexical artifacts? A neural network trained on distributional input offers a learnability test: if…

Computation and Language · Computer Science 2026-05-26 Akhilesh Kakolu Ramarao , Kevin Tang , Dinah Baer-Henney

Morphological declension, which aims to inflect nouns to indicate number, case and gender, is an important task in natural language processing (NLP). This research proposal seeks to address the degree to which Recurrent Neural Networks…

Computation and Language · Computer Science 2018-10-10 Sina Ahmadi

We investigate the extent to which modern, neural language models are susceptible to structural priming, the phenomenon whereby the structure of a sentence makes the same structure more probable in a follow-up sentence. We explore how…

Computation and Language · Computer Science 2022-06-30 Arabella Sinclair , Jaap Jumelet , Willem Zuidema , Raquel Fernández

This study evaluates the performance of Recurrent Neural Network (RNN) and Transformer models in replicating cross-language structural priming, a key indicator of abstract grammatical representations in human language processing. Focusing…

Computation and Language · Computer Science 2024-10-17 Demi Zhang , Bushi Xiao , Chao Gao , Sangpil Youm , Bonnie J Dorr

Neural machine translation (NMT) suffers a performance deficiency when a limited vocabulary fails to cover the source or target side adequately, which happens frequently when dealing with morphologically rich languages. To address this…

Computation and Language · Computer Science 2018-01-12 Kai Song , Yue Zhang , Min Zhang , Weihua Luo

Deep learning sequence models have been successfully applied to the task of morphological inflection. The results of the SIGMORPHON shared tasks in the past several years indicate that such models can perform well, but only if the training…

Computation and Language · Computer Science 2021-04-15 Ling Liu , Mans Hulden

Recurrent neural networks (RNNs) have long been an architecture of interest for computational models of human sentence processing. The recently introduced Transformer architecture outperforms RNNs on many natural language processing tasks…

Computation and Language · Computer Science 2022-03-31 Danny Merkx , Stefan L. Frank

Over the past decade, various studies have addressed how speakers solve the so-called `The Paradigm Cell Filling Problem' (PCFP) \citep{ackerman2009parts} across different languages. The PCFP addresses a fundamental question in…

Computation and Language · Computer Science 2025-08-26 Akhilesh Kakolu Ramarao , Kevin Tang , Dinah Baer-Henney

Nen verbal morphology is remarkably complex; a transitive verb can take up to 1,740 unique forms. The combined effect of having a large combinatoric space and a low-resource setting amplifies the need for NLP tools. Nen morphology utilises…

Computation and Language · Computer Science 2020-12-08 Saliha Muradoğlu , Nicholas Evans , Ekaterina Vylomova
‹ Prev 1 2 3 10 Next ›