English
Related papers

Related papers: Tagging French -- comparing a statistical and a co…

200 papers

This paper compares a qualitative reasoning model of translation with a quantitative statistical model. We consider these models within the context of two hypothetical speech translation systems, starting with a logic-based design and…

cmp-lg · Computer Science 2008-02-03 Hiyan Alshawi

Labeling of sentence boundaries is a necessary prerequisite for many natural language processing tasks, including part-of-speech tagging and sentence alignment. End-of-sentence punctuation marks are ambiguous; to disambiguate them most…

cmp-lg · Computer Science 2008-02-03 David D. Palmer , Marti A. Hearst

Speaker identification, determining which character said each utterance in literary text, benefits many downstream tasks. Most existing approaches use expert-defined rules or rule-based features to directly approach this task, but these…

Computation and Language · Computer Science 2022-10-13 Ben Zhou , Dian Yu , Dong Yu , Dan Roth

We introduce quantitative metrics for child language acquisition to evaluate language models. Our focus is on the formal syntactic and functional discourse properties of determiners in English, which young children acquire early and…

Computation and Language · Computer Science 2026-05-28 Héctor Javier Vázquez Martínez , Charles Yang

Tagging items with descriptive annotations or keywords is a very natural way to compress and highlight information about the properties of the given entity. Over the years several methods have been proposed for extracting a hierarchy…

Information Retrieval · Computer Science 2014-01-23 Gergely Tibély , Péter Pollner , Tamás Vicsek , Gergely Palla

The goal of this thesis is to advance the exploration of the statistical language learning design space. In pursuit of that goal, the thesis makes two main theoretical contributions: (i) it identifies a new class of designs by specifying an…

cmp-lg · Computer Science 2008-02-03 Mark Lauer

In part of speech tagging by Hidden Markov Model, a statistical model is used to assign grammatical categories to words in a text. Early work in the field relied on a corpus which had been tagged by a human annotator to train the model.…

cmp-lg · Computer Science 2008-02-03 David Elworthy

In this paper, we investigate the application of text classification methods to support law professionals. We present several experiments applying machine learning techniques to predict with high accuracy the ruling of the French Supreme…

Computation and Language · Computer Science 2017-10-26 Octavia-Maria Sulea , Marcos Zampieri , Shervin Malmasi , Mihaela Vela , Liviu P. Dinu , Josef van Genabith

We present a constituency parsing algorithm that, like a supertagger, works by assigning labels to each word in a sentence. In order to maximally leverage current neural architectures, the model scores each word's tags in parallel, with…

Computation and Language · Computer Science 2020-06-30 Nikita Kitaev , Dan Klein

This paper provides a method for improving tensor-based compositional distributional models of meaning by the addition of an explicit disambiguation step prior to composition. In contrast with previous research where this hypothesis has…

Computation and Language · Computer Science 2014-08-28 Dimitri Kartsaklis , Nal Kalchbrenner , Mehrnoosh Sadrzadeh

We assume that recommender systems are more successful, when they are based on a thorough understanding of how people process information. In the current paper we test this assumption in the context of social tagging systems. Cognitive…

Information Retrieval · Computer Science 2014-05-09 Dominik Kowald , Paul Seitlinger , Christoph Trattner , Tobias Ley

A variety of statistical methods for noun compound analysis are implemented and compared. The results support two main conclusions. First, the use of conceptual association not only enables a broad coverage, but also improves the accuracy.…

cmp-lg · Computer Science 2008-02-03 Mark Lauer

A statistical classification algorithm and its application to language identification from noisy input are described. The main innovation is to compute confidence limits on the classification, so that the algorithm terminates when enough…

Computation and Language · Computer Science 2007-05-23 David Elworthy

Recent years have seen a number of proposals for performing Natural Language Generation (NLG) based in large part on statistical techniques. Despite having many attractive features, we argue that these existing approaches nonetheless have…

Computation and Language · Computer Science 2020-12-29 Xiao Li , Kees van Deemter , Chenghua Lin

Many studies in the neurosciences have dealt with the semantic processing of words or categories, but few have looked into the semantic organization of the lexicon thought as a system. The present study was designed to try to move towards…

Neurons and Cognition · Quantitative Biology 2017-10-12 Sabine Ploux , Rui Wang , ZhengFeng Zhong , Hai Zhao , Yang Xin , Bao-Liang Lu

Statistical significance testing of differences in values of metrics like recall, precision and balanced F-score is a necessary part of empirical natural language processing. Unfortunately, we find in a set of experiments that many commonly…

Computation and Language · Computer Science 2007-05-23 Alexander Yeh

In survival studies, classical inferences for left-truncated data require quasi-independence, a property that the joint density of truncation time and failure time is factorizable into their marginal densities in the observable region. The…

Methodology · Statistics 2019-04-16 Young-Geun Choi , Wei-Yann Tsai , Myunghee Cho Paik

Today's probabilistic language generators fall short when it comes to producing coherent and fluent text despite the fact that the underlying models perform well under standard metrics, e.g., perplexity. This discrepancy has puzzled the…

Computation and Language · Computer Science 2025-06-06 Clara Meister , Tiago Pimentel , Gian Wiher , Ryan Cotterell

In this work we tackle the problem of sentence boundary detection applied to French as a binary classification task ("sentence boundary" or "not sentence boundary"). We combine convolutional neural networks with subword-level information…

Computation and Language · Computer Science 2018-02-14 Carlos-Emiliano González-Gallardo , Juan-Manuel Torres-Moreno

In this paper, we introduce a new modeling approach of texts for handwriting recognition based on syllables. We propose a supervised syllabification approach for the French and English languages for building a vocabulary of syllables.…

Computer Vision and Pattern Recognition · Computer Science 2018-08-23 Wassim Swaileh , Thierry Paquet