English
Related papers

Related papers: Comparing a statistical and a rule-based tagger fo…

200 papers

Natural language processing (NLP) applied to information retrieval (IR) and filtering problems may assign part-of-speech tags to terms and, more generally, modify queries and documents. Analytic models can predict the performance of a text…

cmp-lg · Computer Science 2008-02-03 Robert M. Losee

Many studies have shown that human languages tend to optimize for lower complexity and increased communication efficiency. Syntactic dependency distance, which measures the linear distance between dependent words, is often considered a key…

Computation and Language · Computer Science 2024-03-29 Yanran Chen , Wei Zhao , Anne Breitbarth , Manuel Stoeckel , Alexander Mehler , Steffen Eger

This paper explores the usefulness of a technique from software engineering, namely code instrumentation, for the development of large-scale natural language grammars. Information about the usage of grammar rules in test sentences is used…

Computation and Language · Computer Science 2007-05-23 Norbert Broeker

In this paper, we investigate the use of selectional restriction -- the constraints a predicate imposes on its arguments -- in a language model for speech recognition. We use an un-tagged corpus, followed by a public domain tagger and a…

cmp-lg · Computer Science 2008-02-03 Joerg P. Ueberla

We propose a system for parsing and translating natural language that learns from examples and uses some background knowledge. As our parsing model we choose a deterministic shift-reduce type parser that integrates part-of-speech tagging…

cmp-lg · Computer Science 2008-02-03 Ulf Hermjakob

Traditional natural language parsers are based on rewrite rule systems developed in an arduous, time-consuming manner by grammarians. A majority of the grammarian's efforts are devoted to the disambiguation process, first hypothesizing…

cmp-lg · Computer Science 2016-08-31 David M. Magerman

There has been substantial progress in the inference of formal behavioural specifications from sample trajectories, for example, using Linear Temporal Logic (LTL). However, these techniques cannot handle specifications that correctly…

Logic in Computer Science · Computer Science 2025-05-20 Rajarshi Roy , Yash Pote , David Parker , Marta Kwiatkowska

In this study, we evaluated the performance of the state-of-the-art sequence tagging grammar error detection and correction model (SeqTagger) using Japanese university students' writing samples. With an automatic annotation toolkit, ERRANT,…

Computation and Language · Computer Science 2024-03-01 Qiao Wang , Zheng Yuan

Classification rules can be severely affected by the presence of disturbing observations in the training sample. Looking for an optimal classifier with such data may lead to unnecessarily complex rules. So, simpler effective classification…

Statistics Theory · Mathematics 2017-01-19 Marina Antolín , Eustasio Del Barrio , Jean-Michel Loubes

Competitive programming remains a very popular activity that combines both software engineering and education. In order to prepare and to practice, contestants use extensive archives of problems from past contents available on various…

Software Engineering · Computer Science 2023-01-12 Artyom Lobanov , Egor Bogomolov , Yaroslav Golubev , Mikhail Mirzayanov , Timofey Bryksin

This paper describes two applications of conditional restricted Boltzmann machines (CRBMs) to the task of autotagging music. The first consists of training a CRBM to predict tags that a user would apply to a clip of a song based on tags…

Machine Learning · Computer Science 2011-03-16 Michael Mandel , Razvan Pascanu , Hugo Larochelle , Yoshua Bengio

We present a constituency parsing algorithm that, like a supertagger, works by assigning labels to each word in a sentence. In order to maximally leverage current neural architectures, the model scores each word's tags in parallel, with…

Computation and Language · Computer Science 2020-06-30 Nikita Kitaev , Dan Klein

In statistical classification/multiple hypothesis testing and machine learning, a model distribution estimated from the training data is usually applied to replace the unknown true distribution in the Bayes decision rule, which introduces a…

Information Theory · Computer Science 2024-09-24 Zijian Yang , Vahe Eminyan , Ralf Schlüter , Hermann Ney

Words unknown to the lexicon present a substantial problem to part-of-speech tagging. In this paper we present a technique for fully unsupervised statistical acquisition of rules which guess possible parts-of-speech for unknown words. Three…

cmp-lg · Computer Science 2008-02-03 Andrei Mikheev

Early detection of security bug reports (SBRs) is crucial for preventing vulnerabilities and ensuring system reliability. While machine learning models have been developed for SBR prediction, their predictive performance still has room for…

Cryptography and Security · Computer Science 2025-05-01 Farnaz Soltaniani , Mohammad Ghafari , Mohammed Sayagh

Structural generalization in semantic parsing requires systems to apply learned compositional rules to novel structural combinations. Existing approaches either rely on hand-written algebraic rules (AM-Parser) or fail to generalize…

Computation and Language · Computer Science 2026-05-11 Zichao Wei

Error detection facilities for dynamic languages are often based on unit testing. Thus, the advantage of rapid prototyping and flexibility must be weighed against cumbersome and time consuming test suite development. Lindahl and Sagonas'…

Programming Languages · Computer Science 2013-06-24 Robert Jakob , Peter Thiemann

An experiment designed to explore the relationship between tagging accuracy and the nature of the tagset is described, using corpora in English, French and Swedish. In particular, the question of internal versus external criteria for tagset…

cmp-lg · Computer Science 2008-02-03 David Elworthy

This paper presents a comparison of classification methods for linguistic typology for the purpose of expanding an extensive, but sparse language resource: the World Atlas of Language Structures (WALS) (Dryer and Haspelmath, 2013). We…

Computation and Language · Computer Science 2016-04-28 Reed Coke , Ben King , Dragomir Radev

Score-based algorithms for tuberculosis (TB) verbal screening perform poorly, causing misclassification that leads to missed cases and unnecessary costly laboratory tests for false positives. We compared score-based classification defined…

Machine Learning · Computer Science 2020-11-17 Ali Akbar Septiandri , Aditiawarman , Roy Tjiong , Erlina Burhan , Anuraj Shankar