English
Related papers

Related papers: Using Letter Positional Probabilities to Assess Wo…

200 papers

Text classification is one of the most widely studied tasks in natural language processing. Motivated by the principle of compositionality, large multilayer neural network models have been employed for this task in an attempt to effectively…

Computation and Language · Computer Science 2018-08-07 Devendra Singh Sachan , Manzil Zaheer , Ruslan Salakhutdinov

Much like sentences are composed of words, words themselves are composed of smaller units. For example, the English word questionably can be analyzed as question+able+ly. However, this structural decomposition of the word does not directly…

Computation and Language · Computer Science 2018-11-13 Ryan Cotterell , Hinrich Schütze

Large Language Models (LLMs) are widely used to evaluate natural language generation tasks as automated metrics. However, the likelihood, a measure of LLM's plausibility for a sentence, can vary due to superficial differences in sentences,…

Computation and Language · Computer Science 2025-11-11 Masanari Oi , Masahiro Kaneko , Ryuto Koike , Mengsay Loem , Naoaki Okazaki

Most research related to unithood were conducted as part of a larger effort for the determination of termhood. Consequently, novelties are rare in this small sub-field of term extraction. In addition, existing work were mostly empirically…

Artificial Intelligence · Computer Science 2008-10-02 Wilson Wong , Wei Liu , Mohammed Bennamoun

Word-level psycholinguistic norms lend empirical support to theories of language processing. However, obtaining such human-based measures is not always feasible or straightforward. One promising approach is to augment human norming datasets…

Children can use the statistical regularities of their environment to learn word meanings, a mechanism known as cross-situational learning. We take a computational approach to investigate how the information present during each observation…

Computation and Language · Computer Science 2017-02-23 Aida Nematzadeh , Barend Beekhuizen , Shanshan Huang , Suzanne Stevenson

Words of estimative probability (WEPs), such as ''maybe'' or ''probably not'' are ubiquitous in natural language for communicating estimative uncertainty, compared with direct statements involving numerical probability. Human estimative…

Computation and Language · Computer Science 2024-05-27 Zhisheng Tang , Ke Shen , Mayank Kejriwal

Semantic textual similarity is one of the open research challenges in the field of Natural Language Processing. Extensive research has been carried out in this field and near-perfect results are achieved by recent transformer-based models…

Computation and Language · Computer Science 2021-07-13 Dhivya Chandrasekaran , Vijay Mago

Lexical complexity prediction (LCP) is the task of predicting the complexity of words in a text on a continuous scale. It plays a vital role in simplifying or annotating complex words to assist readers. To study lexical complexity in…

Computation and Language · Computer Science 2023-07-03 Yusuke Ide , Masato Mita , Adam Nohejl , Hiroki Ouchi , Taro Watanabe

The review summarizes the main methodological concepts used in studying natural language from the perspective of complexity science and documents their applicability in identifying both universal and system-specific features of language in…

Physics and Society · Physics 2024-01-09 Tomasz Stanisz , Stanisław Drożdż , Jarosław Kwapień

We describe a novel language-independent approach to the task of determining the polarity, positive or negative, of the author's opinion on a specific topic in natural language text. In particular, weights are assigned to attributes,…

Computation and Language · Computer Science 2019-12-02 Veselin Raychev , Preslav Nakov

We examine the complexity of inference in Bayesian networks specified by logical languages. We consider representations that range from fragments of propositional logic to function-free first-order logic with equality; in doing so we cover…

Artificial Intelligence · Computer Science 2017-01-09 Fabio Gagliardi Cozman , Denis Deratani Mauá

In many applications of natural language processing it is necessary to determine the likelihood of a given word combination. For example, a speech recognizer may need to determine which of the two word combinations ``eat a peach'' and ``eat…

cmp-lg · Computer Science 2008-02-03 Ido Dagan , Fernando Pereira , Lillian Lee

The emergence of large language models (LLMs) has revolutionized numerous applications across industries. However, their "black box" nature often hinders the understanding of how they make specific decisions, raising concerns about their…

Artificial Intelligence · Computer Science 2024-03-06 Stefan Hackmann , Haniyeh Mahmoudian , Mark Steadman , Michael Schmidt

Distinguishing between arguments and adjuncts of a verb is a longstanding, nontrivial problem. In natural language processing, argumenthood information is important in tasks such as semantic role labeling (SRL) and prepositional phrase (PP)…

Computation and Language · Computer Science 2019-04-16 Najoung Kim , Kyle Rawlins , Benjamin Van Durme , Paul Smolensky

We consider the set of finite random words $\mathcal A^\star$, with independent letters drawn from a finite or infinite totally ordered alphabet according to a general probability distribution. On a specific subset of $\mathcal A^\star$,…

Probability · Mathematics 2012-04-22 Elahe Zohoorian Azad

This paper describes the automation of a new text categorization task. The categories assigned in this task are more syntactically, semantically, and contextually complex than those typically assigned by fully automatic systems that process…

cmp-lg · Computer Science 2007-05-23 Janyce Wiebe , Rebecca Bruce , Lei Duan

This document discusses an approach and its rudimentary realization towards automatic classification of PPs; the topic, that has not received as much attention in NLP as NPs and VPs. The approach is a rule-based heuristics outlined in…

Computation and Language · Computer Science 2010-02-08 Frank Rudzicz , Serguei A. Mokhov

Despite growing interest in using Large Language Models (LLMs) for educational assessment, it remains unclear how closely they align with human scoring. We present a systematic evaluation of instruction-tuned LLMs across three open…

Computation and Language · Computer Science 2026-04-02 Filip J. Kucia , Anirban Chakraborty , Anna Wróblewska

Conceptual combination performs a fundamental role in creating the broad range of compound phrases utilized in everyday language. This article provides a novel probabilistic framework for assessing whether the semantics of conceptual…

Computation and Language · Computer Science 2014-11-24 Peter D. Bruza , Kirsty Kitto , Brentyn J. Ramm , Laurianne Sitbon