English
Related papers

Related papers: Indirectly Supervised English Sentence Break Predi…

200 papers

Based on data from a large-scale experiment with human subjects, we conclude that the logarithm of probability to guess a word in context (unpredictability) depends linearly on the word length. This result holds both for poetry and prose,…

Information Theory · Computer Science 2007-07-16 Dmitrii Manin

The ability of semantic reasoning over the sentence pair is essential for many natural language understanding tasks, e.g., natural language inference and machine reading comprehension. A recent significant improvement in these tasks comes…

Computation and Language · Computer Science 2021-06-18 Weidi Xu , Xingyi Cheng , Kunlong Chen , Wei Wang , Bin Bi , Ming Yan , Chen Wu , Luo Si , Wei Chu , Taifeng Wang

Sentence embedding is one of the most fundamental tasks in Natural Language Processing and plays an important role in various tasks. The recent breakthrough in sentence embedding is achieved by pre-trained language models (PLMs). Despite…

Computation and Language · Computer Science 2023-06-06 Lingfeng Shen , Haiyun Jiang , Lemao Liu , Shuming Shi

This paper is concerned with paraphrase detection. The ability to detect similar sentences written in natural language is crucial for several applications, such as text mining, text summarization, plagiarism detection, authorship…

Information Retrieval · Computer Science 2018-07-18 Basant Agarwal , Heri Ramampiaro , Helge Langseth , Massimiliano Ruocco

The field of cross-lingual sentence embeddings has recently experienced significant advancements, but research concerning low-resource languages has lagged due to the scarcity of parallel corpora. This paper shows that cross-lingual word…

Computation and Language · Computer Science 2024-04-04 Zhongtao Miao , Qiyu Wu , Kaiyan Zhao , Zilong Wu , Yoshimasa Tsuruoka

Pragmatic inferences often subtly depend on the presence or absence of linguistic features. For example, the presence of a partitive construction (of the) increases the strength of a so-called scalar inference: listeners perceive the…

Computation and Language · Computer Science 2020-04-24 Sebastian Schuster , Yuxing Chen , Judith Degen

This paper introduces an objective metric for evaluating a parsing scheme. It is based on Shannon's original work with letter sequences, which can be extended to part-of-speech tag sequences. It is shown that this regular language is an…

cmp-lg · Computer Science 2008-02-03 Caroline Lyon , Stephen Brown

Speech evaluation measures a learners oral proficiency using automatic models. Corpora for training such models often pose sparsity challenges given that there often is limited scored data from teachers, in addition to the score…

Artificial Intelligence · Computer Science 2024-09-24 Huayun Zhang , Jeremy H. M. Wong , Geyu Lin , Nancy F. Chen

A fundamental result in psycholinguistics is that less predictable words take a longer time to process. One theoretical explanation for this finding is Surprisal Theory (Hale, 2001; Levy, 2008), which quantifies a word's predictability as…

Computation and Language · Computer Science 2025-04-15 Ethan Gotlieb Wilcox , Tiago Pimentel , Clara Meister , Ryan Cotterell , Roger P. Levy

The occurrence of unknown words in texts significantly hinders reading comprehension. To improve accessibility for specific target populations, computational modelling has been applied to identify complex words in texts and substitute them…

Computation and Language · Computer Science 2023-03-10 Kai North , Marcos Zampieri , Matthew Shardlow

We argue that semantic meanings of a sentence or clause can not be interpreted independently from the rest of a paragraph, or independently from all discourse relations and the overall paragraph-level discourse structure. With the goal of…

Computation and Language · Computer Science 2018-04-18 Zeyu Dai , Ruihong Huang

Span extraction is an essential problem in machine reading comprehension. Most of the existing algorithms predict the start and end positions of an answer span in the given corresponding context by generating two probability vectors. In…

Computation and Language · Computer Science 2020-10-01 Huaishao Luo , Yu Shi , Ming Gong , Linjun Shou , Tianrui Li

Detecting fine-grained differences in content conveyed in different languages matters for cross-lingual NLP and multilingual corpora analysis, but it is a challenging machine learning problem since annotation is expensive and hard to scale.…

Computation and Language · Computer Science 2020-10-09 Eleftheria Briakou , Marine Carpuat

Argumentative structure prediction aims to establish links between textual units and label the relationship between them, forming a structured representation for a given input text. The former task, linking, has been identified by earlier…

Computation and Language · Computer Science 2021-09-28 Jan Wira Gotama Putra , Simone Teufel , Takenobu Tokunaga

Many natural language processing tasks, e.g., coreference resolution and semantic role labeling, require selecting text spans and making decisions about them. A typical approach to such tasks is to score all possible spans and greedily…

Computation and Language · Computer Science 2023-08-24 Tianyu Liu , Yuchen Eleanor Jiang , Ryan Cotterell , Mrinmaya Sachan

Single document summarization has enjoyed renewed interests in recent years thanks to the popularity of neural network models and the availability of large-scale datasets. In this paper we develop an unsupervised approach arguing that it is…

Computation and Language · Computer Science 2019-06-11 Hao Zheng , Mirella Lapata

We propose a new unsupervised method for lexical substitution using pre-trained language models. Compared to previous approaches that use the generative capability of language models to predict substitutes, our method retrieves substitutes…

Computation and Language · Computer Science 2022-09-20 Takashi Wada , Timothy Baldwin , Yuji Matsumoto , Jey Han Lau

Learning word representations has recently seen much success in computational linguistics. However, assuming sequences of word tokens as input to linguistic analysis is often unjustified. For many languages word segmentation is a…

Computation and Language · Computer Science 2013-09-19 Grzegorz Chrupała

Recent work has found that contemporary language models such as transformers can become so good at next-word prediction that the probabilities they calculate become worse for predicting reading time. In this paper, we propose that this can…

Computation and Language · Computer Science 2026-03-11 James A. Michaelov , Roger P. Levy

In implicit discourse relation classification, we want to predict the relation between adjacent sentences in the absence of any overt discourse connectives. This is challenging even for humans, leading to shortage of annotated data, a fact…

Computation and Language · Computer Science 2021-06-08 Murathan Kurfalı , Robert Östling