English
Related papers

Related papers: How to Evaluate Coreference in Literary Texts?

200 papers

A theory of additive Markov chains with long-range memory is used for description of correlation properties of coarse-grained literary texts. The complex structure of the correlations in texts is revealed. Antipersistent correlations at…

Data Analysis, Statistics and Probability · Physics 2009-11-10 S. S. Melnyk , O. V. Usatenko , V. A. Yampol'skii , V. A. Golick

Coreference annotation and resolution is a vital component of computational literary studies. However, it has previously been difficult to build high quality systems for fiction. Coreference requires complicated structured outputs, and…

Computation and Language · Computer Science 2024-02-01 Rebecca M. M. Hicke , David Mimno

Coreference resolution is typically evaluated using aggregate statistical metrics such as CoNLL-F1, which measure structural overlap between predicted and gold clusters. While widely used, these metrics offer limited diagnostic insights,…

Computation and Language · Computer Science 2026-05-12 Bruno Gatti , Giuliano Martinelli , Roberto Navigli

Understanding texts requires memory: the reader has to keep in mind enough words to create meaning. This calls for a relation between the memory of the reader and the structure of the text. To investigate this interaction, we first identify…

Physics and Society · Physics 2007-05-23 E. Alvarez-Lacalle , B. Dorow , J. -P. Eckmann , E. Moses

Measuring the similarity of short written contexts is a fundamental problem in Natural Language Processing. This article provides a unifying framework by which short context problems can be categorized both by their intended application and…

Computation and Language · Computer Science 2010-10-19 Ted Pedersen

Summarizing conversations via neural approaches has been gaining research traction lately, yet it is still challenging to obtain practical solutions. Examples of such challenges include unstructured information exchange in dialogues,…

Computation and Language · Computer Science 2021-09-15 Zhengyuan Liu , Ke Shi , Nancy F. Chen

Topic models extract representative word sets - called topics - from word counts in documents without requiring any semantic annotations. Topics are not guaranteed to be well interpretable, therefore, coherence measures have been proposed…

Machine Learning · Computer Science 2014-03-26 Frank Rosner , Alexander Hinneburg , Michael Röder , Martin Nettling , Andreas Both

The state-of-the-art models for coreference resolution are based on independent mention pair-wise decisions. We propose a modelling approach that learns coreference at the document-level and takes global decisions. For this purpose, we…

Computation and Language · Computer Science 2022-04-01 Lesly Miculicich , James Henderson

Recent coreference resolution models rely heavily on span representations to find coreference links between word spans. As the number of spans is $O(n^2)$ in the length of text and the number of potential links is $O(n^4)$, various pruning…

Computation and Language · Computer Science 2022-04-12 Vladimir Dobrovolskii

We propose a coreference annotation scheme as a layer on top of the Universal Conceptual Cognitive Annotation foundational layer, treating units in predicate-argument structure as a basis for entity and event mentions. We argue that this…

Computation and Language · Computer Science 2019-06-12 Jakob Prange , Nathan Schneider , Omri Abend

As academic research becomes increasingly diverse, traditional literature evaluation methods face significant limitations,particularly in capturing the complexity of academic dissemination and the multidimensional impacts of literature. To…

Information Retrieval · Computer Science 2025-09-16 Mingyue Kong , Yinglong Zhang , Likun Sheng , Kaifeng Hong

Literary texts are usually rich in meanings and their interpretation complicates corpus studies and automatic processing. There have been several attempts to create collections of literary texts with annotation of literary elements like the…

Computation and Language · Computer Science 2021-11-16 Elena Mikhalkova , Timofei Protasov , Anastasiia Drozdova , Anastasiia Bashmakova , Polina Gavin

We analyse coreference phenomena in three neural machine translation systems trained with different data settings with or without access to explicit intra- and cross-sentential anaphoric information. We compare system performance on two…

Computation and Language · Computer Science 2019-11-05 Ekaterina Lapshinova-Koltunski , Cristina España-Bonet , Josef van Genabith

Measuring the coherence of text is a vital aspect of evaluating the quality of written content. Recent advancements in neural coherence modeling have demonstrated their efficacy in capturing entity coreference and discourse relations,…

Computation and Language · Computer Science 2025-03-13 Zhecheng Sheng , Tianhao Zhang , Chen Jiang , Dongyeop Kang

Term weighting metrics assign weights to terms in order to discriminate the important terms from the less crucial ones. Due to this characteristic, these metrics have attracted growing attention in text classification and recently in…

Computation and Language · Computer Science 2016-10-12 Hussam Hamdan , Patrice Bellot , Frederic Bechet

Humans do not make inferences over texts, but over models of what texts are about. When annotators are asked to annotate coreferent spans of text, it is therefore a somewhat unnatural task. This paper presents an alternative in which we…

Computation and Language · Computer Science 2020-03-03 Rahul Aralikatte , Anders Søgaard

Coherence is a crucial aspect of evaluating text readability and can be assessed through two primary factors when evaluating an essay in a scoring scenario. The first factor is logical coherence, characterized by the appropriate use of…

Computation and Language · Computer Science 2023-08-08 Chen Zheng , Huan Zhang , Yan Zhao , Yuxuan Lai

Measuring similarity is a basic task in information retrieval, and now often a building-block for more complex arguments about cultural change. But do measures of textual similarity and distance really correspond to evidence about cultural…

Computation and Language · Computer Science 2018-07-03 Ted Underwood

A character network is a graph extracted from a narrative, in which vertices represent characters and edges correspond to interactions between them. A number of narrative-related problems can be addressed automatically through the analysis…

Social and Information Networks · Computer Science 2022-06-22 Vincent Labatut , Xavier Bost

Environmental factors determine the smells we perceive, but societal factors factors shape the importance, sentiment and biases we give to them. Descriptions of smells in text, or as we call them `smell experiences', offer a window into…

Computation and Language · Computer Science 2020-12-08 Ryan Brate , Paul Groth , Marieke van Erp