English
Related papers

Related papers: Realistic Evaluation Principles for Cross-document…

200 papers

Estimating heterogeneous treatment effects with machine learning has attracted substantial attention in both academic research and industrial practice. However, the two communities often evaluate models under markedly different conditions.…

Machine Learning · Computer Science 2026-05-26 George Panagopoulos

Entity Coreference Resolution is the task of resolving all mentions in a document that refer to the same real world entity and is considered as one of the most difficult tasks in natural language understanding. It is of great importance for…

Computation and Language · Computer Science 2020-12-10 Nikolaos Stylianou , Ioannis Vlahavas

This paper presents a neural network classifier approach to detecting both within- and cross- document event coreference effectively using only event mention based features. Our approach does not (yet) rely on any event argument features…

Computation and Language · Computer Science 2018-10-11 Arun Pandian , Lamana Mulaffer , Kemal Oflazer , Amna AlZeyara

Academic neural models for coreference resolution (coref) are typically trained on a single dataset, OntoNotes, and model improvements are benchmarked on that same dataset. However, real-world applications of coref depend on the annotation…

Computation and Language · Computer Science 2021-10-04 Patrick Xia , Benjamin Van Durme

A model for reference use in communication is proposed, from a representationist point of view. Both the sender and the receiver of a message handle representations of their common environment, including mental representations of objects.…

Computation and Language · Computer Science 2007-05-23 Andrei Popescu-Belis , Isabelle Robba , Gerard Sabah

Coreference resolution across multiple documents poses a significant challenge in natural language processing, particularly within the domain of knowledge graphs. This study introduces an innovative method aimed at identifying and resolving…

Computation and Language · Computer Science 2025-04-09 Zhang Dong , Mingbang Wang , Songhang deng , Le Dai , Jiyuan Li , Xingzu Liu , Ruilin Nong

The most popular Cross-Document Event Coreference Resolution (CDEC) datasets fail to convey the true difficulty of the task, due to the lack of lexical diversity between coreferring event triggers (words or phrases that refer to an event).…

Computation and Language · Computer Science 2024-07-18 Shafiuddin Rehan Ahmed , Zhiyong Eric Wang , George Arthur Baker , Kevin Stowe , James H. Martin

Reference resolution on extended texts (several thousand references) cannot be evaluated manually. An evaluation algorithm has been proposed for the MUC tests, using equivalence classes for the coreference relation. However, we show here…

Computation and Language · Computer Science 2007-05-23 Andrei Popescu-Belis , Isabelle Robba

Humans do not make inferences over texts, but over models of what texts are about. When annotators are asked to annotate coreferent spans of text, it is therefore a somewhat unnatural task. This paper presents an alternative in which we…

Computation and Language · Computer Science 2020-03-03 Rahul Aralikatte , Anders Søgaard

In large organisations, identifying experts on a given topic is crucial in leveraging the internal knowledge spread across teams and departments. So-called enterprise expert retrieval systems automatically discover and structure employees'…

Information Retrieval · Computer Science 2024-10-08 Jens-Joris Decorte , Jeroen Van Hautte , Chris Develder , Thomas Demeester

Multimodal reference resolution, including phrase grounding, aims to understand the semantic relations between mentions and real-world objects. Phrase grounding between images and their captions is a well-established task. In contrast, for…

Computation and Language · Computer Science 2025-06-03 Shun Inadumi , Nobuhiro Ueda , Koichiro Yoshino

Various neural-based methods have been proposed so far for joint mention detection and coreference resolution. However, existing works on coreference resolution are mainly dependent on filtered mention representation, while other spans are…

Computation and Language · Computer Science 2021-08-06 Xin Tan , Longyin Zhang , Guodong Zhou

Singleton mentions, i.e.~entities mentioned only once in a text, are important to how humans understand discourse from a theoretical perspective. However previous attempts to incorporate their detection in end-to-end neural coreference…

Computation and Language · Computer Science 2024-03-27 Yilun Zhu , Siyao Peng , Sameer Pradhan , Amir Zeldes

This paper suggests a direction of coreference resolution for online decoding on actively generated input such as dialogue, where the model accepts an utterance and its past context, then finds mentions in the current utterance as well as…

Computation and Language · Computer Science 2022-05-24 Liyan Xu , Jinho D. Choi

Correctly resolving textual mentions of people fundamentally entails making inferences about those people. Such inferences raise the risk of systemic biases in coreference resolution systems, including biases that can harm binary and…

Computation and Language · Computer Science 2020-12-03 Yang Trista Cao , Hal Daumé

We propose a sentence-incremental neural coreference resolution system which incrementally builds clusters after marking mention boundaries in a shift-reduce method. The system is aimed at bridging two recent approaches at coreference…

Computation and Language · Computer Science 2023-05-29 Matt Grenander , Shay B. Cohen , Mark Steedman

Studies have been conducted to prevent specific concepts from being generated from pretrained text-to-image generative models, achieving concept erasure in various ways. However, the performance evaluation of these studies is still largely…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Masane Fuchi , Tomohiro Takagi

Building compositional explanations requires models to combine two or more facts that, together, describe why the answer to a question is correct. Typically, these "multi-hop" explanations are evaluated relative to one (or a small number…

Computation and Language · Computer Science 2021-09-09 Peter Jansen , Kelly Smith , Dan Moreno , Huitzilin Ortiz

This paper proposes a new evaluation protocol for cross-media retrieval which better fits the real-word applications. Both image-text and text-image retrieval modes are considered. Traditionally, class labels in the training and testing…

Computer Vision and Pattern Recognition · Computer Science 2017-03-13 Ruoyu Liu , Yao Zhao , Liang Zheng , Shikui Wei , Yi Yang

In this paper, we identify an important reproducibility challenge in the image-to-set prediction literature that impedes proper comparisons among published methods, namely, researchers use different evaluation protocols to assess their…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Luis Pineda , Amaia Salvador , Michal Drozdzal , Adriana Romero