English
Related papers

Related papers: Entropy and Graph Based Modelling of Document Cohe…

200 papers

This paper presents a word-entity duet framework for utilizing knowledge bases in ad-hoc retrieval. In this work, the query and documents are modeled by word-based representations and entity-based representations. Ranking features are…

Information Retrieval · Computer Science 2017-06-22 Chenyan Xiong , Jamie Callan , Tie-Yan Liu

Knowledge is captured in the form of entities and their relationships and stored in knowledge graphs. Knowledge graphs enhance the capabilities of applications in many different areas including Web search, recommendation, and natural…

Machine Learning · Computer Science 2021-03-31 Kalpa Gunaratna , Yu Wang , Hongxia Jin

In this work, we systematically investigate how well current models of coherence can capture aspects of text implicated in discourse organisation. We devise two datasets of various linguistic alterations that undermine coherence and test…

Computation and Language · Computer Science 2020-11-13 Youmna Farag , Josef Valvoda , Helen Yannakoudakis , Ted Briscoe

We describe a new method for summarizing similarities and differences in a pair of related documents using a graph representation for text. Concepts denoted by words, phrases, and proper names in the document are represented positionally as…

cmp-lg · Computer Science 2007-05-23 Inderjeet Mani , Eric Bloedorn

Large Language Models (LLMs) face information overload when handling long contexts, particularly in Retrieval-Augmented Generation (RAG) where extensive supporting documents often introduce redundant content. This issue not only weakens…

Computation and Language · Computer Science 2025-11-25 Kaize Shi , Xueyao Sun , Xiaohui Tao , Lin Li , Qika Lin , Guandong Xu

Context information around words helps in determining their actual meaning, for example "networks" used in contexts of artificial neural networks or biological neuron networks. Generative topic models infer topic-word distributions, taking…

Information Retrieval · Computer Science 2018-08-14 Pankaj Gupta , Florian Buettner , Hinrich Schütze

We propose a novel coherence model for written asynchronous conversations (e.g., forums, emails), and show its applications in coherence assessment and thread reconstruction tasks. We conduct our research in two steps. First, we propose…

Computation and Language · Computer Science 2018-05-08 Tasnim Mohiuddin , Shafiq Joty , Dat Tien Nguyen

A typical IR system that delivers and stores information is affected by problem of matching between user query and available content on web. Use of Ontology represents the extracted terms in form of network graph consisting of nodes, edges,…

Information Retrieval · Computer Science 2017-03-23 Gagandeep Singh Narula , Vishal Jain

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson

Automatic text summarization aims to cut down readers time and cognitive effort by reducing the content of a text document without compromising on its essence. Ergo, informativeness is the prime attribute of document summary generated by an…

Information Retrieval · Computer Science 2021-10-01 Alka Khurana , Vasudha Bhatnagar

A common thread of open-domain question answering (QA) models employs a retriever-reader pipeline that first retrieves a handful of relevant passages from Wikipedia and then peruses the passages to produce an answer. However, even…

Computation and Language · Computer Science 2022-10-11 Mingxuan Ju , Wenhao Yu , Tong Zhao , Chuxu Zhang , Yanfang Ye

Distributed document representation is one of the basic problems in natural language processing. Currently distributed document representation methods mainly consider the context information of words or sentences. These methods do not take…

Computation and Language · Computer Science 2022-01-11 Shicheng Tan , Shu Zhao , Yanping Zhang

Most research in reading comprehension has focused on answering questions based on individual documents or even single paragraphs. We introduce a neural model which integrates and reasons relying on information spread within documents and…

Computation and Language · Computer Science 2022-09-28 Nicola De Cao , Wilker Aziz , Ivan Titov

We propose in this paper a new, hybrid document embedding approach in order to address the problem of document similarities with respect to the technical content. To do so, we employ a state-of-the-art graph techniques to first extract the…

Computation and Language · Computer Science 2019-07-02 Hamid Mirisaee , Eric Gaussier , Cedric Lagnier , Agnes Guerraz

Knowledge graphs suffer from sparsity which degrades the quality of representations generated by various methods. While there is an abundance of textual information throughout the web and many existing knowledge bases, aligning information…

Computation and Language · Computer Science 2021-04-13 Saed Rezayi , Handong Zhao , Sungchul Kim , Ryan A. Rossi , Nedim Lipka , Sheng Li

Entropy is a classical measure to quantify the amount of information or complexity of a system. Various entropy-based measures such as functional and spectral entropies have been proposed in brain network analysis. However, they are less…

Neurons and Cognition · Quantitative Biology 2018-03-08 Hyekyoung Lee , Eunkyung Kim , Hyejin Kang , Youngmin Huh , Youngjo Lee , Seonhee Lim , Dong Soo Lee

We target on the document-level relation extraction in an end-to-end setting, where the model needs to jointly perform mention extraction, coreference resolution (COREF) and relation extraction (RE) at once, and gets evaluated in an…

Computation and Language · Computer Science 2022-05-05 Liyan Xu , Jinho D. Choi

In document-level relation extraction, entities may appear multiple times in a document, and their relationships can shift from one context to another. Accurate prediction of the relationship between two entities across an entire document…

Computation and Language · Computer Science 2025-08-01 Nilesh , Atul Gupta , Avinash C Panday

Generative document retrieval, an emerging paradigm in information retrieval, learns to build connections between documents and identifiers within a single model, garnering significant attention. However, there are still two challenges: (1)…

Information Retrieval · Computer Science 2024-05-14 Yong Guan , Dingxiao Liu , Jinchen Ma , Hao Peng , Xiaozhi Wang , Lei Hou , Ru Li

In linguistics, coherence can be achieved by different means, such as by maintaining reference to the same set of entities across sentences and by establishing discourse relations between them. However, most existing work on coherence…

Computation and Language · Computer Science 2025-09-05 Wei Liu , Michael Strube