English
Related papers

Related papers: Investigating Entropy for Extractive Document Summ…

200 papers

Current abstractive summarization models either suffer from a lack of clear interpretability or provide incomplete rationales by only highlighting parts of the source document. To this end, we propose the Summarization Program (SP), an…

Computation and Language · Computer Science 2023-02-03 Swarnadeep Saha , Shiyue Zhang , Peter Hase , Mohit Bansal

Summarization for scientific text has shown significant benefits both for the research community and human society. Given the fact that the nature of scientific text is distinctive and the input of the multi-document summarization task is…

Computation and Language · Computer Science 2024-09-30 Huy Quoc To , Ming Liu , Guangyan Huang , Hung-Nghiep Tran , Andr'e Greiner-Petter , Felix Beierle , Akiko Aizawa

This report presents an empirical evaluation of four algorithms for automatically extracting keywords and keyphrases from documents. The four algorithms are compared using five different collections of documents. For each document, we have…

Machine Learning · Computer Science 2007-05-23 Peter D. Turney

Non-negative matrix factorization (NMF) is one of the most popular decomposition techniques for multivariate data. NMF is a core method for many machine-learning related computational problems, such as data compression, feature extraction,…

Numerical Analysis · Computer Science 2017-12-07 Gabriele Torre , Michael Graber

Inspired by how humans summarize long documents, we propose an accurate and fast summarization model that first selects salient sentences and then rewrites them abstractively (i.e., compresses and paraphrases) to generate a concise overall…

Computation and Language · Computer Science 2018-05-29 Yen-Chun Chen , Mohit Bansal

Text summarization helps readers capture salient information from documents, news, interviews, and meetings. However, most state-of-the-art pretrained language models (LM) are unable to efficiently process long text for many summarization…

Computation and Language · Computer Science 2022-04-15 Yusen Zhang , Ansong Ni , Ziming Mao , Chen Henry Wu , Chenguang Zhu , Budhaditya Deb , Ahmed H. Awadallah , Dragomir Radev , Rui Zhang

With the rapid growth of unstructured data from social media, reviews, and forums, text mining has become essential in Information Systems (IS) for extracting actionable insights. Summarization can condense fragmented, emotion-rich posts,…

Computation and Language · Computer Science 2025-12-24 Junyi Liu , Stanley Kok

We present EntropyDB, an interactive data exploration system that uses a probabilistic approach to generate a small, query-able summary of a dataset. Departing from traditional summarization techniques, we use the Principle of Maximum…

Databases · Computer Science 2019-11-13 Laurel Orr , Magdalena Balazinska , Dan Suciu

Unsupervised document summarization has re-acquired lots of attention in recent years thanks to its simplicity and data independence. In this paper, we propose a graph-based unsupervised approach for extractive document summarization.…

Computation and Language · Computer Science 2021-04-23 Haopeng Zhang , Jiawei Zhang

Sentence summarization shortens given texts while maintaining core contents of the texts. Unsupervised approaches have been studied to summarize texts without human-written summaries. However, recent unsupervised models are extractive,…

Computation and Language · Computer Science 2022-12-22 Dongmin Hyun , Xiting Wang , Chanyoung Park , Xing Xie , Hwanjo Yu

In this paper, we exploit the innate document segment structure for improving the extractive summarization task. We build two text segmentation models and find the most optimal strategy to introduce their output predictions in an extractive…

Computation and Language · Computer Science 2023-01-24 Lesly Miculicich , Benjamin Han

Many computational linguistic methods have been proposed to study the information content of languages. We consider two interesting research questions: 1) how is information distributed over long documents, and 2) how does content…

Computation and Language · Computer Science 2023-09-13 Shaoxiong Ji , Wei Sun , Pekka Marttinen

Our task is to generate an effective summary for a given document with specific realtime requirements. We use the softplus function to enhance keyword rankings to favor important sentences, based on which we present a number of…

Information Retrieval · Computer Science 2017-10-03 Liqun Shao , Hao Zhang , Ming Jia , Jie Wang

This study investigates entropy's potential for analyzing scientific research patterns across disciplines. Originating from thermodynamics, entropy now measures uncertainty and diversity in information systems. We examine Shannon Entropy,…

Physics and Society · Physics 2025-03-27 Yujie Shi , Alex Jie Yang , Sanhong Deng

Keyphrase extraction is a textual information processing task concerned with the automatic extraction of representative and characteristic phrases from a document that express all the key aspects of its content. Keyphrases constitute a…

Computation and Language · Computer Science 2019-07-31 Eirini Papagiannopoulou , Grigorios Tsoumakas

Extractive summarization aims to form a summary by directly extracting sentences from the source document. Existing works mostly formulate it as a sequence labeling problem by making individual sentence label predictions. This paper…

Computation and Language · Computer Science 2023-05-12 Haopeng Zhang , Xiao Liu , Jiawei Zhang

We present a method to produce abstractive summaries of long documents that exceed several thousand words via neural abstractive summarization. We perform a simple extractive step before generating a summary, which is then used to condition…

Computation and Language · Computer Science 2020-04-29 Sandeep Subramanian , Raymond Li , Jonathan Pilault , Christopher Pal

The increasing availability of semantic data has substantially enhanced Web applications. Semantic data such as RDF data is commonly represented as entity-property-value triples. The magnitude of semantic data, in particular the large…

Information Retrieval · Computer Science 2021-05-12 Qingxia Liu , Gong Cheng , Kalpa Gunaratna , Yuzhong Qu

Beyond the local constraints imposed by grammar, words concatenated in long sequences carrying a complex message show statistical regularities that may reflect their linguistic role in the message. In this paper, we perform a systematic…

Statistical Mechanics · Physics 2007-05-23 Marcelo A. Montemurro , Damian H. Zanette

Generating an abstract from a collection of documents is a desirable capability for many real-world applications. However, abstractive approaches to multi-document summarization have not been thoroughly investigated. This paper studies the…

Computation and Language · Computer Science 2018-06-15 Kexin Liao , Logan Lebanoff , Fei Liu