English
Related papers

Related papers: Assessment of Transformer-Based Encoder-Decoder Mo…

200 papers

Many applications of text generation such as summarization benefit from accurately controlling the text length. Existing approaches on length-controlled summarization either result in degraded performance or can only control the length…

Computation and Language · Computer Science 2023-05-10 Lesly Miculicich , Yujia Xie , Song Wang , Pengcheng He

Summarization of long sequences into a concise statement is a core problem in natural language processing, requiring non-trivial understanding of the input. Based on the promising results of graph neural networks on highly structured data,…

Machine Learning · Computer Science 2021-02-04 Patrick Fernandes , Miltiadis Allamanis , Marc Brockschmidt

We carry out experiments with deep learning models of summarization across the domains of news, personal stories, meetings, and medical articles in order to understand how content selection is performed. We find that many sophisticated…

Computation and Language · Computer Science 2019-02-20 Chris Kedzie , Kathleen McKeown , Hal Daume

The realm of scientific text summarization has experienced remarkable progress due to the availability of annotated brief summaries and ample data. However, the utilization of multiple input modalities, such as videos and audio, has yet to…

Computation and Language · Computer Science 2023-06-27 Yash Kumar Atri , Vikram Goyal , Tanmoy Chakraborty

Summary assessment involves evaluating how well a generated summary reflects the key ideas and meaning of the source text, requiring a deep understanding of the content. Large Language Models (LLMs) have been used to automate this process,…

Computation and Language · Computer Science 2025-12-23 Zahra Sadeghi , Evangelos Milios , Frank Rudzicz

Dialogue summarization task involves summarizing long conversations while preserving the most salient information. Real-life dialogues often involve naturally occurring variations (e.g., repetitions, hesitations) and existing dialogue…

Computation and Language · Computer Science 2023-11-16 Ankita Gupta , Chulaka Gunasekara , Hui Wan , Jatin Ganhotra , Sachindra Joshi , Marina Danilevsky

Since the advent of the web, the amount of data on wen has been increased several million folds. In recent years web data generated is more than data stored for years. One important data format is text. To answer user queries over the…

Information Retrieval · Computer Science 2018-11-19 Chandra Shekhar Yadav

Controlled abstractive summarization focuses on producing condensed versions of a source article to cover specific aspects by shifting the distribution of generated text towards a desired style, e.g., a set of topics. Subsequently, the…

Computation and Language · Computer Science 2023-11-14 Seyed Ali Bahrainian , Martin Jaggi , Carsten Eickhoff

The availability of a vast array of research papers in any area of study, necessitates the need of automated summarisation systems that can present the key research conducted and their corresponding findings. Scientific paper summarisation…

Computation and Language · Computer Science 2024-07-30 Grishma Sharma , Aditi Paretkar , Deepak Sharma

In this paper, we propose a deep learning approach to tackle the automatic summarization tasks by incorporating topic information into the convolutional sequence-to-sequence (ConvS2S) model and using self-critical sequence training (SCST)…

Computation and Language · Computer Science 2020-07-28 Li Wang , Junlin Yao , Yunzhe Tao , Li Zhong , Wei Liu , Qiang Du

Automatic summarization of natural language is a current topic in computer science research and industry, studied for decades because of its usefulness across multiple domains. For example, summarization is necessary to create reviews such…

Computation and Language · Computer Science 2018-12-31 Marc Everett Johnson

An accurate abstractive summary of a document should contain all its salient information and should be logically entailed by the input document. We improve these important aspects of abstractive summarization via multi-task learning with…

Computation and Language · Computer Science 2018-05-29 Han Guo , Ramakanth Pasunuru , Mohit Bansal

We present a novel divide-and-conquer method for the neural summarization of long documents. Our method exploits the discourse structure of the document and uses sentence similarity to split the problem into an ensemble of smaller…

Computation and Language · Computer Science 2020-09-24 Alexios Gidiotis , Grigorios Tsoumakas

With the abundance of automatic meeting transcripts, meeting summarization is of great interest to both participants and other parties. Traditional methods of summarizing meetings depend on complex multi-step pipelines that make joint…

Computation and Language · Computer Science 2020-09-22 Chenguang Zhu , Ruochen Xu , Michael Zeng , Xuedong Huang

Extractive text summarization has been an extensive research problem in the field of natural language understanding. While the conventional approaches rely mostly on manually compiled features to generate the summary, few attempts have been…

Computation and Language · Computer Science 2019-12-30 Abhishek Kumar Singh , Manish Gupta , Vasudeva Varma

Traditional approaches to extractive summarization rely heavily on human-engineered features. In this work we propose a data-driven approach based on neural networks and continuous sentence features. We develop a general framework for…

Computation and Language · Computer Science 2016-07-04 Jianpeng Cheng , Mirella Lapata

The scarcity of comprehensive up-to-date studies on evaluation metrics for text summarization and the lack of consensus regarding evaluation protocols continue to inhibit progress. We address the existing shortcomings of summarization…

Computation and Language · Computer Science 2021-02-03 Alexander R. Fabbri , Wojciech Kryściński , Bryan McCann , Caiming Xiong , Richard Socher , Dragomir Radev

Semantic textual similarity is the task of estimating the similarity between the meaning of two texts. In this paper, we fine-tune transformer architectures for semantic textual similarity on the Semantic Textual Similarity Benchmark by…

Computation and Language · Computer Science 2023-06-02 Ivan Rep , Vladimir Čeperić

Existing approaches to automatic summarization assume that a length limit for the summary is given, and view content selection as an optimization problem to maximize informativeness and minimize redundancy within this budget. This framework…

Computation and Language · Computer Science 2019-01-15 Jingyun Liu , Jackie C. K. Cheung , Annie Louis

Abstractive Text Summarization is the process of constructing semantically relevant shorter sentences which captures the essence of the overall meaning of the source text. It is actually difficult and very time consuming for humans to…

Computation and Language · Computer Science 2021-01-19 Mohan Bharath B , Aravindh Gowtham B , Akhil M