English
Related papers

Related papers: Leveraging Pretrained Models for Automatic Summari…

200 papers

Usually, programming languages have official documentation to guide developers with APIs, methods, and classes. However, researchers identified insufficient or inadequate documentation examples and flaws with the API's complex structure as…

Software Engineering · Computer Science 2023-12-05 AmirHossein Naghshzan , Latifa Guerrouj , Olga Baysal

Summarizing sales calls is a routine task performed manually by salespeople. We present a production system which combines generative models fine-tuned for customer-agent setting, with a human-in-the-loop user experience for an interactive…

Computation and Language · Computer Science 2022-04-29 Abedelkadir Asi , Song Wang , Roy Eisenstadt , Dean Geckt , Yarin Kuper , Yi Mao , Royi Ronen

We consider the problem of automatically generating a narrative biomedical evidence summary from multiple trial reports. We evaluate modern neural models for abstractive summarization of relevant article abstracts from systematic reviews…

Computation and Language · Computer Science 2020-12-23 Byron C. Wallace , Sayantan Saha , Frank Soboczenski , Iain J. Marshall

The Query Focused Text Summarization (QFTS) task aims at building systems that generate the summary of the text document(s) based on the given query. A key challenge in addressing this task is the lack of large labeled data for training the…

Computation and Language · Computer Science 2021-12-23 Md Tahmid Rahman Laskar , Enamul Hoque , Jimmy Xiangji Huang

Abstractive conversation summarization has received much attention recently. However, these generated summaries often suffer from insufficient, redundant, or incorrect content, largely due to the unstructured and complex characteristics of…

Computation and Language · Computer Science 2021-04-20 Jiaao Chen , Diyi Yang

This paper proposes a medical literature summary generation method based on the BERT model to address the challenges brought by the current explosion of medical information. By fine-tuning and optimizing the BERT model, we develop an…

Computation and Language · Computer Science 2024-10-29 Jiacheng Hu , Yiru Cang , Guiran Liu , Meiqi Wang , Weijie He , Runyuan Bao

Dialogue summarization involves a wide range of scenarios and domains. However, existing methods generally only apply to specific scenarios or domains. In this study, we propose a new pre-trained model specifically designed for…

Computation and Language · Computer Science 2023-10-17 Weixiao Zhou , Gengyao Li , Xianfu Cheng , Xinnian Liang , Junnan Zhu , Feifei Zhai , Zhoujun Li

With the advancement of telemedicine, both researchers and medical practitioners are working hand-in-hand to develop various techniques to automate various medical operations, such as diagnosis report generation. In this paper, we first…

Computation and Language · Computer Science 2023-09-28 Abhisek Tiwari , Anisha Saha , Sriparna Saha , Pushpak Bhattacharyya , Minakshi Dhar

Generating discharge summaries is a crucial yet time-consuming task in clinical practice, essential for conveying pertinent patient information and facilitating continuity of care. Recent advancements in large language models (LLMs) have…

Computation and Language · Computer Science 2025-07-01 Yiming Li , Fang Li , Kirk Roberts , Licong Cui , Cui Tao , Hua Xu

Text summarization tasks commonly employ Pre-trained Language Models (PLMs) to fit diverse standard datasets. While these PLMs excel in automatic evaluations, they frequently underperform in human evaluations, indicating a deviation between…

Computation and Language · Computer Science 2024-10-02 Yang Han , Yiming Wang , Rui Wang , Lu Chen , Kai Yu

Pre-trained language model representations have been successful in a wide range of language understanding tasks. In this paper, we examine different strategies to integrate pre-trained representations into sequence to sequence models and…

Computation and Language · Computer Science 2019-04-02 Sergey Edunov , Alexei Baevski , Michael Auli

A vast amount of textual data is added to the internet daily, making utilization and interpretation of such data difficult and cumbersome. As a result, automatic text summarization is crucial for extracting relevant information, saving…

Computation and Language · Computer Science 2024-10-10 Naman Chhibbar , Jugal Kalita

As language models become more powerful, training and evaluation are increasingly bottlenecked by the data and metrics used for a particular task. For example, summarization models are often trained to predict human reference summaries and…

Computation and Language · Computer Science 2022-02-17 Nisan Stiennon , Long Ouyang , Jeff Wu , Daniel M. Ziegler , Ryan Lowe , Chelsea Voss , Alec Radford , Dario Amodei , Paul Christiano

In this paper, we propose a controllable neural generation framework that can flexibly guide dialogue summarization with personal named entity planning. The conditional sequences are modulated to decide what types of information or what…

Computation and Language · Computer Science 2021-09-28 Zhengyuan Liu , Nancy F. Chen

The task of automatic text summarization produces a concise and fluent text summary while preserving key information and overall meaning. Recent approaches to document-level summarization have seen significant improvements in recent years…

Computation and Language · Computer Science 2022-12-07 Gonçalo Raposo , Afonso Raposo , Ana Sofia Carmo

This research examines the effectiveness of OpenAI's GPT models as independent evaluators of text summaries generated by six transformer-based models from Hugging Face: DistilBART, BERT, ProphetNet, T5, BART, and PEGASUS. We evaluated these…

Computation and Language · Computer Science 2024-05-08 Hassan Shakil , Atqiya Munawara Mahi , Phuoc Nguyen , Zeydy Ortiz , Mamoun T. Mardini

Biomedical summarization requires large datasets to train for text generation. We show that while transfer learning offers a viable option for addressing this challenge, an in-domain pre-training does not always offer advantages in a BioASQ…

Computation and Language · Computer Science 2023-07-11 Dima Galat , Marian-Andrei Rizoiu

Proposal of large-scale datasets has facilitated research on deep neural models for news summarization. Deep learning can also be potentially useful for spoken dialogue summarization, which can benefit a range of real-life scenarios…

Computation and Language · Computer Science 2021-06-17 Yulong Chen , Yang Liu , Liang Chen , Yue Zhang

To capture the semantic graph structure from raw text, most existing summarization approaches are built on GNNs with a pre-trained model. However, these methods suffer from cumbersome procedures and inefficient computations for long-text…

Computation and Language · Computer Science 2021-10-22 Ye Liu , Jian-Guo Zhang , Yao Wan , Congying Xia , Lifang He , Philip S. Yu

In a customer service system, dialogue summarization can boost service efficiency by automatically creating summaries for long spoken dialogues in which customers and agents try to address issues about specific topics. In this work, we…

Computation and Language · Computer Science 2021-06-28 Yicheng Zou , Lujun Zhao , Yangyang Kang , Jun Lin , Minlong Peng , Zhuoren Jiang , Changlong Sun , Qi Zhang , Xuanjing Huang , Xiaozhong Liu