English
Related papers

Related papers: Revisiting Automatic Question Summarization Evalua…

200 papers

Evaluation frameworks for text summarization have evolved in terms of both domain coverage and metrics. However, existing benchmarks still lack domain-specific assessment criteria, remain predominantly English-centric, and face challenges…

Computation and Language · Computer Science 2025-06-03 Hyangsuk Min , Yuho Lee , Minjeong Ban , Jiaqi Deng , Nicole Hee-Yeon Kim , Taewon Yun , Hang Su , Jason Cai , Hwanjun Song

Customized medical prompts enable Large Language Models (LLM) to effectively address medical dialogue summarization. The process of medical reporting is often time-consuming for healthcare professionals. Implementing medical dialogue…

Computation and Language · Computer Science 2024-01-22 Daphne van Zandvoort , Laura Wiersema , Tom Huibers , Sandra van Dulmen , Sjaak Brinkkemper

This chapter gives an overview of recent advances in the field of biomedical text summarization. Different types of challenges are introduced, and methods are discussed concerning the type of challenge that they address. Biomedical…

Computation and Language · Computer Science 2019-08-08 Milad Moradi , Nasser Ghadiri

Automatic text summarization has enjoyed great progress over the years and is used in numerous applications, impacting the lives of many. Despite this development, there is little research that meaningfully investigates how the current…

Computation and Language · Computer Science 2022-05-02 Maartje ter Hoeve , Julia Kiseleva , Maarten de Rijke

In recent times, data is growing rapidly in every domain such as news, social media, banking, education, etc. Due to the excessiveness of data, there is a need of automatic summarizer which will be capable to summarize the data especially…

Computation and Language · Computer Science 2017-04-12 Santosh Kumar Bharti , Korra Sathya Babu

In text summarization, evaluating the efficacy of automatic metrics without human judgments has become recently popular. One exemplar work concludes that automatic metrics strongly disagree when ranking high-scoring summaries. In this…

Computation and Language · Computer Science 2020-11-10 Manik Bhandari , Pranav Gour , Atabak Ashfaq , Pengfei Liu

Objective: Automatic text summarization tools can help users in the biomedical domain to access information efficiently from a large volume of scientific literature and other sources of text documents. In this paper, we propose a…

Information Retrieval · Computer Science 2018-11-26 Milad Moradi , Nasser Ghadiri

Research on automated text summarization relies heavily on human and automatic evaluation. While recent work on human evaluation mainly adopted intrinsic evaluation methods, judging the generic quality of text summaries, e.g.…

Computation and Language · Computer Science 2023-05-25 Xiao Pu , Mingqi Gao , Xiaojun Wan

How reliably an automatic summarization evaluation metric replicates human judgments of summary quality is quantified by system-level correlations. We identify two ways in which the definition of the system-level correlation is inconsistent…

Computation and Language · Computer Science 2022-04-22 Daniel Deutsch , Rotem Dror , Dan Roth

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen

Automatic text summarization has experienced substantial progress in recent years. With this progress, the question has arisen whether the types of summaries that are typically generated by automatic summarization models align with users'…

Computation and Language · Computer Science 2022-04-26 Maartje ter Hoeve , Julia Kiseleva , Maarten de Rijke

Summarization is one of the key features of human intelligence. It plays an important role in understanding and representation. With rapid and continual expansion of texts, pictures and videos in cyberspace, automatic summarization becomes…

Computation and Language · Computer Science 2015-07-02 Hai Zhuge

Speech summarization has become an essential tool for efficiently managing and accessing the growing volume of spoken and audiovisual content. However, despite its increasing importance, speech summarization remains loosely defined. The…

Computation and Language · Computer Science 2025-10-20 Fabian Retkowski , Maike Züfle , Andreas Sudmann , Dinah Pfau , Shinji Watanabe , Jan Niehues , Alexander Waibel

Automated lay summarisation (LS) aims to simplify complex technical documents into a more accessible format to non-experts. Existing approaches using pre-trained language models, possibly augmented with external background knowledge, tend…

Computation and Language · Computer Science 2024-02-22 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

Meeting summarization has become a critical task considering the increase in online interactions. While new techniques are introduced regularly, their evaluation uses metrics not designed to capture meeting-specific errors, undermining…

Computation and Language · Computer Science 2025-02-19 Frederic Kirstein , Jan Philip Wahle , Terry Ruas , Bela Gipp

Automatic metrics are used as proxies to evaluate abstractive summarization systems when human annotations are too expensive. To be useful, these metrics should be fine-grained, show a high correlation with human annotations, and ideally be…

Computation and Language · Computer Science 2024-10-16 Théo Gigant , Camille Guinaudeau , Marc Decombas , Frédéric Dufaux

Previous approaches for automatic lay summarisation are exclusively reliant on the source article that, given it is written for a technical audience (e.g., researchers), is unlikely to explicitly define all technical concepts or state all…

Computation and Language · Computer Science 2023-10-25 Tomas Goldsack , Zhihao Zhang , Chen Tang , Carolina Scarton , Chenghua Lin

Automatic text summarization tools help users in biomedical domain to acquire their intended information from various textual resources more efficiently. Some of the biomedical text summarization systems put the basis of their sentence…

Computation and Language · Computer Science 2017-05-31 Milad Moradi , Nasser Ghadiri

We propose a summarization approach for scientific articles which takes advantage of citation-context and the document discourse model. While citations have been previously used in generating scientific summaries, they lack the related…

Computation and Language · Computer Science 2017-04-24 Arman Cohan , Nazli Goharian

Interpretability and efficiency are two important considerations for the adoption of neural automatic metrics. In this work, we develop strong-performing automatic metrics for reference-based summarization evaluation, based on a two-stage…

Computation and Language · Computer Science 2023-11-17 Yixin Liu , Alexander R. Fabbri , Yilun Zhao , Pengfei Liu , Shafiq Joty , Chien-Sheng Wu , Caiming Xiong , Dragomir Radev