English
Related papers

Related papers: Answers Unite! Unsupervised Metrics for Reinforced…

200 papers

The exponential growth of textual data has created a crucial need for tools that assist users in extracting meaningful insights. Traditional document summarization approaches often fail to meet individual user requirements and lack…

Information Retrieval · Computer Science 2023-07-13 Samira Ghodratnama , Amin Beheshti , Mehrdad Zakershahrak

Modern summarization models generate highly fluent but often factually unreliable outputs. This motivated a surge of metrics attempting to measure the factuality of automatically generated summaries. Due to the lack of common benchmarks,…

Computation and Language · Computer Science 2021-07-27 Artidoro Pagnoni , Vidhisha Balachandran , Yulia Tsvetkov

Neural network models have shown excellent fluency and performance when applied to abstractive summarization. Many approaches to neural abstractive summarization involve the introduction of significant inductive bias, exemplified through…

Computation and Language · Computer Science 2019-09-04 Luke de Oliveira , Alfredo Láinez Rodrigo

Attention-based neural abstractive summarization systems equipped with copy mechanisms have shown promising results. Despite this success, it has been noticed that such a system generates a summary by mostly, if not entirely, copying over…

Computation and Language · Computer Science 2018-03-21 Noah Weber , Leena Shekhar , Niranjan Balasubramanian , Kyunghyun Cho

Summarization of electronic health records (EHRs) can substantially minimize 'screen time' for both patients as well as medical personnel. In recent years summarization of EHRs have employed machine learning pipelines using state of the art…

Computation and Language · Computer Science 2024-01-04 Walid Saba , Suzanne Wendelken , James. Shanahan

Supervised approaches for Neural Abstractive Summarization require large annotated corpora that are costly to build. We present a French meeting summarization task where reports are predicted based on the automatic transcription of the…

Computation and Language · Computer Science 2020-09-18 Paul Tardy , Louis de Seynes , François Hernandez , Vincent Nguyen , David Janiszek , Yannick Estève

Specifically focusing on the landscape of abstractive text summarization, as opposed to extractive techniques, this survey presents a comprehensive overview, delving into state-of-the-art techniques, prevailing challenges, and prospective…

Computation and Language · Computer Science 2024-09-05 Hassan Shakil , Ahmad Farooq , Jugal Kalita

The scarcity of comprehensive up-to-date studies on evaluation metrics for text summarization and the lack of consensus regarding evaluation protocols continue to inhibit progress. We address the existing shortcomings of summarization…

Computation and Language · Computer Science 2021-02-03 Alexander R. Fabbri , Wojciech Kryściński , Bryan McCann , Caiming Xiong , Richard Socher , Dragomir Radev

Explanation is a fundamentally human process. Understanding the goal and audience of the explanation is vital, yet existing work on explainable reinforcement learning (XRL) routinely does not consult humans in their evaluations. Even when…

Artificial Intelligence · Computer Science 2025-02-03 Balint Gyevnar , Mark Towers

Summarization models often generate text that is poorly calibrated to quality metrics because they are trained to maximize the likelihood of a single reference (MLE). To address this, recent work has added a calibration step, which exposes…

Since the amount of information on the internet is growing rapidly, it is not easy for a user to find relevant information for his/her query. To tackle this issue, much attention has been paid to Automatic Document Summarization. The key…

Computation and Language · Computer Science 2019-02-05 Kamal Al-Sabahi , Zhang Zuping , Yang Kang

Despite the recent advances in abstractive text summarization, current summarization models still suffer from generating factually inconsistent summaries, reducing their utility for real-world application. We argue that the main reason for…

Computation and Language · Computer Science 2023-10-16 Polina Zablotskaia , Misha Khalman , Rishabh Joshi , Livio Baldini Soares , Shoshana Jakobovits , Joshua Maynez , Shashi Narayan

The anthology of spoken languages today is inundated with textual information, necessitating the development of automatic summarization models. In this manuscript, we propose an extractor-paraphraser based abstractive summarization system…

Computation and Language · Computer Science 2021-05-05 Anubhav Jangra , Raghav Jain , Vaibhav Mavi , Sriparna Saha , Pushpak Bhattacharyya

This study explores integrating reinforcement learning (RL) with idealised climate models to address key parameterisation challenges in climate science. Current climate models rely on complex mathematical parameterisations to represent…

Machine Learning · Computer Science 2025-04-17 Pritthijit Nath , Henry Moss , Emily Shuckburgh , Mark Webb

Despite recent progress in abstractive summarization, systems still suffer from faithfulness errors. While prior work has proposed models that improve faithfulness, it is unclear whether the improvement comes from an increased level of…

Computation and Language · Computer Science 2022-04-22 Faisal Ladhak , Esin Durmus , He He , Claire Cardie , Kathleen McKeown

For summarization, human preference is critical to tame outputs of the summarizer in favor of human interests, as ground-truth summaries are scarce and ambiguous. Practical settings require dynamic exchanges between human and AI agent…

Artificial Intelligence · Computer Science 2022-05-13 Duy-Hung Nguyen , Nguyen Viet Dung Nghiem , Bao-Sinh Nguyen , Dung Tien Le , Shahab Sabahi , Minh-Tien Nguyen , Hung Le

Real-world sequential decision-making often involves parameterized action spaces that require both, decisions regarding discrete actions and decisions about continuous action parameters governing how an action is executed. Existing…

Artificial Intelligence · Computer Science 2026-04-27 Rashmeet Kaur Nayyar , Naman Shah , Siddharth Srivastava

Text summarization is a crucial task that requires the simultaneous optimization of multiple objectives, including consistency, coherence, relevance, and fluency, which presents considerable challenges. Although large language models (LLMs)…

Computation and Language · Computer Science 2025-10-23 Junjie Song , Yiwen Liu , Dapeng Li , Yin Sun , Shukun Fu , Siqi Chen , Yuji Cao

In this study, we analyze automatic evaluation metrics for Natural Language Generation (NLG), specifically task-agnostic metrics and human-aligned metrics. Task-agnostic metrics, such as Perplexity, BLEU, BERTScore, are cost-effective and…

Computation and Language · Computer Science 2023-05-29 Iftitahu Ni'mah , Meng Fang , Vlado Menkovski , Mykola Pechenizkiy

Safety is critical when applying reinforcement learning (RL) to real-world problems. As a result, safe RL has emerged as a fundamental and powerful paradigm for optimizing an agent's policy while incorporating notions of safety. A prevalent…

Machine Learning · Computer Science 2024-05-09 Akifumi Wachi , Xun Shen , Yanan Sui
‹ Prev 1 8 9 10 Next ›