English
Related papers

Related papers: Redundancy Aware Multi-Reference Based Gainwise Ev…

200 papers

The task of table summarization involves generating text that both succinctly and accurately represents the table or a specific set of highlighted cells within a table. While significant progress has been made in table to text generation…

Computation and Language · Computer Science 2023-10-31 Deepanway Ghosal , Preksha Nema , Aravindan Raghuveer

Novel neural architectures, training strategies, and the availability of large-scale corpora haven been the driving force behind recent progress in abstractive text summarization. However, due to the black-box nature of neural models,…

Computation and Language · Computer Science 2021-07-27 Jesse Vig , Wojciech Kryściński , Karan Goel , Nazneen Fatema Rajani

This paper presents a procedure for and evaluation of using a semantic similarity metric as a loss function for neural source code summarization. Code summarization is the task of writing natural language descriptions of source code. Neural…

Software Engineering · Computer Science 2024-06-13 Chia-Yi Su , Collin McMillan

Large language models can now directly generate answers to many factual questions without referencing external sources. Unfortunately, relatively little attention has been paid to methods for evaluating the quality and correctness of these…

Information Retrieval · Computer Science 2024-01-11 Negar Arabzadeh , Amin Bigdeli , Charles L. A. Clarke

Sequential recommendation has increasingly shifted toward generative recommenders that combine sequential patterns with semantic item information. Yet these methods are often evaluated on a small set of widely used benchmarks, raising a key…

Information Retrieval · Computer Science 2026-05-11 Haoyu Han , Li Ma , Hanbing Wang , Bingheng Li , Daochen Zha , Chun How Tan , Huiji Gao , Xin Liu , Stephanie Moyerman , Sanjeev Katariya , Hui Liu , Jiliang Tang

Keyword extraction is used for summarizing the content of a document and supports efficient document retrieval, and is as such an indispensable part of modern text-based systems. We explore how load centrality, a graph-theoretic measure…

Computation and Language · Computer Science 2019-11-12 Blaž Škrlj , Andraž Repar , Senja Pollak

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for enhancing the capabilities of large language models. However, existing RAG evaluation predominantly focuses on text retrieval and relies on opaque, end-to-end…

Information Retrieval · Computer Science 2025-05-19 Chuan Xu , Qiaosheng Chen , Yutong Feng , Gong Cheng

To date, most abstractive summarisation models have relied on variants of the negative log-likelihood (NLL) as their training objective. In some cases, reinforcement learning has been added to train the models with an objective that is…

Computation and Language · Computer Science 2021-06-09 Jacob Parnell , Inigo Jauregi Unanue , Massimo Piccardi

We present a novel unsupervised framework for focused meeting summarization that views the problem as an instance of relation extraction. We adapt an existing in-domain relation learner (Chen et al., 2011) by exploiting a set of…

Computation and Language · Computer Science 2016-06-28 Lu Wang , Claire Cardie

Improving factual consistency of abstractive summarization has been a widely studied topic. However, most of the prior works on training factuality-aware models have ignored the negative effect it has on summary quality. We propose EFACTSUM…

Computation and Language · Computer Science 2023-05-25 Tanay Dixit , Fei Wang , Muhao Chen

Conventional solutions to automatic related work summarization rely heavily on human-engineered features. In this paper, we develop a neural data-driven summarizer by leveraging the seq2seq paradigm, in which a joint context-driven…

Computation and Language · Computer Science 2021-04-30 Yongzhen Wang , Xiaozhong Liu , Zheng Gao

In this paper, we present RTSUM, an unsupervised summarization framework that utilizes relation triples as the basic unit for summarization. Given an input document, RTSUM first selects salient relation triples via multi-level salience…

Computation and Language · Computer Science 2025-06-24 Seonglae Cho , Yonggi Cho , HoonJae Lee , Myungha Jang , Jinyoung Yeo , Dongha Lee

We discuss the use of multivariate Granger causality in presence of redundant variables: the application of the standard analysis, in this case, leads to under-estimation of causalities. Using the un-normalized version of the causality…

Quantitative Methods · Quantitative Biology 2015-05-14 L. Angelini , M. de Tommaso , D. Marinazzo , L. Nitti , M. Pellicoro , S. Stramaglia

Assessing an AI agent that can converse in human language and understand visual content is challenging. Generation metrics, such as BLEU scores favor correct syntax over semantics. Hence a discriminative approach is often used, where an…

Artificial Intelligence · Computer Science 2021-08-05 Idan Schwartz

Since LLMs emerged, more attention has been paid to abstractive long-form summarization, where longer input sequences indicate more information contained. Nevertheless, the automatic evaluation of such summaries remains underexplored. The…

Computation and Language · Computer Science 2026-01-30 Yuchen Fan , Yazhe Wan , Xin Zhong , Haonan Cheng , Ning Ding , Bowen Zhou

In this work, we aim at developing an extractive summarizer in the multi-document setting. We implement a rank based sentence selection using continuous vector representations along with key-phrases. Furthermore, we propose a model to…

Computation and Language · Computer Science 2020-06-26 Mir Tafseer Nayeem , Yllias Chali

This paper introduces and analyzes a search and retrieval model for RAG-like systems under {token} erasures. We provide an information-theoretic analysis of remote document retrieval when query representations are only partially preserved.…

Information Retrieval · Computer Science 2026-04-21 Sara Ghasvarianjahromi , Joshua Barr , Yauhen Yakimenka , Jörg Kliewer

The task of incomplete utterance rewriting has recently gotten much attention. Previous models struggled to extract information from the dialogue context, as evidenced by the low restoration scores. To address this issue, we propose a novel…

Machine Learning · Computer Science 2023-07-14 Yunshan Chen

Neural network-based methods for abstractive summarization produce outputs that are more fluent than other techniques, but which can be poor at content selection. This work proposes a simple technique for addressing this issue: use a…

Computation and Language · Computer Science 2018-10-10 Sebastian Gehrmann , Yuntian Deng , Alexander M. Rush

The scarcity of comprehensive up-to-date studies on evaluation metrics for text summarization and the lack of consensus regarding evaluation protocols continue to inhibit progress. We address the existing shortcomings of summarization…

Computation and Language · Computer Science 2021-02-03 Alexander R. Fabbri , Wojciech Kryściński , Bryan McCann , Caiming Xiong , Richard Socher , Dragomir Radev