English
Related papers

Related papers: Summary-Oriented Vision Modeling for Multimodal Ab…

200 papers

The rapid expansion of video content across a variety of industries, including social media, education, entertainment, and surveillance, has made video summarization an essential field of study. The current work is a survey that explores…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Toqa Alaa , Ahmad Mongy , Assem Bakr , Mariam Diab , Walid Gomaa

Multi-document summarization (MDS) is a challenging task, often decomposed to subtasks of salience and redundancy detection, followed by text generation. In this context, alignment of corresponding sentences between a reference summary and…

Computation and Language · Computer Science 2024-06-04 Ori Ernst , Ori Shapira , Aviv Slobodkin , Sharon Adar , Mohit Bansal , Jacob Goldberger , Ran Levy , Ido Dagan

Neural abstractive summarization models are flexible and can produce coherent summaries, but they are sometimes unfaithful and can be difficult to control. While previous studies attempt to provide different types of guidance to control the…

Computation and Language · Computer Science 2021-04-20 Zi-Yi Dou , Pengfei Liu , Hiroaki Hayashi , Zhengbao Jiang , Graham Neubig

Abstractive multi document summarization has evolved as a task through the basic sequence to sequence approaches to transformer and graph based techniques. Each of these approaches has primarily focused on the issues of multi document…

Computation and Language · Computer Science 2022-05-10 Aiswarya Sankar , Ankit Chadha

Controllable summarization allows users to generate customized summaries with specified attributes. However, due to the lack of designated annotations of controlled summaries, existing works have to craft pseudo datasets by adapting generic…

Computation and Language · Computer Science 2023-06-08 Yusen Zhang , Yang Liu , Ziyi Yang , Yuwei Fang , Yulong Chen , Dragomir Radev , Chenguang Zhu , Michael Zeng , Rui Zhang

In recent years, abstractive text summarization with multimodal inputs has started drawing attention due to its ability to accumulate information from different source modalities and generate a fluent textual summary. However, existing…

Machine Learning · Computer Science 2021-09-16 Yash Kumar Atri , Shraman Pramanick , Vikram Goyal , Tanmoy Chakraborty

Fact-checking real-world claims often requires reviewing multiple multimodal documents to assess a claim's truthfulness, which is a highly laborious and time-consuming task. In this paper, we present a summarization model designed to…

Artificial Intelligence · Computer Science 2024-09-23 Ting-Chih Chen , Chia-Wei Tang , Chris Thomas

Bayesian Active Learning has had significant impact to various NLP problems, but nevertheless it's application to text summarization has been explored very little. We introduce Bayesian Active Summarization (BAS), as a method of combining…

Computation and Language · Computer Science 2021-10-12 Alexios Gidiotis , Grigorios Tsoumakas

Recently, compressive text summarisation offers a balance between the conciseness issue of extractive summarisation and the factual hallucination issue of abstractive summarisation. However, most existing compressive summarisation methods…

Computation and Language · Computer Science 2023-06-07 Peggy Tang , Junbin Gao , Lei Zhang , Zhiyong Wang

Effective summarisation evaluation metrics enable researchers and practitioners to compare different summarisation systems efficiently. Estimating the effectiveness of an automatic evaluation metric, termed meta-evaluation, is a critically…

Computation and Language · Computer Science 2024-10-01 Xiang Dai , Sarvnaz Karimi , Biaoyan Fang

Sentence simplification tends to focus on the generic simplification of sentences by making them more readable and easier to understand. This paper provides a dataset aimed at training models that perform subject aware sentence…

Computation and Language · Computer Science 2023-03-28 Brad Windsor , Luke Martin , Anand Tyagi

In this work, we introduce the task of script-driven video summarization, which aims to produce a summary of the full-length video by selecting the parts that are most relevant to a user-provided script outlining the visual content of the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Manolis Mylonas , Evlampios Apostolidis , Vasileios Mezaris

Abstractive dialogue summarization is to generate a concise and fluent summary covering the salient information in a dialogue among two or more interlocutors. It has attracted great attention in recent years based on the massive emergence…

Computation and Language · Computer Science 2023-08-08 Qi Jia , Yizhu Liu , Siyu Ren , Kenny Q. Zhu

In this paper we address the task of summarizing television shows, which touches key areas in AI research: complex reasoning, multiple modalities, and long narratives. We present a modular approach where separate components perform…

Computation and Language · Computer Science 2024-08-23 Louis Mahon , Mirella Lapata

The recent development of Video-based Large Language Models (VideoLLMs), has significantly advanced video summarization by aligning video features and, in some cases, audio features with Large Language Models (LLMs). Each of these VideoLLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Kuan-Chen Mu , Zhi-Yi Chin , Wei-Chen Chiu

One key challenge in multi-document summarization is to capture the relations among input documents that distinguish between single document summarization (SDS) and multi-document summarization (MDS). Few existing MDS works address this…

Computation and Language · Computer Science 2022-09-14 Congbo Ma , Wei Emma Zhang , Pitawelayalage Dasun Dileepa Pitawela , Yutong Qu , Haojie Zhuang , Hu Wang

Pre-trained neural abstractive summarization systems have dominated extractive strategies on news summarization performance, at least in terms of ROUGE. However, system-generated abstractive summaries often face the pitfall of factual…

Computation and Language · Computer Science 2020-10-07 Yue Dong , Shuohang Wang , Zhe Gan , Yu Cheng , Jackie Chi Kit Cheung , Jingjing Liu

Automatically summarizing large text collections is a valuable tool for document research, with applications in journalism, academic research, legal work, and many other fields. In this work, we contrast two classes of systems for…

Computation and Language · Computer Science 2025-02-11 Adithya Pratapa , Teruko Mitamura

Most traditional video summarization methods are designed to generate effective summaries for single-view videos, and thus they cannot fully exploit the complicated intra and inter-view correlations in summarizing multi-view videos in a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Rameswar Panda , Amit K. Roy-Chowdhury

While most existing video summarization approaches aim to extract an informative summary of a single video, we propose a novel framework for summarizing multi-view videos by exploiting both intra- and inter-view content correlations in a…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Rameswar Panda , Abir Das , Amit K. Roy-Chowdhury