English
Related papers

Related papers: A Survey on Multi-modal Summarization

200 papers

Modern developments in digital media technologies has made transmitting and storing large amounts of multi/rich media data (e.g. text, images, music, video and their combination) more feasible and affordable than ever before. However, the…

Multimedia · Computer Science 2011-09-07 Pravin M. Kamde , Dr. Siddu. P. Algur

The rapid proliferation of online video content necessitates effective video summarization techniques. Traditional methods, often relying on a single modality (typically visual), struggle to capture the full semantic richness of videos.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuo wang , Jihao Zhang

Document summarization is a task to shorten texts into concise and informative summaries. This paper introduces a novel dataset designed for summarizing multiple scientific articles into a section of a survey. Our contributions are: (1)…

While most existing video summarization approaches aim to extract an informative summary of a single video, we propose a novel framework for summarizing multi-view videos by exploiting both intra- and inter-view content correlations in a…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Rameswar Panda , Abir Das , Amit K. Roy-Chowdhury

Long video summarization presents significant challenges for current multimodal large language models (MLLMs), particularly in maintaining temporal fidelity over extended durations and producing summaries that are both semantically and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Alkesh Patel , Melis Ozyildirim , Ying-Chang Cheng , Ganesh Nagarajan

In this paper we introduce a new dataset for 360-degree video summarization: the transformation of 360-degree video content to concise 2D-video summaries that can be consumed via traditional devices, such as TV sets and smartphones. The…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Ioannis Kontostathis , Evlampios Apostolidis , Vasileios Mezaris

Remote communication through video or audio conferences has become more popular than ever because of the worldwide pandemic. These events, therefore, have provoked the development of systems for automatic minuting of spoken language leading…

Computation and Language · Computer Science 2024-10-07 Olga Iakovenko , Anna Andreeva , Anna Lapidus , Liana Mikaelyan

Large Language Models (LLMs) have been widely applied in summarization due to their speedy and high-quality text generation. Summarization for sensemaking involves information compression and insight extraction. Human guidance in…

Human-Computer Interaction · Computer Science 2024-09-27 Xuxin Tang , Eric Krokos , Can Liu , Kylie Davidson , Kirsten Whitley , Naren Ramakrishnan , Chris North

As the number of video content has mushroomed in recent years, automatic video summarization has come useful when we want to just peek at the content of the video. However, there are two underlying limitations in generic video summarization…

Machine Learning · Computer Science 2023-01-23 Jeiyoon Park , Kiho Kwoun , Chanhee Lee , Heuiseok Lim

The exploration of multimodal language models integrates multiple data types, such as images, text, language, audio, and other heterogeneity. While the latest large language models excel in text-based tasks, they often struggle to…

Artificial Intelligence · Computer Science 2023-11-23 Jiayang Wu , Wensheng Gan , Zefeng Chen , Shicheng Wan , Philip S. Yu

Recent years have witnessed a resurgence of interest in video summarization. However, one of the main obstacles to the research on video summarization is the user subjectivity - users have various preferences over the summaries. The…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Aidean Sharghi , Jacob S. Laurel , Boqing Gong

Automatic generation of summaries from multiple news articles is a valuable tool as the number of online publications grows rapidly. Single document summarization (SDS) systems have benefited from advances in neural encoder-decoder model…

Computation and Language · Computer Science 2019-06-21 Alexander R. Fabbri , Irene Li , Tianwei She , Suyi Li , Dragomir R. Radev

This paper presents a web-based tool that facilitates the production of tailored summaries for online sharing on social media. Through an interactive user interface, it supports a ``one-click'' video summarization process. Based on the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Evlampios Apostolidis , Konstantinos Apostolidis , Vasileios Mezaris

The increasing amount of online content motivated the development of multi-document summarization methods. In this work, we explore straightforward approaches to extend single-document summarization methods to multi-document summarization.…

Information Retrieval · Computer Science 2015-07-13 Luís Marujo , Ricardo Ribeiro , David Martins de Matos , João P. Neto , Anatole Gershman , Jaime Carbonell

A comparative study of various techniques which can be used for summarization of Videos i.e. Video to Video conversion is presented along with respective architecture, results, strengths and shortcomings. In all approaches, a lengthy video…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Ravi Raj , Varad Bhatnagar , Aman Kumar Singh , Sneha Mane , Nilima Walde

Meeting summarization is crucial in digital communication, but existing solutions struggle with salience identification to generate personalized, workable summaries, and context understanding to fully comprehend the meetings' content.…

Computation and Language · Computer Science 2025-02-19 Frederic Kirstein , Terry Ruas , Robert Kratel , Bela Gipp

Meetings are a key component of human collaboration. As increasing numbers of meetings are recorded and transcribed, meeting summaries have become essential to remind those who may or may not have attended the meetings about the key…

Computation and Language · Computer Science 2021-04-14 Ming Zhong , Da Yin , Tao Yu , Ahmad Zaidi , Mutethia Mutuma , Rahul Jha , Ahmed Hassan Awadallah , Asli Celikyilmaz , Yang Liu , Xipeng Qiu , Dragomir Radev

In the rapidly evolving landscape of digital content, the task of summarizing multimedia documents, which encompass textual, visual, and auditory elements, presents intricate challenges. These challenges include extracting pertinent…

Multimedia · Computer Science 2024-12-30 Azze-Eddine Maredj , Madjid Sadallah

As academic literature proliferates, traditional review methods are increasingly challenged by the sheer volume and diversity of available research. This article presents a study that aims to address these challenges by enhancing the…

Huge volumes of textual information has been produced every single day. In order to organize and understand such large datasets, in recent years, summarization techniques have become popular. These techniques aims at finding relevant,…

Computation and Language · Computer Science 2018-03-26 Jorge V. Tohalino , Diego R. Amancio