English
Related papers

Related papers: Multi-modal Summarization for Video-containing Doc…

200 papers

Since the advent of the web, the amount of data on wen has been increased several million folds. In recent years web data generated is more than data stored for years. One important data format is text. To answer user queries over the…

Information Retrieval · Computer Science 2018-11-19 Chandra Shekhar Yadav

While advances in computing resources have made processing enormous amounts of data possible, human ability to identify patterns in such data has not scaled accordingly. Efficient computational methods for condensing and simplifying data…

Information Retrieval · Computer Science 2020-04-03 Yike Liu , Tara Safavi , Abhilash Dighe , Danai Koutra

Videos contain multi-modal content, and exploring multi-level cross-modal interactions with natural language queries can provide great prominence to text-video retrieval task (TVR). However, new trending methods applying large-scale…

Multimedia · Computer Science 2022-08-23 Shuo Liu , Weize Quan , Ming Zhou , Sihong Chen , Jian Kang , Zhe Zhao , Chen Chen , Dong-Ming Yan

Multimodal summarization (MS) aims to generate a summary from multimodal input. Previous works mainly focus on textual semantic coverage metrics such as ROUGE, which considers the visual content as supplemental data. Therefore, the summary…

Artificial Intelligence · Computer Science 2023-02-21 Litian Zhang , Xiaoming Zhang , Ziming Guo , Zhipeng Liu

With the rapid development of mobile Internet and big data, a huge amount of data is generated in the network, but the data that users are really interested in a very small portion. To extract the information that users are interested in…

Information Retrieval · Computer Science 2022-05-09 Bo Liu

Video consumption is a key part of daily life, but watching entire videos can be tedious. To address this, researchers have explored video summarization and highlight detection to identify key video segments. While some works combine video…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Spyros Barbakos , Charalampos Antoniadis , Gerasimos Potamianos , Gianluca Setti

We introduce Web-Scale Multimodal Summarization, a lightweight framework for generating summaries by combining retrieved text and image data from web sources. Given a user-defined topic, the system performs parallel web, news, and image…

Machine Learning · Computer Science 2026-02-17 Mounvik K , N Harshit

Information Retrieval (IR) methods aim to identify documents relevant to a query, which have been widely applied in various natural language tasks. However, existing approaches typically consider only the textual content within documents,…

Computation and Language · Computer Science 2026-01-26 Jaewoo Lee , Joonho Ko , Jinheon Baek , Soyeong Jeong , Sung Ju Hwang

We consider the problem of video summarization. Given an input raw video, the goal is to select a small subset of key frames from the input video to create a shorter summary video that best describes the content of the original video. Most…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Mrigank Rochan , Yang Wang

The task of retrieving video content relevant to natural language queries plays a critical role in effectively handling internet-scale datasets. Most of the existing methods for this caption-to-video retrieval problem do not fully exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Valentin Gabeur , Chen Sun , Karteek Alahari , Cordelia Schmid

Cross-lingual summarization involves the summarization of text written in one language to a different one. There is a body of research addressing cross-lingual summarization from English to other European languages. In this work, we aim to…

Computation and Language · Computer Science 2023-12-25 Nikhilesh Bhatnagar , Ashok Urlana , Vandan Mujadia , Pruthwik Mishra , Dipti Misra Sharma

The goal of video summarization is to automatically shorten videos such that it conveys the overall story without losing relevant information. In many application scenarios, improper video summarization can have a large impact. For example…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jia-Hong Huang , Chao-Han Huck Yang , Pin-Yu Chen , Min-Hung Chen , Marcel Worring

Multi-document summarization entails producing concise synopses of collections of inputs. For some applications, the synopsis should accurately synthesize inputs with respect to a key aspect, e.g., a synopsis of film reviews written about a…

Computation and Language · Computer Science 2024-07-15 Jay DeYoung , Stephanie C. Martinez , Iain J. Marshall , Byron C. Wallace

With the advancement of telemedicine, both researchers and medical practitioners are working hand-in-hand to develop various techniques to automate various medical operations, such as diagnosis report generation. In this paper, we first…

Computation and Language · Computer Science 2023-09-28 Abhisek Tiwari , Anisha Saha , Sriparna Saha , Pushpak Bhattacharyya , Minakshi Dhar

Text summarization is an approach for identifying important information present within text documents. This computational technique aims to generate shorter versions of the source text, by including only the relevant and salient information…

Computation and Language · Computer Science 2021-06-30 Kalliath Abdul Rasheed Issam , Shivam Patel , Subalalitha C. N

Quickly understanding lengthy lecture videos is essential for learners with limited time and interest in various topics to improve their learning efficiency. To this end, video summarization has been actively researched to enable users to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Kazuki Kawamura , Jun Rekimoto

Significant developments in techniques such as encoder-decoder models have enabled us to represent information comprising multiple modalities. This information can further enhance many downstream tasks in the field of information retrieval…

Computation and Language · Computer Science 2023-02-14 Yash Verma , Anubhav Jangra , Raghvendra Kumar , Sriparna Saha

Automatic generation of summaries from multiple news articles is a valuable tool as the number of online publications grows rapidly. Single document summarization (SDS) systems have benefited from advances in neural encoder-decoder model…

Computation and Language · Computer Science 2019-06-21 Alexander R. Fabbri , Irene Li , Tianwei She , Suyi Li , Dragomir R. Radev

The technology of automatic document summarization is maturing and may provide a solution to the information overload problem. Nowadays, document summarization plays an important role in information retrieval. With a large volume of…

Information Retrieval · Computer Science 2012-04-10 Mohsen Pourvali , Mohammad Saniee Abadeh

Video summarization aims to automatically generate a summary (storyboard or video skim) of a video, which can facilitate large-scale video retrieval and browsing. Most of the existing methods perform video summarization on individual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Li Haopeng , Ke Qiuhong , Gong Mingming , Zhang Rui