English
Related papers

Related papers: A Survey on Multi-modal Summarization

200 papers

Significant developments in techniques such as encoder-decoder models have enabled us to represent information comprising multiple modalities. This information can further enhance many downstream tasks in the field of information retrieval…

Computation and Language · Computer Science 2023-02-14 Yash Verma , Anubhav Jangra , Raghvendra Kumar , Sriparna Saha

Multimodal abstractive summarization (MAS) aims to produce a concise summary given the multimodal data (text and vision). Existing studies mainly focus on how to effectively use the visual features from the perspective of an article, having…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Yunlong Liang , Fandong Meng , Jinan Xu , Jiaan Wang , Yufeng Chen , Jie Zhou

Table summarization is a crucial task aimed at condensing information from tabular data into concise and comprehensible textual summaries. However, existing approaches often fall short of adequately meeting users' information and quality…

Computation and Language · Computer Science 2024-08-27 Weijia Zhang , Vaishali Pal , Jia-Hong Huang , Evangelos Kanoulas , Maarten de Rijke

Multi-document summarization is the process of automatically generating a concise summary of multiple documents related to the same topic. This summary can help users quickly understand the key information from a large collection of…

Computation and Language · Computer Science 2023-12-20 Charles Rajan , Nishit Asnani , Shreya Singh

Automatic text summarization has experienced substantial progress in recent years. With this progress, the question has arisen whether the types of summaries that are typically generated by automatic summarization models align with users'…

Computation and Language · Computer Science 2022-04-26 Maartje ter Hoeve , Julia Kiseleva , Maarten de Rijke

Multi-document summarization (MDS) is the task of reflecting key points from any set of documents into a concise text paragraph. In the past, it has been used to aggregate news, tweets, product reviews, etc. from various sources. Owing to…

Computation and Language · Computer Science 2020-10-06 Alvin Dey , Tanya Chowdhury , Yash Kumar Atri , Tanmoy Chakraborty

Customer reviews are vital for making purchasing decisions in the Information Age. Such reviews can be automatically summarized to provide the user with an overview of opinions. In this tutorial, we present various aspects of opinion…

Computation and Language · Computer Science 2022-06-06 Reinald Kim Amplayo , Arthur Bražinskas , Yoshi Suhara , Xiaolan Wang , Bing Liu

Traditional video summarization methods generate fixed video representations regardless of user interest. Therefore such methods limit users' expectations in content search and exploration scenarios. Multi-modal video summarization is one…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Jia-Hong Huang , Luka Murn , Marta Mrak , Marcel Worring

This article provides a systematic up-to-date survey of automatic summarization techniques, datasets, models, and evaluation methods in the legal domain. Through specific source selection criteria, we thoroughly review over 120 papers…

Computation and Language · Computer Science 2025-01-31 Mousumi Akter , Erion Çano , Erik Weber , Dennis Dobler , Ivan Habernal

The scarcity of comprehensive up-to-date studies on evaluation metrics for text summarization and the lack of consensus regarding evaluation protocols continue to inhibit progress. We address the existing shortcomings of summarization…

Computation and Language · Computer Science 2021-02-03 Alexander R. Fabbri , Wojciech Kryściński , Bryan McCann , Caiming Xiong , Richard Socher , Dragomir Radev

The internet has had a dramatic effect on the healthcare industry, allowing documents to be saved, shared, and managed digitally. This has made it easier to locate and share important data, improving patient care and providing more…

Computation and Language · Computer Science 2022-12-06 Raghav Jain , Anubhav Jangra , Sriparna Saha , Adam Jatowt

Multimedia summarization with multimodal output (MSMO) is a recently explored application in language grounding. It plays an essential role in real-world applications, i.e., automatically generating cover images and titles for news articles…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jielin Qiu , Jiacheng Zhu , Mengdi Xu , Franck Dernoncourt , Trung Bui , Zhaowen Wang , Bo Li , Ding Zhao , Hailin Jin

Video summarization, by selecting the most informative and/or user-relevant parts of original videos to create concise summary videos, has high research value and consumer demand in today's video proliferation era. Multi-modal video…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yaowei Guo , Jiazheng Xing , Xiaojun Hou , Shuo Xin , Juntao Jiang , Demetri Terzopoulos , Chenfanfu Jiang , Yong Liu

Multimodal summarization (MS) aims to generate a summary from multimodal input. Previous works mainly focus on textual semantic coverage metrics such as ROUGE, which considers the visual content as supplemental data. Therefore, the summary…

Artificial Intelligence · Computer Science 2023-02-21 Litian Zhang , Xiaoming Zhang , Ziming Guo , Zhipeng Liu

Summaries are important when it comes to process huge amounts of information. Their most important benefit is saving time, which we do not have much nowadays. Therefore, a summary must be short, representative and readable. Generating…

Computation and Language · Computer Science 2019-04-02 Abdelkrime Aries , Djamel eddine Zegour , Walid Khaled Hidouci

Long-form video content constitutes a significant portion of internet traffic, making automated video summarization an essential research problem. However, existing video summarization datasets are notably limited in their size,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Dawit Mureja Argaw , Seunghyun Yoon , Fabian Caba Heilbron , Hanieh Deilamsalehy , Trung Bui , Zhaowen Wang , Franck Dernoncourt , Joon Son Chung

In the real world, where information is abundant and diverse across different modalities, understanding and utilizing various data types to improve retrieval systems is a key focus of research. Multimodal composite retrieval integrates…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Suyan Li , Fuxiang Huang , Lei Zhang

Text summarization is the research area aiming at creating a short and condensed version of the original document, which conveys the main idea of the document in a few words. This research topic has started to attract the attention of a…

Computation and Language · Computer Science 2020-05-12 Shen Gao , Xiuying Chen , Zhaochun Ren , Dongyan Zhao , Rui Yan

Recently, video summarization has been proposed as a method to help video exploration. However, traditional video summarization models only generate a fixed video summary which is usually independent of user-specific needs and hence limits…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jia-Hong Huang , Chao-Han Huck Yang , Pin-Yu Chen , Andrew Brown , Marcel Worring

Query-based text summarization is an important real world problem that requires to condense the prolix text data into a summary under the guidance of the query information provided by users. The topic has been studied for a long time and…

Information Retrieval · Computer Science 2024-10-08 Hang Yu , Jiawei Han