English
Related papers

Related papers: A Survey on Multi-modal Summarization

200 papers

In the contemporary information era, significantly accelerated by the advent of Large-scale Language Models, the proliferation of scientific literature is reaching unprecedented levels. Researchers urgently require efficient tools for…

Computation and Language · Computer Science 2024-01-18 Feng Jiang , Kuang Wang , Haizhou Li

Novel neural architectures, training strategies, and the availability of large-scale corpora haven been the driving force behind recent progress in abstractive text summarization. However, due to the black-box nature of neural models,…

Computation and Language · Computer Science 2021-07-27 Jesse Vig , Wojciech Kryściński , Karan Goel , Nazneen Fatema Rajani

The exponential growth of video content necessitates effective video summarization to efficiently extract key information from long videos. However, current approaches struggle to fully comprehend complex videos, primarily because they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Sumin Kim , Hyemin Jeong , Mingu Kang , Yejin Kim , Yoori Oh , Joonseok Lee

The increasing availability of semantic data has substantially enhanced Web applications. Semantic data such as RDF data is commonly represented as entity-property-value triples. The magnitude of semantic data, in particular the large…

Information Retrieval · Computer Science 2021-05-12 Qingxia Liu , Gong Cheng , Kalpa Gunaratna , Yuzhong Qu

Given the explosive growth of online videos, it is becoming increasingly important to relieve the tedious work of browsing and managing the video content of interest. Video summarization aims at providing such a technique by transforming…

Computer Vision and Pattern Recognition · Computer Science 2017-07-14 Zhong Ji , Yaru Ma , Yanwei Pang , Xuelong Li

We are developing an automatic method to compile an encyclopedic corpus from the Web. In our previous work, paragraph-style descriptions for a term are extracted from Web pages and organized based on domains. However, these descriptions are…

Computation and Language · Computer Science 2007-05-23 Atsushi Fujii , Tetsuya Ishikawa

Large Language Models have advanced clinical Natural Language Generation, creating opportunities to manage the volume of medical text. However, the high-stakes nature of medicine requires reliable evaluation, which remains a challenge. In…

Multimodal Mathematical Reasoning (MMR) has recently attracted increasing attention for its capability to solve mathematical problems involving both textual and visual modalities. However, current models still face significant challenges in…

Artificial Intelligence · Computer Science 2026-04-15 Tianyu Yang , Sihong Wu , Yilun Zhao , Zhenwen Liang , Lisen Dai , Chen Zhao , Minhao Cheng , Arman Cohan , Xiangliang Zhang

We present a novel summarization framework for reviews of products and services by selecting informative and concise text segments from the reviews. Our method consists of two major steps. First, we identify five frequently occurring…

Information Retrieval · Computer Science 2012-11-26 Trung V. Nguyen , Alice H. Oh

Although the problem of automatic video summarization has recently received a lot of attention, the problem of creating a video summary that also highlights elements relevant to a search query has been less studied. We address this problem…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Arun Balajee Vasudevan , Michael Gygli , Anna Volokitin , Luc Van Gool

The recent development of Video-based Large Language Models (VideoLLMs), has significantly advanced video summarization by aligning video features and, in some cases, audio features with Large Language Models (LLMs). Each of these VideoLLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Kuan-Chen Mu , Zhi-Yi Chin , Wei-Chen Chiu

Video summarization has unprecedented importance to help us digest, browse, and search today's ever-growing video collections. We propose a novel subset selection technique that leverages supervision in the form of human-created summaries…

Computer Vision and Pattern Recognition · Computer Science 2016-05-02 Ke Zhang , Wei-Lun Chao , Fei Sha , Kristen Grauman

This chapter gives an overview of recent advances in the field of biomedical text summarization. Different types of challenges are introduced, and methods are discussed concerning the type of challenge that they address. Biomedical…

Computation and Language · Computer Science 2019-08-08 Milad Moradi , Nasser Ghadiri

Video skimming, also known as dynamic video summarization, generates a temporally abridged version of a given video. Skimming can be achieved by identifying significant components either in uni-modal or multi-modal features extracted from…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Vivekraj V. K. , Debashis Sen , Balasubramanian Raman

Summarizing texts is not a straightforward task. Before even considering text summarization, one should determine what kind of summary is expected. How much should the information be compressed? Is it relevant to reformulate or should the…

Computation and Language · Computer Science 2020-07-16 Paul Tardy , David Janiszek , Yannick Estève , Vincent Nguyen

Abstractive dialogue summarization is to generate a concise and fluent summary covering the salient information in a dialogue among two or more interlocutors. It has attracted great attention in recent years based on the massive emergence…

Computation and Language · Computer Science 2023-08-08 Qi Jia , Yizhu Liu , Siyu Ren , Kenny Q. Zhu

We present a novel system providing summaries for Computer Science publications. Through a qualitative user study, we identified the most valuable scenarios for discovery, exploration and understanding of scientific documents. Based on…

Multimodal Dialogue Summarization (MDS) is a critical task with wide-ranging applications. To support the development of effective MDS models, robust automatic evaluation methods are essential for reducing both cost and human effort.…

Computation and Language · Computer Science 2025-10-03 Yinhong Liu , Jianfeng He , Hang Su , Ruixue Lian , Yi Nian , Jake Vincent , Srikanth Vishnubhotla , Robinson Piramuthu , Saab Mansour

Multi-modal 3D scene understanding has gained considerable attention due to its wide applications in many areas, such as autonomous driving and human-computer interaction. Compared to conventional single-modal 3D understanding, introducing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Yinjie Lei , Zixuan Wang , Feng Chen , Guoqing Wang , Peng Wang , Yang Yang

A massive amount of reviews are generated daily from various platforms. It is impossible for people to read through tons of reviews and to obtain useful information. Automatic summarizing customer reviews thus is important for identifying…

Computation and Language · Computer Science 2020-06-02 Pengyuan Li , Lei Huang , Guang-jie Ren