English
Related papers

Related papers: NLP Driven Ensemble Based Automatic Subtitle Gener…

200 papers

Large Language Models (LLMs) have been widely applied in summarization due to their speedy and high-quality text generation. Summarization for sensemaking involves information compression and insight extraction. Human guidance in…

Human-Computer Interaction · Computer Science 2024-09-27 Xuxin Tang , Eric Krokos , Can Liu , Kylie Davidson , Kirsten Whitley , Naren Ramakrishnan , Chris North

The goal of this paper is automatic character-aware subtitle generation. Given a video and a minimal amount of metadata, we propose an audio-visual method that generates a full transcript of the dialogue, with precise speech timestamps, and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Bruno Korbar , Jaesung Huh , Andrew Zisserman

In the Internet, ubiquitous presence of redundant, unedited, raw videos has made video summarization an important problem. Traditional methods of video summarization employ a heuristic set of hand-crafted features, which in many cases fail…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Mohaiminul Al Nahian , A. S. M. Iftekhar , Mohammad Tariqul Islam , S. M. Mahbubur Rahman , Dimitrios Hatzinakos

Source code summarization -- creating natural language descriptions of source code behavior -- is a rapidly-growing research topic with applications to automatic documentation generation, program comprehension, and software maintenance.…

Software Engineering · Computer Science 2019-02-07 Alexander LeClair , Siyuan Jiang , Collin McMillan

The goal of this work is to temporally align asynchronous subtitles in sign language videos. In particular, we focus on sign-language interpreted TV broadcast data comprising (i) a video of continuous signing, and (ii) subtitles…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Hannah Bull , Triantafyllos Afouras , Gül Varol , Samuel Albanie , Liliane Momeni , Andrew Zisserman

Evaluation of automatic video summaries is a challenging problem. In the past years, some evaluation methods are presented that utilize only a single feature like color feature to detect similarity between automatic video summaries and…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Karim M. Mahmoud

Extractive text summarization has been an extensive research problem in the field of natural language understanding. While the conventional approaches rely mostly on manually compiled features to generate the summary, few attempts have been…

Computation and Language · Computer Science 2019-12-30 Abhishek Kumar Singh , Manish Gupta , Vasudeva Varma

Automatic summarisation is a popular approach to reduce a document to its main arguments. Recent research in the area has focused on neural approaches to summarisation, which can be very data-hungry. However, few large datasets exist and…

Computation and Language · Computer Science 2017-06-14 Ed Collins , Isabelle Augenstein , Sebastian Riedel

Subtitling is becoming increasingly important for disseminating information, given the enormous amounts of audiovisual content becoming available daily. Although Neural Machine Translation (NMT) can speed up the process of translating…

Computation and Language · Computer Science 2020-06-02 Alina Karakanta , Matteo Negri , Marco Turchi

Evaluating text summarization has been a challenging task in natural language processing (NLP). Automatic metrics which heavily rely on reference summaries are not suitable in many situations, while human evaluation is time-consuming and…

Computation and Language · Computer Science 2024-07-02 Huyen Nguyen , Haihua Chen , Lavanya Pobbathi , Junhua Ding

Recent advances in image captioning task have led to increasing interests in video captioning task. However, most works on video captioning are focused on generating single input of aggregated features, which hardly deviates from image…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Andrew Shin , Katsunori Ohnishi , Tatsuya Harada

Each programming language comes with official documentation to guide developers with APIs, methods, and classes. However, in some cases, official documentation is not an efficient way to get the needed information. As a result, developers…

Software Engineering · Computer Science 2023-11-08 AmirHossein Naghshzan

It is now much easier than ever before to produce videos. While the ubiquitous video data is a great source for information discovery and extraction, the computational challenges are unparalleled. Automatically summarizing the videos has…

Machine Learning · Computer Science 2018-10-26 Aidean Sharghi , Ali Borji , Chengtao Li , Tianbao Yang , Boqing Gong

The growth of videos in our digital age and the users' limited time raise the demand for processing untrimmed videos to produce shorter versions conveying the same information. Despite the remarkable progress that summarization methods have…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Washington Ramos , Michel Silva , Edson Araujo , Victor Moura , Keller Oliveira , Leandro Soriano Marcolino , Erickson R. Nascimento

Sentence scoring and sentence selection are two main steps in extractive document summarization systems. However, previous works treat them as two separated subtasks. In this paper, we present a novel end-to-end neural network framework for…

Computation and Language · Computer Science 2018-07-09 Qingyu Zhou , Nan Yang , Furu Wei , Shaohan Huang , Ming Zhou , Tiejun Zhao

Automatically generating a summary of sports video poses the challenge of detecting interesting moments, or highlights, of a game. Traditional sports video summarization methods leverage editing conventions of broadcast sports video that…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Antonio Tejero-de-Pablos , Yuta Nakashima , Tomokazu Sato , Naokazu Yokoya , Marko Linna , Esa Rahtu

Text summarization is a fundamental task in natural language processing (NLP), and the information explosion has made long-document processing increasingly demanding, making summarization essential. Existing research mainly focuses on model…

The substantial growth of textual content in diverse domains and platforms has led to a considerable need for Automatic Text Summarization (ATS) techniques that aid in the process of text analysis. The effectiveness of text summarization…

Computation and Language · Computer Science 2025-03-03 Nevidu Jayatilleke , Ruvan Weerasinghe , Nipuna Senanayake

Traditional sequence-to-sequence (seq2seq) models and other variations of the attention-mechanism such as hierarchical attention have been applied to the text summarization problem. Though there is a hierarchy in the way humans use language…

Machine Learning · Computer Science 2019-11-04 Rajeev Bhatt Ambati , Saptarashmi Bandyopadhyay , Prasenjit Mitra

Summarizing long-form narratives--such as books, movies, and TV scripts--requires capturing intricate plotlines, character interactions, and thematic coherence, a task that remains challenging for existing LLMs. We introduce NexusSum, a…

Computation and Language · Computer Science 2025-06-02 Hyuntak Kim , Byung-Hak Kim