English
Related papers

Related papers: SalSum: Saliency-based Video Summarization using G…

200 papers

Despite its wide range of applications, video summarization is still held back by the scarcity of extensive datasets, largely due to the labor-intensive and costly nature of frame-level annotations. As a result, existing video summarization…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Hojjat Mokhtarabadi , Kave Bahraman , Mehrdad HosseinZadeh , Mahdi Eftekhari

A crucial factor to trust Machine Learning (ML) algorithm decisions is a good representation of its application field by the training dataset. This is particularly true when parts of the training data have been artificially generated to…

Machine Learning · Computer Science 2020-01-03 Hiba Arnout , Johannes Kehrer , Johanna Bronner , Thomas Runkler

Predicting saliency in videos is a challenging problem due to complex modeling of interactions between spatial and temporal information, especially when ever-changing, dynamic nature of videos is considered. Recently, researchers have…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Aysun Kocak , Erkut Erdem , Aykut Erdem

We propose a second order gradient based method with ADAM and RMSprop for the training of generative adversarial networks. The proposed method is fastest to obtain similar accuracy when compared to prominent second order methods. Unlike…

Machine Learning · Computer Science 2023-04-21 Sachin Kumar Danisetty , Santhosh Reddy Mylaram , Pawan Kumar

The rapid proliferation of online video content necessitates effective video summarization techniques. Traditional methods, often relying on a single modality (typically visual), struggle to capture the full semantic richness of videos.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shuo wang , Jihao Zhang

Conventional Generative Adversarial Networks (GANs) for text generation tend to have issues of reward sparsity and mode collapse that affect the quality and diversity of generated samples. To address the issues, we propose a novel…

Computation and Language · Computer Science 2020-02-13 Wangchunshu Zhou , Tao Ge , Ke Xu , Furu Wei , Ming Zhou

The large amount of videos popping up every day, make it more and more critical that key information within videos can be extracted and understood in a very short time. Video summarization, the task of finding the smallest subset of frames,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Yujia Zhang , Michael Kampffmeyer , Xiaodan Liang , Dingwen Zhang , Min Tan , Eric P. Xing

This paper proposes a novel simultaneous localization and mapping (SLAM) approach, namely Attention-SLAM, which simulates human navigation mode by combining a visual saliency model (SalNavNet) with traditional monocular visual SLAM. Most…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Jinquan Li , Ling Pei , Danping Zou , Songpengcheng Xia , Qi Wu , Tao Li , Zhen Sun , Wenxian Yu

The use of accurate scanning transmission electron microscopy (STEM) image simulation methods require large computation times that can make their use infeasible for the simulation of many images. Other simulation methods based on linear…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Nick Lawrence , Mingren Shen , Ruiqi Yin , Cloris Feng , Dane Morgan

Text summarization in medicine can help doctors for reducing the time to access important information from countless documents. The paper offers a supervised extractive summarization method based on conditional generative adversarial…

Computation and Language · Computer Science 2021-10-25 Seyed Vahid Moravvej , Abdolreza Mirzaei , Mehran Safayani

Recently, video summarization has been proposed as a method to help video exploration. However, traditional video summarization models only generate a fixed video summary which is usually independent of user-specific needs and hence limits…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jia-Hong Huang , Chao-Han Huck Yang , Pin-Yu Chen , Andrew Brown , Marcel Worring

Long video summarization presents significant challenges for current multimodal large language models (MLLMs), particularly in maintaining temporal fidelity over extended durations and producing summaries that are both semantically and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Alkesh Patel , Melis Ozyildirim , Ying-Chang Cheng , Ganesh Nagarajan

Existing visual SLAM approaches are sensitive to illumination, with their precision drastically falling in dark conditions due to feature extractor limitations. The algorithms currently used to overcome this issue are not able to provide…

Single-Image Super-Resolution can support robotic tasks in environments where a reliable visual stream is required to monitor the mission, handle teleoperation or study relevant visual details. In this work, we propose an efficient…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Simone Angarano , Francesco Salvetti , Mauro Martini , Marcello Chiaberge

Video matting has traditionally been limited by the lack of high-quality ground-truth data. Most existing video matting datasets provide only human-annotated imperfect alpha and foreground annotations, which must be composited to background…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yongtao Ge , Kangyang Xie , Guangkai Xu , Mingyu Liu , Li Ke , Longtao Huang , Hui Xue , Hao Chen , Chunhua Shen

In recent years, there has been a growing interest in Semantic Image Synthesis (SIS) through the use of Generative Adversarial Networks (GANs) and diffusion models. This field has seen innovations such as the implementation of specialized…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Khaled M. Seyam , Julian Wiederer , Markus Braun , Bin Yang

Exploiting the inner-shot and inter-shot dependencies is essential for key-shot based video summarization. Current approaches mainly devote to modeling the video as a frame sequence by recurrent neural networks. However, one potential…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Bin Zhao , Haopeng Li , Xiaoqiang Lu , Xuelong Li

The increasing ubiquity of video content and the corresponding demand for efficient access to meaningful information have elevated video summarization and video highlights as a vital research area. However, many state-of-the-art methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Pritam Mishra , Coloma Ballester , Dimosthenis Karatzas

The large domain discrepancy between faces captured in polarimetric (or conventional) thermal and visible domain makes cross-domain face verification a highly challenging problem for human examiners as well as computer vision algorithms.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 He Zhang , Benjamin S. Riggan , Shuowen Hu , Nathaniel J. Short , Vishal M. Patel

Video summarization aims to eliminate visual redundancy while retaining key parts of video to construct concise and comprehensive synopses. Most existing methods use discriminative models to predict the importance scores of video frames.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zirui Shang , Yubo Zhu , Hongxi Li , Shuo Yang , Xinxiao Wu