中文
相关论文

相关论文: SELF-VS: Self-supervised Encoding Learning For Vid…

200 篇论文

Self-supervised tasks have been utilized to build useful representations that can be used in downstream tasks when the annotation is unavailable. In this paper, we introduce a self-supervised video representation learning method based on…

计算机视觉与模式识别 · 计算机科学 2021-02-23 Duc Quang Vu , Ngan T. H. Le , Jia-Ching Wang

Video summarization has unprecedented importance to help us digest, browse, and search today's ever-growing video collections. We propose a novel subset selection technique that leverages supervision in the form of human-created summaries…

计算机视觉与模式识别 · 计算机科学 2016-05-02 Ke Zhang , Wei-Lun Chao , Fei Sha , Kristen Grauman

We introduce a novel self-supervised contrastive learning method to learn representations from unlabelled videos. Existing approaches ignore the specifics of input distortions, e.g., by learning invariance to temporal transformations.…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Simon Jenni , Hailin Jin

Video summarization aims at choosing parts of a video that narrate a story as close as possible to the original one. Most of the existing video summarization approaches focus on hand-crafted labels. As the number of videos grows…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Ivan Sosnovik , Artem Moskalev , Cees Kaandorp , Arnold Smeulders

Self-supervision has emerged as a propitious method for visual representation learning after the recent paradigm shift from handcrafted pretext tasks to instance-similarity based approaches. Most state-of-the-art methods enforce similarity…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Sravanti Addepalli , Kaushal Bhogale , Priyam Dey , R. Venkatesh Babu

Unsupervised visual representation learning remains a largely unsolved problem in computer vision research. Among a big body of recently proposed approaches for unsupervised learning of visual representations, a class of self-supervised…

计算机视觉与模式识别 · 计算机科学 2019-01-28 Alexander Kolesnikov , Xiaohua Zhai , Lucas Beyer

We propose a novel supervised learning technique for summarizing videos by automatically selecting keyframes or key subshots. Casting the problem as a structured prediction problem on sequential data, our main idea is to use Long Short-Term…

计算机视觉与模式识别 · 计算机科学 2016-08-01 Ke Zhang , Wei-Lun Chao , Fei Sha , Kristen Grauman

In the Internet, ubiquitous presence of redundant, unedited, raw videos has made video summarization an important problem. Traditional methods of video summarization employ a heuristic set of hand-crafted features, which in many cases fail…

计算机视觉与模式识别 · 计算机科学 2017-08-24 Mohaiminul Al Nahian , A. S. M. Iftekhar , Mohammad Tariqul Islam , S. M. Mahbubur Rahman , Dimitrios Hatzinakos

Self supervised representation learning has recently attracted a lot of research interest for both the audio and visual modalities. However, most works typically focus on a particular modality or feature alone and there has been very…

音频与语音处理 · 电气工程与系统科学 2020-02-21 Abhinav Shukla , Konstantinos Vougioukas , Pingchuan Ma , Stavros Petridis , Maja Pantic

With the broad growth of video capturing devices and applications on the web, it is more demanding to provide desired video content for users efficiently. Video summarization facilitates quickly grasping video content by creating a compact…

计算机视觉与模式识别 · 计算机科学 2022-10-24 Mayu Otani , Yale Song , Yang Wang

Traditional video summarization methods generate fixed video representations regardless of user interest. Therefore such methods limit users' expectations in content search and exploration scenarios. Multi-modal video summarization is one…

计算机视觉与模式识别 · 计算机科学 2021-04-27 Jia-Hong Huang , Luka Murn , Marta Mrak , Marcel Worring

Self-supervised learning is an effective way for label-free model pre-training, especially in the video domain where labeling is expensive. Existing self-supervised works in the video domain use varying experimental setups to demonstrate…

计算机视觉与模式识别 · 计算机科学 2023-11-22 Akash Kumar , Ashlesha Kumar , Vibhav Vineet , Yogesh Singh Rawat

The proliferation of video content on platforms like YouTube and Vimeo presents significant challenges in efficiently locating relevant information. Automatic video summarization aims to address this by extracting and presenting key content…

计算机视觉与模式识别 · 计算机科学 2024-08-28 Jia-Hong Huang

This paper proposes a novel pretext task to address the self-supervised video representation learning problem. Specifically, given an unlabeled video clip, we compute a series of spatio-temporal statistical summaries, such as the spatial…

计算机视觉与模式识别 · 计算机科学 2021-02-01 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Wei Liu , Yun-hui Liu

Video summarization is among challenging tasks in computer vision, which aims at identifying highlight frames or shots over a lengthy video input. In this paper, we propose an novel attention-based framework for video summarization with…

计算机视觉与模式识别 · 计算机科学 2020-06-04 Yen-Ting Liu , Yu-Jhe Li , Yu-Chiang Frank Wang

Previous work on action representation learning focused on global representations for short video clips. In contrast, many practical applications, such as video alignment, strongly demand learning the intensive representation of long…

计算机视觉与模式识别 · 计算机科学 2023-03-03 Minghao Chen , Renbo Tu , Chenxi Huang , Yuqi Lin , Boxi Wu , Deng Cai

Most existing video summarisation methods are based on either supervised or unsupervised learning. In this paper, we propose a reinforcement learning-based weakly supervised method that exploits easy-to-obtain, video-level category labels…

计算机视觉与模式识别 · 计算机科学 2018-09-05 Kaiyang Zhou , Tao Xiang , Andrea Cavallaro

Video is one of the robust sources of information and the consumption of online and offline videos has reached an unprecedented level in the last few years. A fundamental challenge of extracting information from videos is a viewer has to go…

信息检索 · 计算机科学 2020-11-17 Shruti Jadon , Mahmood Jasim

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

计算机视觉与模式识别 · 计算机科学 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

We propose a self-supervised visual learning method by predicting the variable playback speeds of a video. Without semantic labels, we learn the spatio-temporal visual representation of the video by leveraging the variations in the visual…

计算机视觉与模式识别 · 计算机科学 2021-06-02 Hyeon Cho , Taehoon Kim , Hyung Jin Chang , Wonjun Hwang