English
Related papers

Related papers: Contrastive learning-based video quality assessmen…

200 papers

Recently, Users Generated Content (UGC) videos becomes ubiquitous in our daily lives. However, due to the limitations of photographic equipments and techniques, UGC videos often contain various degradations, in which one of the most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Yunlong Dong , Xiaohong Liu , Yixuan Gao , Xunchu Zhou , Tao Tan , Guangtao Zhai

In the mobile communication field, some of the video applications boosted the interest of robust methods for video quality assessment. Out of all existing methods, We Preferred, No Reference Video Quality Assessment is the one which is most…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Amitesh Kumar Singam , Benny Lövström , Wlodek J. Kulesza

The attention mechanism is blooming in computer vision nowadays. However, its application to video quality assessment (VQA) has not been reported. Evaluating the quality of in-the-wild videos is challenging due to the unknown of pristine…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Fengchuang Xing , Yuan-Gen Wang , Hanpin Wang , Leida Li , Guopu Zhu

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

Compressed video quality enhancement (CVQE) is crucial for improving user experience with lossy video codecs like H.264/AVC, H.265/HEVC, and H.266/VVC. While deep learning based CVQE has driven significant progress, existing surveys still…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Xiem HoangVan , Dang BuiDinh , Sang NguyenQuang , Wen-Hsiao Peng

In this paper, we focus on the self-supervised learning of visual correspondence using unlabeled videos in the wild. Our method simultaneously considers intra- and inter-video representation associations for reliable correspondence…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Ning Wang , Wengang Zhou , Houqiang Li

Summarizing a video requires a diverse understanding of the video, ranging from recognizing scenes to evaluating how much each frame is essential enough to be selected as a summary. Self-supervised learning (SSL) is acknowledged for its…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Minho Shim , Taeoh Kim , Jinhyung Kim , Dongyoon Wee

Advances in deep learning are re-defining how visual data is processed and understand by the machines. Vision Transformers (ViTs) have recently demonstrated prominent performance in computer vision related tasks. However, their performance…

The objective of this paper is visual-only self-supervised video representation learning. We make the following contributions: (i) we investigate the benefit of adding semantic-class positives to instance-based Info Noise Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Tengda Han , Weidi Xie , Andrew Zisserman

Video Quality Assessment (VQA) aims to simulate the process of perceiving video quality by the human visual system (HVS). The judgments made by HVS are always influenced by human subjective feelings. However, most of the current VQA…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Yachun Mi , Yu Li , Yan Shu , Chen Hui , Puchao Zhou , Shaohui Liu

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

Video summarization aims at choosing parts of a video that narrate a story as close as possible to the original one. Most of the existing video summarization approaches focus on hand-crafted labels. As the number of videos grows…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Ivan Sosnovik , Artem Moskalev , Cees Kaandorp , Arnold Smeulders

We propose to perform video question answering (VideoQA) in a Contrastive manner via a Video Graph Transformer model (CoVGT). CoVGT's uniqueness and superiority are three-fold: 1) It proposes a dynamic graph transformer module which encodes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Junbin Xiao , Pan Zhou , Angela Yao , Yicong Li , Richang Hong , Shuicheng Yan , Tat-Seng Chua

Video action recognition is a challenging but important task for understanding and discovering what the video does. However, acquiring annotations for a video is costly, and semi-supervised learning (SSL) has been studied to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Seokun Kang , Taehwan Kim

Recent advancements in language-model-based video understanding have been progressing at a remarkable pace, spurred by the introduction of Large Language Models (LLMs). However, the focus of prior research has been predominantly on devising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Yizhou Wang , Ruiyi Zhang , Haoliang Wang , Uttaran Bhattacharya , Yun Fu , Gang Wu

Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art contrastive learning…

Quality assessment of videos is crucial for many computer graphics applications, including video games, virtual reality, and augmented reality, where visual performance has a significant impact on user experience. When test videos cannot be…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Sipeng Yang , Jiayu Ji , Qingchuan Zhu , Zhiyao Yang , Xiaogang Jin

A long-term video, such as a movie or TV show, is composed of various scenes, each of which represents a series of shots sharing the same semantic story. Spotting the correct scene boundary from the long-term video is a challenging task,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Haoqian Wu , Keyu Chen , Yanan Luo , Ruizhi Qiao , Bo Ren , Haozhe Liu , Weicheng Xie , Linlin Shen

Video-quality measurement is a critical task in video processing. Nowadays, many implementations of new encoding standards - such as AV1, VVC, and LCEVC - use deep-learning-based decoding algorithms with perceptual metrics that serve as…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Anastasia Antsiferova , Sergey Lavrushkin , Maksim Smirnov , Alexander Gushchin , Dmitriy Vatolin , Dmitriy Kulikov

Introduction: Video Quality Assessment (VQA) is one of the important areas of study in this modern era, where video is a crucial component of communication with applications in every field. Rapid technology developments in mobile technology…

Image and Video Processing · Electrical Eng. & Systems 2024-04-10 Anantha Prabhu , David Pratap , Narayana Darapeni , Anwesh P R