English

Exploring Simple Siamese Network for High-Resolution Video Quality Assessment

Computer Vision and Pattern Recognition 2025-03-05 v1

Abstract

In the research of video quality assessment (VQA), two-branch network has emerged as a promising solution. It decouples VQA with separate technical and aesthetic branches to measure the perception of low-level distortions and high-level semantics respectively. However, we argue that while technical and aesthetic perspectives are complementary, the technical perspective itself should be measured in semantic-aware manner. We hypothesize that existing technical branch struggles to perceive the semantics of high-resolution videos, as it is trained on local mini-patches sampled from videos. This issue can be hidden by apparently good results on low-resolution videos, but indeed becomes critical for high-resolution VQA. This work introduces SiamVQA, a simple but effective Siamese network for highre-solution VQA. SiamVQA shares weights between technical and aesthetic branches, enhancing the semantic perception ability of technical branch to facilitate technical-quality representation learning. Furthermore, it integrates a dual cross-attention layer for fusing technical and aesthetic features. SiamVQA achieves state-of-the-art accuracy on high-resolution benchmarks, and competitive results on lower-resolution benchmarks. Codes will be available at: https://github.com/srcn-ivl/SiamVQA

Keywords

Cite

@article{arxiv.2503.02330,
  title  = {Exploring Simple Siamese Network for High-Resolution Video Quality Assessment},
  author = {Guotao Shen and Ziheng Yan and Xin Jin and Longhai Wu and Jie Chen and Ilhyun Cho and Cheul-Hee Hahm},
  journal= {arXiv preprint arXiv:2503.02330},
  year   = {2025}
}

Comments

Accepted by ICASSP 2025

R2 v1 2026-06-28T22:05:53.616Z