English

SCENE: Semantic-aware Codec Enhancement with Neural Embeddings

Image and Video Processing 2026-02-02 v1 Computer Vision and Pattern Recognition Machine Learning Multimedia

Abstract

Compression artifacts from standard video codecs often degrade perceptual quality. We propose a lightweight, semantic-aware pre-processing framework that enhances perceptual fidelity by selectively addressing these distortions. Our method integrates semantic embeddings from a vision-language model into an efficient convolutional architecture, prioritizing the preservation of perceptually significant structures. The model is trained end-to-end with a differentiable codec proxy, enabling it to mitigate artifacts from various standard codecs without modifying the existing video pipeline. During inference, the codec proxy is discarded, and SCENE operates as a standalone pre-processor, enabling real-time performance. Experiments on high-resolution benchmarks show improved performance over baselines in both objective (MS-SSIM) and perceptual (VMAF) metrics, with notable gains in preserving detailed textures within salient regions. Our results show that semantic-guided, codec-aware pre-processing is an effective approach for enhancing compressed video streams.

Keywords

Cite

@article{arxiv.2601.22189,
  title  = {SCENE: Semantic-aware Codec Enhancement with Neural Embeddings},
  author = {Han-Yu Lin and Li-Wei Chen and Hung-Shin Lee},
  journal= {arXiv preprint arXiv:2601.22189},
  year   = {2026}
}

Comments

Accepted to ICASSP 2026

R2 v1 2026-07-01T09:26:30.954Z