English

Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks

Computer Vision and Pattern Recognition 2025-12-03 v1

Abstract

When applied sequentially to video, frame-based networks often exhibit temporal inconsistency - for example, outputs that flicker between frames. This problem is amplified when the network inputs contain time-varying corruptions. In this work, we introduce a general approach for adapting frame-based models for stable and robust inference on video. We describe a class of stability adapters that can be inserted into virtually any architecture and a resource-efficient training process that can be performed with a frozen base network. We introduce a unified conceptual framework for describing temporal stability and corruption robustness, centered on a proposed accuracy-stability-robustness loss. By analyzing the theoretical properties of this loss, we identify the conditions where it produces well-behaved stabilizer training. Our experiments validate our approach on several vision tasks including denoising (NAFNet), image enhancement (HDRNet), monocular depth (Depth Anything v2), and semantic segmentation (DeepLabv3+). Our method improves temporal stability and robustness against a range of image corruptions (including compression artifacts, noise, and adverse weather), while preserving or improving the quality of predictions.

Keywords

Cite

@article{arxiv.2512.03014,
  title  = {Instant Video Models: Universal Adapters for Stabilizing Image-Based Networks},
  author = {Matthew Dutson and Nathan Labiosa and Yin Li and Mohit Gupta},
  journal= {arXiv preprint arXiv:2512.03014},
  year   = {2025}
}

Comments

NeurIPS 2025

R2 v1 2026-07-01T08:06:08.830Z