English

Compression as Adaptation: Implicit Visual Representation with Diffusion Foundation Models

Machine Learning 2026-05-25 v3 Computer Vision and Pattern Recognition

Abstract

Modern visual generative models acquire rich visual knowledge through large-scale training, yet existing visual representations (such as pixels, latents, or tokens) remain external to the model and cannot directly exploit this knowledge for compact storage or reuse. In this work, we introduce a new visual representation framework that encodes a signal as a function, which is parametrized by low-rank adaptations attached to a frozen visual generative model. Such implicit representations of visual signals, \textit{e.g.}, an 81-frame video, can further be hashed into a single compact vector, achieving strong perceptual video compression at extremely low bitrates. Beyond basic compression, the functional nature of this representation enables inference-time scaling and control, allowing additional refinement on the compression performance. More broadly, as the implicit representations directly act as a function of the generation process, this suggests a unified framework bridging visual compression and generation.

Keywords

Cite

@article{arxiv.2603.07615,
  title  = {Compression as Adaptation: Implicit Visual Representation with Diffusion Foundation Models},
  author = {Zongyu Guo and Jiajun He and Zhaoyang Jia and Xiaoyi Zhang and Jiahao Li and Xiao Li and Bin Li and José Miguel Hernández-Lobato and Yan Lu},
  journal= {arXiv preprint arXiv:2603.07615},
  year   = {2026}
}

Comments

ICML 2026