English

Efficient Neural Network Encoding for 3D Color Lookup Tables

Computer Vision and Pattern Recognition 2024-12-23 v1 Artificial Intelligence Machine Learning Image and Video Processing

Abstract

3D color lookup tables (LUTs) enable precise color manipulation by mapping input RGB values to specific output RGB values. 3D LUTs are instrumental in various applications, including video editing, in-camera processing, photographic filters, computer graphics, and color processing for displays. While an individual LUT does not incur a high memory overhead, software and devices may need to store dozens to hundreds of LUTs that can take over 100 MB. This work aims to develop a neural network architecture that can encode hundreds of LUTs in a single compact representation. To this end, we propose a model with a memory footprint of less than 0.25 MB that can reconstruct 512 LUTs with only minor color distortion (ΔˉEM\bar{\Delta}E_M \leq 2.0) over the entire color gamut. We also show that our network can weight colors to provide further quality gains on natural image colors (ΔˉEM\bar{\Delta}{E}_M \leq 1.0). Finally, we show that minor modifications to the network architecture enable a bijective encoding that produces LUTs that are invertible, allowing for reverse color processing. Our code is available at https://github.com/vahidzee/ennelut.

Keywords

Cite

@article{arxiv.2412.15438,
  title  = {Efficient Neural Network Encoding for 3D Color Lookup Tables},
  author = {Vahid Zehtab and David B. Lindell and Marcus A. Brubaker and Michael S. Brown},
  journal= {arXiv preprint arXiv:2412.15438},
  year   = {2024}
}

Comments

14 pages, 13 figures; extended version; to appear in AAAI 2025

R2 v1 2026-06-28T20:43:09.880Z