English

Modular Neural Image Signal Processing

Computer Vision and Pattern Recognition 2026-03-10 v3

Abstract

This paper presents a modular neural image signal processing (ISP) framework that processes raw inputs and renders high-quality display-referred images. Unlike prior neural ISP designs, our method introduces a high degree of modularity, providing full control over multiple intermediate stages of the rendering process.~This modular design not only achieves high rendering accuracy but also improves scalability, debuggability, generalization to unseen cameras, and flexibility to match different user-preference styles. To demonstrate the advantages of this design, we built a user-interactive photo-editing tool that leverages our neural ISP to support diverse editing operations and picture styles. The tool is carefully engineered to take advantage of the high-quality rendering of our neural ISP and to enable unlimited post-editable re-rendering. Our method is a fully learning-based framework with variants of different capacities, all of moderate size (ranging from ~0.5 M to ~3.9 M parameters for the entire pipeline), and consistently delivers competitive qualitative and quantitative results across multiple test sets. Watch the supplemental video at: https://youtu.be/ByhQjQSjxVM

Keywords

Cite

@article{arxiv.2512.08564,
  title  = {Modular Neural Image Signal Processing},
  author = {Mahmoud Afifi and Zhongling Wang and Ran Zhang and Michael S. Brown},
  journal= {arXiv preprint arXiv:2512.08564},
  year   = {2026}
}
R2 v1 2026-07-01T08:16:54.210Z