English

DRIFT: Deep Restoration, ISP Fusion, and Tone-mapping

Image and Video Processing 2026-04-14 v2 Computer Vision and Pattern Recognition

Abstract

Smartphone cameras have gained immense popularity with the adoption of high-resolution and high-dynamic range imaging. As a result, high-performance camera Image Signal Processors (ISPs) are crucial in generating high-quality images for the end user while keeping computational costs low. In this paper, we propose DRIFT (Deep Restoration, ISP Fusion, and Tone-mapping): an efficient AI mobile camera pipeline that generates high quality RGB images from hand-held raw captures. The first stage of DRIFT is a Multi-Frame Processing (MFP) network that is trained using a adversarial perceptual loss to perform multi-frame alignment, denoising, demosaicing, and super-resolution. Then, the output of DRIFT-MFP is processed by a novel deep-learning based tone-mapping (DRIFT-TM) solution that allows for tone tunability, ensures tone-consistency with a reference pipeline, and can be run efficiently for high-resolution images on a mobile device. We show qualitative and quantitative comparisons against state-of-the-art MFP and tone-mapping methods to demonstrate the effectiveness of our approach.

Keywords

Cite

@article{arxiv.2604.03402,
  title  = {DRIFT: Deep Restoration, ISP Fusion, and Tone-mapping},
  author = {Soumendu Majee and Joshua Peter Ebenezer and Abhinau K. Venkataramanan and Weidi Liu and Thilo Balke and Zeeshan Nadir and Sreenithy Chandran and Seok-Jun Lee and Hamid Rahim Sheikh},
  journal= {arXiv preprint arXiv:2604.03402},
  year   = {2026}
}

Comments

Proceedings of CVPR 2026

R2 v1 2026-07-01T11:53:24.928Z