English

ReTiDe: Real-Time Denoising for Energy-Efficient Motion Picture Processing with FPGAs

Image and Video Processing 2025-10-07 v1 Artificial Intelligence

Abstract

Denoising is a core operation in modern video pipelines. In codecs, in-loop filters suppress sensor noise and quantisation artefacts to improve rate-distortion performance; in cinema post-production, denoisers are used for restoration, grain management, and plate clean-up. However, state-of-the-art deep denoisers are computationally intensive and, at scale, are typically deployed on GPUs, incurring high power and cost for real-time, high-resolution streams. This paper presents Real-Time Denoise (ReTiDe), a hardware-accelerated denoising system that serves inference on data-centre Field Programmable Gate Arrays (FPGAs). A compact convolutional model is quantised (post-training quantisation plus quantisation-aware fine-tuning) to INT8 and compiled for AMD Deep Learning Processor Unit (DPU)-based FPGAs. A client-server integration offloads computation from the host CPU/GPU to a networked FPGA service, while remaining callable from existing workflows, e.g., NUKE, without disrupting artist tooling. On representative benchmarks, ReTiDe delivers 37.71×\times Giga Operations Per Second (GOPS) throughput and 5.29×\times higher energy efficiency than prior FPGA denoising accelerators, with negligible degradation in Peak Signal-to-Noise Ratio (PSNR)/Structural Similarity Index (SSIM). These results indicate that specialised accelerators can provide practical, scalable denoising for both encoding pipelines and post-production, reducing energy per frame without sacrificing quality or workflow compatibility. Code is available at https://github.com/RCSL-TCD/ReTiDe.

Keywords

Cite

@article{arxiv.2510.03812,
  title  = {ReTiDe: Real-Time Denoising for Energy-Efficient Motion Picture Processing with FPGAs},
  author = {Changhong Li and Clément Bled and Rosa Fernandez and Shreejith Shanker},
  journal= {arXiv preprint arXiv:2510.03812},
  year   = {2025}
}

Comments

This paper has been accepted by the 22nd ACM SIGGRAPH European Conference on Visual Media Production (CVMP 2025)