English

Lightweight Optimal-Transport Harmonization on Edge Devices

Computer Vision and Pattern Recognition 2025-11-18 v1 Artificial Intelligence Graphics

Abstract

Color harmonization adjusts the colors of an inserted object so that it perceptually matches the surrounding image, resulting in a seamless composite. The harmonization problem naturally arises in augmented reality (AR), yet harmonization algorithms are not currently integrated into AR pipelines because real-time solutions are scarce. In this work, we address color harmonization for AR by proposing a lightweight approach that supports on-device inference. For this, we leverage classical optimal transport theory by training a compact encoder to predict the Monge-Kantorovich transport map. We benchmark our MKL-Harmonizer algorithm against state-of-the-art methods and demonstrate that for real composite AR images our method achieves the best aggregated score. We release our dedicated AR dataset of composite images with pixel-accurate masks and data-gathering toolkit to support further data acquisition by researchers.

Keywords

Cite

@article{arxiv.2511.12785,
  title  = {Lightweight Optimal-Transport Harmonization on Edge Devices},
  author = {Maria Larchenko and Dmitry Guskov and Alexander Lobashev and Georgy Derevyanko},
  journal= {arXiv preprint arXiv:2511.12785},
  year   = {2025}
}

Comments

AAAI 2026, Oral

R2 v1 2026-07-01T07:40:07.984Z