English

MegaPortrait: Revisiting Diffusion Control for High-fidelity Portrait Generation

Computer Vision and Pattern Recognition 2024-11-08 v1

Abstract

We propose MegaPortrait. It's an innovative system for creating personalized portrait images in computer vision. It has three modules: Identity Net, Shading Net, and Harmonization Net. Identity Net generates learned identity using a customized model fine-tuned with source images. Shading Net re-renders portraits using extracted representations. Harmonization Net fuses pasted faces and the reference image's body for coherent results. Our approach with off-the-shelf Controlnets is better than state-of-the-art AI portrait products in identity preservation and image fidelity. MegaPortrait has a simple but effective design and we compare it with other methods and products to show its superiority.

Keywords

Cite

@article{arxiv.2411.04357,
  title  = {MegaPortrait: Revisiting Diffusion Control for High-fidelity Portrait Generation},
  author = {Han Yang and Sotiris Anagnostidis and Enis Simsar and Thomas Hofmann},
  journal= {arXiv preprint arXiv:2411.04357},
  year   = {2024}
}

Comments

Technical Report

R2 v1 2026-06-28T19:50:50.662Z