English

MegaSR: Mining Customized Semantics and Expressive Guidance for Real-World Image Super-Resolution

Computer Vision and Pattern Recognition 2025-12-03 v2

Abstract

Text-to-image (T2I) models have ushered in a new era of real-world image super-resolution (Real-ISR) due to their rich internal implicit knowledge for multimodal learning. Although bringing high-level semantic priors and dense pixel guidance have led to advances in reconstruction, we identified several critical phenomena by analyzing the behavior of existing T2I-based Real-ISR methods: (1) Fine detail deficiency, which ultimately leads to incorrect reconstruction in local regions. (2) Block-wise semantic inconsistency, which results in distracted semantic interpretations across U-Net blocks. (3) Edge ambiguity, which causes noticeable structural degradation. Building upon these observations, we first introduce MegaSR, which enhances the T2I-based Real-ISR models with fine-grained customized semantics and expressive guidance to unlock semantically rich and structurally consistent reconstruction. Then, we propose the Customized Semantics Module (CSM) to supplement fine-grained semantics from the image modality and regulate the semantic fusion between multi-level knowledge to realize customization for different U-Net blocks. Besides the semantic adaptation, we identify expressive multimodal signals through pair-wise comparisons and introduce the Multimodal Signal Fusion Module (MSFM) to aggregate them for structurally consistent reconstruction. Extensive experiments on real-world and synthetic datasets demonstrate the superiority of the method. Notably, it not only achieves state-of-the-art performance on quality-driven metrics but also remains competitive on fidelity-focused metrics, striking a balance between perceptual realism and faithful content reconstruction.

Keywords

Cite

@article{arxiv.2503.08096,
  title  = {MegaSR: Mining Customized Semantics and Expressive Guidance for Real-World Image Super-Resolution},
  author = {Xinrui Li and Jinrong Zhang and Jianlong Wu and Chong Chen and Liqiang Nie and Zhouchen Lin},
  journal= {arXiv preprint arXiv:2503.08096},
  year   = {2025}
}
R2 v1 2026-06-28T22:15:19.054Z