English

FreqOrtho-SR: Frequency-Guided Orthogonal Expert Learning for Real-World Image Super-Resolution

Computer Vision and Pattern Recognition 2026-06-27 v1

Abstract

Diffusion prior-based methods have shown impressive results in real-world image super-resolution (ISR), yet two key challenges persist: balancing pixel-level fidelity with semantic quality, and adapting to diverse degradations. Existing dual-branch approaches freeze the pixel module during semantic training, but the semantic branch can still expand capacity within the pixel subspace, precluding genuine perceptual improvement. Moreover, using a single static adapter cannot generalize across heterogeneous real-world corruptions. To address both issues, we propose FreqOrtho-SR, which comprises: Freq\textbf{Freq}uency-guided Mixture of LoRA Experts (FreqMoE), it routes inputs to specialized experts via a non-parametric FFT-based degradation-feature extractor that encodes frequency-domain signatures, enabling stable and interpretable specialization across corruption types; and Ortho\textbf{Ortho}gonal Gradient Projection (OGP), which reframes the dual-objective optimization as a subspace-constrained problem: by extracting the pixel-fidelity subspace via SVD on combined expert weight deltas and projecting semantic gradients onto its null space, OGP guarantees orthogonality between the two objectives, enabling genuinely complementary learning without mutual interference. Experiments show that FreqOrtho-SR achieves competitive overall performance and a strong fidelity-perception trade-off across multiple benchmarks with efficient single-step inference. The source code of our method can be found at \href\href{https://github.com/sonhm3029/FreqOrtho-SR}{\texttt{sonhm3029/FreqOrtho-SR}}.

Keywords

Cite

@article{arxiv.2606.28745,
  title  = {FreqOrtho-SR: Frequency-Guided Orthogonal Expert Learning for Real-World Image Super-Resolution},
  author = {Minh Son Hoang and Dinh Phu Tran and Quyen Nguyen Duc and Dam Hoang Phuong and Daeyoung Kim},
  journal= {arXiv preprint arXiv:2606.28745},
  year   = {2026}
}

Comments

Accepted at ECCV 2026