English

Parallax to Align Them All: An OmniParallax Attention Mechanism for Distributed Multi-View Image Compression

Computer Vision and Pattern Recognition 2026-03-05 v1

Abstract

Multi-view image compression (MIC) aims to achieve high compression efficiency by exploiting inter-image correlations, playing a crucial role in 3D applications. As a subfield of MIC, distributed multi-view image compression (DMIC) offers performance comparable to MIC while eliminating the need for inter-view information at the encoder side. However, existing methods in DMIC typically treat all images equally, overlooking the varying degrees of correlation between different views during decoding, which leads to suboptimal coding performance. To address this limitation, we propose a novel OmniParallax Attention Mechanism\textbf{OmniParallax Attention Mechanism} (OPAM), which is a general mechanism for explicitly modeling correlations and aligned features between arbitrary pairs of information sources. Building upon OPAM, we propose a Parallax Multi Information Fusion Module (PMIFM) to adaptively integrate information from different sources. PMIFM is incorporated into both the joint decoder and the entropy model to construct our end-to-end DMIC framework, ParaHydra\textbf{ParaHydra}. Extensive experiments demonstrate that ParaHydra\textbf{ParaHydra} is the first DMIC method\textbf{the first DMIC method} to significantly surpass state-of-the-art MIC codecs, while maintaining low computational overhead. Performance gains become more pronounced as the number of input views increases. Compared with LDMIC, ParaHydra\textbf{ParaHydra} achieves bitrate savings of \textbf{19.72%} on WildTrack(3) and up to \textbf{24.18%} on WildTrack(6), while significantly improving coding efficiency (as much as 65×\textbf{65}\times in decoding and 34×\textbf{34}\times in encoding).

Keywords

Cite

@article{arxiv.2603.03615,
  title  = {Parallax to Align Them All: An OmniParallax Attention Mechanism for Distributed Multi-View Image Compression},
  author = {Haotian Zhang and Feiyue Long and Yixin Yu and Jian Xue and Haocheng Tang and Tongda Xu and Zhenning Shi and Yan Wang and Siwei Ma and Jiaqi Zhang},
  journal= {arXiv preprint arXiv:2603.03615},
  year   = {2026}
}

Comments

Accepted by CVPR 2026