English

iiANET: Inception Inspired Attention Hybrid Network for efficient Long-Range Dependency

Computer Vision and Pattern Recognition 2026-03-31 v3

Abstract

The recent emergence of hybrid models has introduced a transformative approach to computer vision, gradually moving beyond conventional convolutional neural networks and vision transformers. However, efficiently combining these two approaches to better capture long-range dependencies in complex images remains a challenge. In this paper, we present iiANET (Inception Inspired Attention Network), an efficient hybrid visual backbone designed to improve the modeling of long-range dependencies in complex visual recognition tasks. The core innovation of iiANET is the iiABlock, a unified building block that integrates a modified global r-MHSA (Multi-Head Self-Attention) and convolutional layers in parallel. This design enables iiABlock to simultaneously capture global context and local details, making it effective for extracting rich and diverse features. By efficiently fusing these complementary representations, iiABlock allows iiANET to achieve strong feature interaction while maintaining computational efficiency. Extensive qualitative and quantitative evaluations on some SOTA benchmarks demonstrate improved performance.

Keywords

Cite

@article{arxiv.2407.07603,
  title  = {iiANET: Inception Inspired Attention Hybrid Network for efficient Long-Range Dependency},
  author = {Haruna Yunusa and Adamu Lawan and Abdulganiyu Abdu Yusuf},
  journal= {arXiv preprint arXiv:2407.07603},
  year   = {2026}
}

Comments

17 pages, 7 figures. Published in Transactions on Machine Learning Research (TMLR). Available at https://openreview.net/pdf?id=HGSjlgFodQ

R2 v1 2026-06-28T17:35:37.485Z