English

Look Beyond Saliency: Low-Attention Guided Dual Encoding for Video Semantic Search

Computer Vision and Pattern Recognition 2026-05-08 v1

Abstract

Video semantic search in densely crowded scenes remains a challenging task due to visual encoders tendency to prioritize salient foreground regions while neglecting contextually important, background areas. We propose an Inverse Attention Embedding mechanism that explicitly captures and highlights these overlooked regions. By combining inverse attention embeddings with traditional visual embeddings, our method significantly enhances semantic retrieval performance without additional training. Initial experiments and ablation studies demonstrate promising improvements over existing approaches in recall for video semantic search in crowded environments.

Keywords

Cite

@article{arxiv.2605.06229,
  title  = {Look Beyond Saliency: Low-Attention Guided Dual Encoding for Video Semantic Search},
  author = {Faisal Aljehrai and Mohammed A. Alkhrashi and Alreem Almuhrij and Sarah Abuhimed and Noorh Aldossary and Abdullah Aldwyish and Raied Aljadaany and Huda Alamri and Muhammad Kamran J Khan},
  journal= {arXiv preprint arXiv:2605.06229},
  year   = {2026}
}
R2 v1 2026-07-01T12:55:00.916Z