English

From Attenuation to Attention: Variational Information Flow Manipulation for Fine-Grained Visual Perception

Computer Vision and Pattern Recognition 2026-04-15 v1

Abstract

While Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in general visual understanding, they frequently falter in fine-grained perception tasks that require identifying tiny objects or discerning subtle visual relationships. We attribute this limitation to Visual Attenuation: a phenomenon where sparse fine-grained visual signals are prematurely suppressed or diluted by dominant textual tokens during network propagation, resulting in a "loss of focus" during the deep-level decision-making process. Existing input-centric solutions fail to fundamentally reverse this intrinsic mechanism of information loss. To address this challenge, we propose the Variational Information Flow (VIF) framework. Adopting a probabilistic perspective, VIF leverages a Conditional Variational Autoencoder (CVAE) to model the visual saliency relevant to the question-answer pair as a latent distribution. As a plug-and-play module, VIF can be integrated into existing architectures. Extensive evaluations across diverse benchmarks, covering General VQA, fine-grained perception, and visual grounding, demonstrate that VIF yields competitive improvements over previous methods, validating its effectiveness in enhancing the fine-grained perception of MLLMs.

Keywords

Cite

@article{arxiv.2604.12508,
  title  = {From Attenuation to Attention: Variational Information Flow Manipulation for Fine-Grained Visual Perception},
  author = {Jilong Zhu and Yang Feng},
  journal= {arXiv preprint arXiv:2604.12508},
  year   = {2026}
}
R2 v1 2026-07-01T12:08:24.508Z