English

AgroNVILA: Perception-Reasoning Decoupling for Multi-view Agricultural Multimodal Large Language Models

Computer Vision and Pattern Recognition 2026-03-17 v1 Artificial Intelligence

Abstract

Agricultural multimodal reasoning requires robust spatial understanding across varying scales, from ground-level close-ups to top-down UAV and satellite imagery. Existing Multi-modal Large Language Models (MLLMs) suffer from a significant "terrestrial-centric" bias, causing scale confusion and logic drift during complex agricultural planning. To address this, we introduce the first large-scale AgroOmni (288K), a multi-view training corpus designed to capture diverse spatial topologies and scales in modern precision agriculture. Built on this dataset, we propose AgroNVILA, an MLLM that utilizes a novel Perception-Reasoning Decoupling (PRD) architecture. On the perception side, we incorporate a View-Conditioned Meta-Net (VCMN), which injects macroscopic spatial context into visual tokens, resolving scale ambiguities with minimal computational overhead. On the reasoning side, Agriculture-aware Relative Policy Optimization (ARPO) leverages reinforcement learning to align the model's decision-making with expert agricultural logic, preventing statistical shortcuts. Extensive experiments demonstrate that AgroNVILA outperforms state-of-the-art MLLMs, achieving significant improvements (+15.18%) in multi-altitude agricultural reasoning, reflecting its robust capability for holistic agricultural spatial planning.

Keywords

Cite

@article{arxiv.2603.14342,
  title  = {AgroNVILA: Perception-Reasoning Decoupling for Multi-view Agricultural Multimodal Large Language Models},
  author = {Jiarui Zhang and Junqi Hu and Zurong Mai and Yuhang Chen and Shuohong Lou and Henglian Huang and Lingyuan Zhao and Jianxi Huang and Yutong Lu and Haohuan Fu and Juepeng Zheng},
  journal= {arXiv preprint arXiv:2603.14342},
  year   = {2026}
}
R2 v1 2026-07-01T11:20:40.472Z