English

DRCP: Diffusion on Reinforced Cooperative Perception for Perceiving Beyond Limits

Robotics 2025-09-30 v1 Computer Vision and Pattern Recognition Image and Video Processing

Abstract

Cooperative perception enabled by Vehicle-to-Everything communication has shown great promise in enhancing situational awareness for autonomous vehicles and other mobile robotic platforms. Despite recent advances in perception backbones and multi-agent fusion, real-world deployments remain challenged by hard detection cases, exemplified by partial detections and noise accumulation which limit downstream detection accuracy. This work presents Diffusion on Reinforced Cooperative Perception (DRCP), a real-time deployable framework designed to address aforementioned issues in dynamic driving environments. DRCP integrates two key components: (1) Precise-Pyramid-Cross-Modality-Cross-Agent, a cross-modal cooperative perception module that leverages camera-intrinsic-aware angular partitioning for attention-based fusion and adaptive convolution to better exploit external features; and (2) Mask-Diffusion-Mask-Aggregation, a novel lightweight diffusion-based refinement module that encourages robustness against feature perturbations and aligns bird's-eye-view features closer to the task-optimal manifold. The proposed system achieves real-time performance on mobile platforms while significantly improving robustness under challenging conditions. Code will be released in late 2025.

Keywords

Cite

@article{arxiv.2509.24903,
  title  = {DRCP: Diffusion on Reinforced Cooperative Perception for Perceiving Beyond Limits},
  author = {Lantao Li and Kang Yang and Rui Song and Chen Sun},
  journal= {arXiv preprint arXiv:2509.24903},
  year   = {2025}
}
R2 v1 2026-07-01T06:04:48.080Z