English

RenderFormer++: Scalable and Physically Grounded Feed-Forward Neural Rendering

Graphics 2026-06-29 v1 Computer Vision and Pattern Recognition Machine Learning

Abstract

We present RenderFormer++, a scalable and physically grounded feed-forward neural rendering framework for global illumination in mesh scenes. Existing Transformer-based neural rendering methods such as RenderFormer achieve promising cross-scene generalization, but suffer from limited physical consistency and poor scalability due to the quadratic attention complexity of triangle-level tokenization. To address these issues, we introduce Physics-Informed Transport Guidance (PITG), which embeds rendering-equation inductive biases into the attention mechanism and enforces transport consistency loss, enabling physically consistent light transport modeling. We further propose Hierarchical Object-Centric Tokenization (HOCT), which aggregates triangle-level features into compact object-level tokens via cross-attention with learnable queries, substantially reducing computational and memory costs while preserving geometric and radiometric information. Extensive experiments demonstrate that RenderFormer++ achieves scalable, stable, and generalizable feed-forward global illumination rendering across complex large-scale scenes with improved physical accuracy and efficiency over prior neural rendering methods.

Cite

@article{arxiv.2606.30380,
  title  = {RenderFormer++: Scalable and Physically Grounded Feed-Forward Neural Rendering},
  author = {Huangsheng Du and Haoran Zhu and Youcheng Cai and Jinyang Meng and Ligang Liu},
  journal= {arXiv preprint arXiv:2606.30380},
  year   = {2026}
}