English

PIT-QMM: A Large Multimodal Model For No-Reference Point Cloud Quality Assessment

Computer Vision and Pattern Recognition 2025-10-10 v1

Abstract

Large Multimodal Models (LMMs) have recently enabled considerable advances in the realm of image and video quality assessment, but this progress has yet to be fully explored in the domain of 3D assets. We are interested in using these models to conduct No-Reference Point Cloud Quality Assessment (NR-PCQA), where the aim is to automatically evaluate the perceptual quality of a point cloud in absence of a reference. We begin with the observation that different modalities of data - text descriptions, 2D projections, and 3D point cloud views - provide complementary information about point cloud quality. We then construct PIT-QMM, a novel LMM for NR-PCQA that is capable of consuming text, images and point clouds end-to-end to predict quality scores. Extensive experimentation shows that our proposed method outperforms the state-of-the-art by significant margins on popular benchmarks with fewer training iterations. We also demonstrate that our framework enables distortion localization and identification, which paves a new way forward for model explainability and interactivity. Code and datasets are available at https://www.github.com/shngt/pit-qmm.

Keywords

Cite

@article{arxiv.2510.07636,
  title  = {PIT-QMM: A Large Multimodal Model For No-Reference Point Cloud Quality Assessment},
  author = {Shashank Gupta and Gregoire Phillips and Alan C. Bovik},
  journal= {arXiv preprint arXiv:2510.07636},
  year   = {2025}
}

Comments

Oral presentation at ICIP 2025

R2 v1 2026-07-01T06:25:28.434Z