English

Measure Anything: Real-time, Multi-stage Vision-based Dimensional Measurement using Segment Anything

Computer Vision and Pattern Recognition 2024-12-05 v1

Abstract

We present Measure Anything, a comprehensive vision-based framework for dimensional measurement of objects with circular cross-sections, leveraging the Segment Anything Model (SAM). Our approach estimates key geometric features -- including diameter, length, and volume -- for rod-like geometries with varying curvature and general objects with constant skeleton slope. The framework integrates segmentation, mask processing, skeleton construction, and 2D-3D transformation, packaged in a user-friendly interface. We validate our framework by estimating the diameters of Canola stems -- collected from agricultural fields in North Dakota -- which are thin and non-uniform, posing challenges for existing methods. Measuring its diameters is critical, as it is a phenotypic traits that correlates with the health and yield of Canola crops. This application also exemplifies the potential of Measure Anything, where integrating intelligent models -- such as keypoint detection -- extends its scalability to fully automate the measurement process for high-throughput applications. Furthermore, we showcase its versatility in robotic grasping, leveraging extracted geometric features to identify optimal grasp points.

Keywords

Cite

@article{arxiv.2412.03472,
  title  = {Measure Anything: Real-time, Multi-stage Vision-based Dimensional Measurement using Segment Anything},
  author = {Yongkyu Lee and Shivam Kumar Panda and Wei Wang and Mohammad Khalid Jawed},
  journal= {arXiv preprint arXiv:2412.03472},
  year   = {2024}
}
R2 v1 2026-06-28T20:23:10.912Z