This report reviews all results derived from performance benchmarking conducted during Phase I of the Development and Execution of Comprehensive and Integrated Subterranean Intelligent Vehicle Evaluations (DECISIVE) project by the University of Massachusetts Lowell, using the test methods specified in the DECISIVE Test Methods Handbook v1.1 for evaluating small unmanned aerial systems (sUAS) performance in subterranean and constrained indoor environments, spanning communications, field readiness, interface, obstacle avoidance, navigation, mapping, autonomy, trust, and situation awareness. Using those 20 test methods, over 230 tests were conducted across 8 sUAS platforms: Cleo Robotics Dronut X1P (P = prototype), FLIR Black Hornet PRS, Flyability Elios 2 GOV, Lumenier Nighthawk V3, Parrot ANAFI USA GOV, Skydio X2D, Teal Golden Eagle, and Vantage Robotics Vesper. Best in class criteria is specified for each applicable test method and the sUAS that match this criteria are named for each test method, including a high-level executive summary of their performance.
Cite
@article{arxiv.2301.07853,
title = {DECISIVE Benchmarking Data Report: sUAS Performance Results from Phase I},
author = {Adam Norton and Reza Ahmadzadeh and Kshitij Jerath and Paul Robinette and Jay Weitzen and Thanuka Wickramarathne and Holly Yanco and Minseop Choi and Ryan Donald and Brendan Donoghue and Christian Dumas and Peter Gavriel and Alden Giedraitis and Brendan Hertel and Jack Houle and Nathan Letteri and Edwin Meriaux and Zahra Rezaei Khavas and Rakshith Singh and Gregg Willcox and Naye Yoni},
journal= {arXiv preprint arXiv:2301.07853},
year = {2023}
}
Comments
Approved for public release: PAO #PR2023_74172; arXiv admin note: substantial text overlap with arXiv:2211.01801