移动设备上的高效单图像深度估计,Mobile AI & AIM 2022 挑战赛:报告
计算机视觉与模式识别
2022-11-17 v1 图像与视频处理
摘要
各种深度估计模型现已广泛用于许多移动和物联网设备,以进行图像分割、散景效果渲染、目标跟踪及许多其他移动任务。因此,拥有能在低功耗移动芯片组上快速运行的高效且准确的深度估计模型至关重要。在本次 Mobile AI 挑战赛中,目标是开发基于深度学习的单图像深度估计解决方案,这些方案需能在物联网平台和智能手机上展示实时性能。为此,参赛者使用了一个大规模 RGB 到深度数据集,该数据集由 ZED 立体相机采集,能够为最远 50 米处的物体生成深度图。所有模型的运行时间均在 Raspberry Pi 4 平台上进行了评估,所开发的解决方案能够以高达 27 FPS 的速度生成 VGA 分辨率的深度图,同时实现高保真结果。挑战赛中开发的所有模型也兼容任何基于 Android 或 Linux 的移动设备,本文提供了它们的详细描述。
引用
@article{arxiv.2211.04470,
title = {Efficient Single-Image Depth Estimation on Mobile Devices, Mobile AI & AIM 2022 Challenge: Report},
author = {Andrey Ignatov and Grigory Malivenko and Radu Timofte and Lukasz Treszczotko and Xin Chang and Piotr Ksiazek and Michal Lopuszynski and Maciej Pioro and Rafal Rudnicki and Maciej Smyl and Yujie Ma and Zhenyu Li and Zehui Chen and Jialei Xu and Xianming Liu and Junjun Jiang and XueChao Shi and Difan Xu and Yanan Li and Xiaotao Wang and Lei Lei and Ziyu Zhang and Yicheng Wang and Zilong Huang and Guozhong Luo and Gang Yu and Bin Fu and Jiaqi Li and Yiran Wang and Zihao Huang and Zhiguo Cao and Marcos V. Conde and Denis Sapozhnikov and Byeong Hyun Lee and Dongwon Park and Seongmin Hong and Joonhee Lee and Seunggyu Lee and Se Young Chun},
journal= {arXiv preprint arXiv:2211.04470},
year = {2022}
}
备注
arXiv admin note: substantial text overlap with arXiv:2105.08630, arXiv:2211.03885; text overlap with arXiv:2105.08819, arXiv:2105.08826, arXiv:2105.08629, arXiv:2105.07809, arXiv:2105.07825