English

FisheyeMultiNet: Real-time Multi-task Learning Architecture for Surround-view Automated Parking System

Computer Vision and Pattern Recognition 2019-12-25 v1 Robotics

Abstract

Automated Parking is a low speed manoeuvring scenario which is quite unstructured and complex, requiring full 360{\deg} near-field sensing around the vehicle. In this paper, we discuss the design and implementation of an automated parking system from the perspective of camera based deep learning algorithms. We provide a holistic overview of an industrial system covering the embedded system, use cases and the deep learning architecture. We demonstrate a real-time multi-task deep learning network called FisheyeMultiNet, which detects all the necessary objects for parking on a low-power embedded system. FisheyeMultiNet runs at 15 fps for 4 cameras and it has three tasks namely object detection, semantic segmentation and soiling detection. To encourage further research, we release a partial dataset of 5,000 images containing semantic segmentation and bounding box detection ground truth via WoodScape project \cite{yogamani2019woodscape}.

Keywords

Cite

@article{arxiv.1912.11066,
  title  = {FisheyeMultiNet: Real-time Multi-task Learning Architecture for Surround-view Automated Parking System},
  author = {Pullarao Maddu and Wayne Doherty and Ganesh Sistu and Isabelle Leang and Michal Uricar and Sumanth Chennupati and Hazem Rashed and Jonathan Horgan and Ciaran Hughes and Senthil Yogamani},
  journal= {arXiv preprint arXiv:1912.11066},
  year   = {2019}
}

Comments

Accepted for publication at Irish Machine Vision and Image Processing (IMVIP) 2019

R2 v1 2026-06-23T12:55:05.534Z