English

Dense Depth from Event Focal Stack

Computer Vision and Pattern Recognition 2024-12-12 v1 Artificial Intelligence Machine Learning Robotics

Abstract

We propose a method for dense depth estimation from an event stream generated when sweeping the focal plane of the driving lens attached to an event camera. In this method, a depth map is inferred from an ``event focal stack'' composed of the event stream using a convolutional neural network trained with synthesized event focal stacks. The synthesized event stream is created from a focal stack generated by Blender for any arbitrary 3D scene. This allows for training on scenes with diverse structures. Additionally, we explored methods to eliminate the domain gap between real event streams and synthetic event streams. Our method demonstrates superior performance over a depth-from-defocus method in the image domain on synthetic and real datasets.

Keywords

Cite

@article{arxiv.2412.08120,
  title  = {Dense Depth from Event Focal Stack},
  author = {Kenta Horikawa and Mariko Isogawa and Hideo Saito and Shohei Mori},
  journal= {arXiv preprint arXiv:2412.08120},
  year   = {2024}
}

Comments

Accepted at WACV2025

R2 v1 2026-06-28T20:30:33.085Z