English

A Retina-inspired Sampling Method for Visual Texture Reconstruction

Image and Video Processing 2019-07-23 v1 Computer Vision and Pattern Recognition Multimedia

Abstract

Conventional frame-based camera is not able to meet the demand of rapid reaction for real-time applications, while the emerging dynamic vision sensor (DVS) can realize high speed capturing for moving objects. However, to achieve visual texture reconstruction, DVS need extra information apart from the output spikes. This paper introduces a fovea-like sampling method inspired by the neuron signal processing in retina, which aims at visual texture reconstruction only taking advantage of the properties of spikes. In the proposed method, the pixels independently respond to the luminance changes with temporal asynchronous spikes. Analyzing the arrivals of spikes makes it possible to restore the luminance information, enabling reconstructing the natural scene for visualization. Three decoding methods of spike stream for texture reconstruction are proposed for high-speed motion and stationary scenes. Compared to conventional frame-based camera and DVS, our model can achieve better image quality and higher flexibility, which is capable of changing the way that demanding machine vision applications are built.

Keywords

Cite

@article{arxiv.1907.08769,
  title  = {A Retina-inspired Sampling Method for Visual Texture Reconstruction},
  author = {Lin Zhu and Siwei Dong and Tiejun Huang and Yonghong Tian},
  journal= {arXiv preprint arXiv:1907.08769},
  year   = {2019}
}

Comments

Published in ICME 2019

R2 v1 2026-06-23T10:25:51.338Z