English
Related papers

Related papers: Photonic Neuromorphic Accelerators for Event-Based…

200 papers

Photonic technologies offer great prospects for novel ultrafast, energy-efficient and hardware-friendly neuromorphic (brain-like) computing platforms. Moreover, neuromorphic photonic approaches based upon ubiquitous, technology-mature and…

Emerging Technologies · Computer Science 2022-11-23 Dafydd Owen-Newns , Joshua Robertson , Matej Hejda , Antonio Hurtado

This paper introduces a neuromorphic methodology for eye tracking, harnessing pure event data captured by a Dynamic Vision Sensor (DVS) camera. The framework integrates a directly trained Spiking Neuron Network (SNN) regression model and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Pietro Bonazzi , Sizhen Bian , Giovanni Lippolis , Yawei Li , Sadique Sheik , Michele Magno

High-speed machine vision is increasing its importance in both scientific and technological applications. Neuro-inspired photonic computing is a promising approach to speed-up machine vision processing with ultralow latency. However, the…

In the field of artificial intelligence, neuromorphic computing has been around for several decades. Deep learning has however made much recent progress such that it consistently outperforms neuromorphic learning algorithms in…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Roshan Gopalakrishnan , Yansong Chua , Laxmi R Iyer

Photonic neuromorphic computing offers compelling advantages in power efficiency and parallel processing, but often falls short in realizing scalable nonlinearity and long-term memory. We overcome these limitations by employing silicon…

Neuromorphic photonic accelerators are becoming increasingly popular, since they can significantly improve computation speed and energy efficiency, leading to femtojoule per MAC efficiency. However, deploying existing DL models on such…

Emerging Technologies · Computer Science 2023-10-03 Manos Kirtas , Nikolaos Passalis , Nikolaos Pleros , Anastasios Tefas

The detection of ultrafast optical and radio-frequency (RF) signals is crucial for applications ranging from high-speed communications to advanced sensing. However, conventional detectors are fundamentally constrained by their intrinsic…

Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shintaro Shiba , Yoshimitsu Aoki , Guillermo Gallego

Neuromorphic vision sensors (event cameras) are inherently suitable for spiking neural networks (SNNs) and provide novel neuromorphic vision data for this biomimetic model. Due to the spatiotemporal characteristics, novel data augmentations…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Haibo Shen , Yihao Luo , Xiang Cao , Liangqi Zhang , Juyu Xiao , Tianjiang Wang

This paper introduces an unsupervised compact architecture that can extract features and classify the contents of dynamic scenes from the temporal output of a neuromorphic asynchronous event-based camera. Event-based cameras are clock-less…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Germain Haessig , Ryad Benosman

Emergent learning transforms a disordered optical medium into a photonic device capable of storage, recognition, and classification of arbitrary memory patterns. First, we show that the intensity at the output of a multiply scattering…

Mobile and embedded applications require neural networks-based pattern recognition systems to perform well under a tight computational budget. In contrast to commonly used synchronous, frame-based vision systems and CNNs, asynchronous,…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Bodo Rückauer , Nicolas Känzig , Shih-Chii Liu , Tobi Delbruck , Yulia Sandamirskaya

Increasing demand for understanding the vast heterogeneity of cellular phenotypes has driven the development of imaging flow cytometry (IFC), that combines features of flow cytometry with fluorescence and bright field microscopy. IFC…

Quantitative Methods · Quantitative Biology 2019-02-06 Yuanyuan Han , Rui Tang , Yi Gu , Alex Ce Zhang , Wei Cai , Violet Castor , Sung Hwan Cho , William Alaynick , Yu-Hwa Lo

3D depth sensors using single-photon avalanche diodes (SPADs) are becoming increasingly common in applications such as autonomous navigation and object detection. Recent designs implement on-chip histogramming time-to-digital converters…

Image and Video Processing · Electrical Eng. & Systems 2024-02-13 Jack MacLean , Brian Stewart , Istvan Gyongy

Neuromorphic imaging is an emerging technique that imitates the human retina to sense variations in dynamic scenes. It responds to pixel-level brightness changes by asynchronous streaming events and boasts microsecond temporal precision…

Image and Video Processing · Electrical Eng. & Systems 2024-10-23 Pei Zhang , Shuo Zhu , Chutian Wang , Yaping Zhao , Edmund Y. Lam

Event cameras generate asynchronous and sparse event streams capturing changes in light intensity. They offer significant advantages over conventional frame-based cameras, such as a higher dynamic range and an extremely faster data rate,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Yi Tian , Juan Andrade-Cetto

Photonic computing chips have made significant progress in accelerating linear computations, but nonlinear computations are usually implemented in the digital domain, which introduces additional system latency and power consumption, and…

Photonic systems for high-performance information processing have attracted renewed interest. Neuromorphic silicon photonics has the potential to integrate processing functions that vastly exceed the capabilities of electronics. We report…

Neurons and Cognition · Quantitative Biology 2017-11-17 Alexander N. Tait , Thomas Ferreira de Lima , Ellen Zhou , Allie X. Wu , Mitchell A. Nahmias , Bhavin J. Shastri , Paul R. Prucnal

We propose a fully asynchronous peak detection approach for SPAD-based direct time-of-flight (dToF) flash LiDAR, enabling pixel-wise event-driven depth acquisition without global synchronization. By allowing pixels to independently report…

Image and Video Processing · Electrical Eng. & Systems 2025-12-29 Yiyang Liu , Rongxuan Zhang , Istvan Gyongy , Alistair Gorman , Sarrah M. Patanwala , Filip Taneski , Robert K. Henderson

Neuro-symbolic Artificial Intelligence (AI) models, blending neural networks with symbolic AI, have facilitated transparent reasoning and context understanding without the need for explicit rule-based programming. However, implementing such…