English
Related papers

Related papers: A surface-normal photodetector as nonlinear activa…

200 papers

This paper proposes three-filters-to-normal (3F2N), an accurate and ultrafast surface normal estimator (SNE), which is designed for structured range sensor data, e.g., depth/disparity images. 3F2N SNE computes surface normals by simply…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Rui Fan , Hengli Wang , Bohuan Xue , Huaiyang Huang , Yuan Wang , Ming Liu , Ioannis Pitas

Optical approaches have made great strides towards the goal of high-speed, energy-efficient computing necessary for modern deep learning and AI applications. Read-in and read-out of data, however, limit the overall performance of existing…

Emerging Technologies · Computer Science 2024-02-06 Alexander Song , Sai Nikhilesh Murty Kottapalli , Rahul Goyal , Bernhard Schölkopf , Peer Fischer

Spiking Neural Networks (SNNs) are a biologically plausible neural network model with significant advantages in both event-driven processing and spatio-temporal information processing, rendering SNNs an appealing choice for energyefficient…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Jilong Luo , Shanlin Xiao , Yinsheng Chen , Zhiyi Yu

Spiking neural networks (SNNs) emulated on dedicated neuromorphic accelerators promise to offer energy-efficient signal processing. However, the neuromorphic advantage over traditional algorithms still remains to be demonstrated in…

Neural and Evolutionary Computing · Computer Science 2024-12-05 Elias Arnold , Eike-Manuel Edelmann , Alexander von Bank , Eric Müller , Laurent Schmalen , Johannes Schemmel

Diffractive Neural Networks (DNNs) leverage the power of light to enhance computational performance in machine learning, offering a pathway to high-speed, low-energy, and large-scale neural information processing. However, most existing DNN…

Optics · Physics 2024-11-21 Sahar Behroozinia , Qing Gu

Conventional image sensors digitize high-resolution images at fast frame rates, producing a large amount of data that needs to be transmitted off the sensor for further processing. This is challenging for perception systems operating on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Haley M. So , Laurie Bose , Piotr Dudek , Gordon Wetzstein

Photonic neuromorphic computing offers a promising route to overcoming the limitations of conventional von Neumann architectures by exploiting the high bandwidth, low latency, and massive parallelism of optical systems. However, most…

Optics · Physics 2026-05-20 Isaac Yorke

Diffractive neural networks (DNNs) are an emerging approach for the realization of photonic artificial intelligence, especially due to their suitability for machine-vision applications and high-dimensional photonic information processing at…

Optics · Physics 2026-03-27 Marie Braasch , Anna Kartashova , Elena Goi , Thomas Pertsch , Sina Saravi

Photonic neural networks (PNNs) have emerged as a promising platform to address the energy consumption issue that comes with the advancement of artificial intelligence technology, and thin film lithium niobate (TFLN) offers an attractive…

Optics · Physics 2024-02-27 Yong Zheng , Rongbo Wu , Yuan Ren , Rui Bao , Jian Liu , Yu Ma , Min Wang , Ya Cheng

In recent years, deep neural networks (DNNs) have gained widespread adoption for continuous mobile object detection (OD) tasks, particularly in autonomous systems. However, a prevalent issue in their deployment is the one-size-fits-all…

Machine Learning · Computer Science 2024-04-30 Justin Davis , Mehmet E. Belviranli

We introduce an all-optical Diffractive Deep Neural Network (D2NN) architecture that can learn to implement various functions after deep learning-based design of passive diffractive layers that work collectively. We experimentally…

Neural and Evolutionary Computing · Computer Science 2018-09-26 Xing Lin , Yair Rivenson , Nezih T. Yardimci , Muhammed Veli , Mona Jarrahi , Aydogan Ozcan

Nonlinear computation is essential for various information processing tasks. Optical implementations are attractive because passive light propagation can manipulate high-dimensional signals with extreme throughput and parallelism; yet…

Recent success in deep neural networks has generated strong interest in hardware accelerators to improve speed and energy consumption. This paper presents a new type of photonic accelerator based on coherent detection that is scalable to…

Emerging Technologies · Computer Science 2019-05-21 Ryan Hamerly , Liane Bernstein , Alexander Sludds , Marin Soljačić , Dirk Englund

The escalating energy demands and parallel-processing bottlenecks of electronic neural networks underscore the need for alternative computing paradigms. Optical neural networks, capitalizing on the inherent parallelism and speed of light…

The complexity of event-based object detection (OD) poses considerable challenges. Spiking Neural Networks (SNNs) show promising results and pave the way for efficient event-based OD. Despite this success, the path to efficient SNNs on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Jonathan Courtois , Pierre-Emmanuel Novac , Edgar Lemaire , Alain Pegatoquet , Benoit Miramond

As deep neural networks (DNNs) grow to solve increasingly complex problems, they are becoming limited by the latency and power consumption of existing digital processors. For improved speed and energy efficiency, specialized analog optical…

Emerging Technologies · Computer Science 2022-06-24 Liane Bernstein , Alexander Sludds , Christopher Panuski , Sivan Trajtenberg-Mills , Ryan Hamerly , Dirk Englund

The ever-growing deep learning technologies are making revolutionary changes for modern life. However, conventional computing architectures are designed to process sequential and digital programs, being extremely burdened with performing…

Emerging Technologies · Computer Science 2022-12-21 Yuyao Huang , Tingzhao Fu , Honghao Huang , Sigang Yang , Hongwei Chen

We propose and experimentally demonstrate a nonlinear-optics approach to pattern recognition with single-pixel imaging and deep neural network. It employs mode selective image up-conversion to project a raw image onto a set of coherent…

Optics · Physics 2021-02-03 Ting Bu , Santosh Kumar , He Zhang , Irwin Huang , Yuping Huang

The recent explosive compute growth, mainly fueled by the boost of AI and DNNs, is currently instigating the demand for a novel computing paradigm that can overcome the insurmountable barriers imposed by conventional electronic computing…

Neural networks are one of the first major milestones in developing artificial intelligence systems. The utilisation of integrated photonics in neural networks offers a promising alternative approach to microelectronic and hybrid…