English
Related papers

Related papers: Engineering nonlinear activation functions for all…

200 papers

The energy consumption of neural network inference has become a topic of paramount importance with the growing success and adoption of deep neural networks. Analog optical neural networks (ONNs) can reduce the energy of matrix-vector…

Emerging Technologies · Computer Science 2024-09-23 Marc Gong Bacvanski , Sri Krishna Vadlamani , Kfir Sulimany , Dirk Robert Englund

The high demand for machine intelligence of doubling every three months is driving novel hardware solutions beyond charging of electrical wires given a resurrection to application specific integrated circuit (ASIC)-based accelerators. These…

Feed-forward, fully-connected Artificial Neural Networks (ANNs) or the so-called Multi-Layer Perceptrons (MLPs) are well-known universal approximators. However, their learning performance varies significantly depending on the function or…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Serkan Kiranyaz , Turker Ince , Alexandros Iosifidis , Moncef Gabbouj

The threads of photonics are eagerly awaited to redefine the future of neuromorphic data processing, especially as the computing-intensive artificial intelligence models become an unavoidable part of our everyday lives. Still, there is much…

This paper addresses the limitations in Optical Neural Networks (ONNs) related to training efficiency, nonlinear function implementation, and large input data processing. We introduce Two-Pass Forward Propagation, a novel training method…

Machine Learning · Computer Science 2024-08-19 Amirreza Ahmadnejad , Somayyeh Koohi

The development of viable all-optical data processing systems has immense importance for both the computing and telecommunication industries, but device realization remains elusive. In this Letter, we propose an innovative mechanism…

Optics · Physics 2012-06-21 David L. Andrews , David S. Bradshaw

There has been a recent surge of interest in the implementation of linear operations such as matrix multipications using photonic integrated circuit technology. However, these approaches require an efficient and flexible way to perform…

The paper investigates nonlinear system identification using system output data at various linearized operating points. A feed-forward multi-layer Artificial Neural Network (ANN) based approach is used for this purpose and tested for two…

Systems and Control · Computer Science 2016-11-17 Sayan Saha , Saptarshi Das , Anish Acharya , Abhishek Kumar , Sumit Mukherjee , Indranil Pan , Amitava Gupta

Optical non-linearities usually appear for large intensities, but discrete transitions allow for giant non-linearities operating at the single photon level. This has been demonstrated in the last decade for a single optical mode with cold…

Optical imaging is commonly used for both scientific and technological applications across industry and academia. In image sensing, a measurement, such as of an object's position, is performed by computational analysis of a digitized image.…

Software-implementation, via neural networks, of brain-inspired computing approaches underlie many important modern-day computational tasks, from image processing to speech recognition, artificial intelligence and deep learning…

Optics · Physics 2021-02-19 J. Feldmann , N. Youngblood , C. D. Wright , H. Bhaskaran , W. H. P. Pernice

Quantum computing enables quantum neural networks (QNNs) to have great potentials to surpass artificial neural networks (ANNs). The powerful generalization of neural networks is attributed to nonlinear activation functions. Although various…

Quantum Physics · Physics 2020-11-30 Shilu Yan , Hongsheng Qi , Wei Cui

Light's ability to perform massive linear operations parallelly has recently inspired numerous demonstrations of optics-assisted artificial neural networks (ANN). However, a clear advantage of optics over purely digital ANN in a…

Recently integrated optics has become an intriguing platform for implementing machine learning algorithms and inparticular neural networks. Integrated photonic circuits can straightforwardly perform vector-matrix multiplicationswith high…

Neuromorphic engineering has emerged as a promising avenue for developing brain-inspired computational systems. However, conventional electronic AI-based processors often encounter challenges related to processing speed and thermal…

Optics · Physics 2025-01-03 Reyhane Ahmadi , Amirreza Ahmadnejad , Somayyeh Koohi

Optical neural networks (ONNs) based on programmable photonic integrated circuits (PICs) offer a promising route toward low-latency and energy-efficient deep learning. However, conventional photonic implementations of matrix-vector…

Having the potential for high speed, high throughput, and low energy cost, optical neural networks (ONNs) have emerged as a promising candidate for accelerating deep learning tasks. In conventional ONNs, light amplitudes are modulated at…

Systems and Control · Electrical Eng. & Systems 2023-12-18 Ruidi Qiu , Amro Eldebiky , Grace Li Zhang , Xunzhao Yin , Cheng Zhuo , Ulf Schlichtmann , Bing Li

As artificial neural networks (ANNs) continue to make strides in wide-ranging and diverse fields of technology, the search for more efficient hardware implementations beyond conventional electronics is gaining traction. In particular,…

Emerging Technologies · Computer Science 2021-07-01 Albert Ryou , James Whitehead , Maksym Zhelyeznyakov , Paul Anderson , Cem Keskin , Michal Bajcsy , Arka Majumdar

We introduce an all-optical Diffractive Deep Neural Network (D2NN) architecture that can learn to implement various functions after deep learning-based design of passive diffractive layers that work collectively. We experimentally…

Neural and Evolutionary Computing · Computer Science 2018-09-26 Xing Lin , Yair Rivenson , Nezih T. Yardimci , Muhammed Veli , Mona Jarrahi , Aydogan Ozcan

Photonics has unlocked the potential for energy-efficient acceleration of deep learning. Most approaches toward photonic deep learning have diligently reproduced traditional deep learning architectures using photonic platforms, separately…

Optics · Physics 2024-12-06 Sunkyu Yu , Xianji Piao , Namkyoo Park