English
Related papers

Related papers: Engineering nonlinear activation functions for all…

200 papers

Deeplearning algorithms are revolutionising many aspects of modern life. Typically, they are implemented in CMOS-based hardware with severely limited memory access times and inefficient data-routing. All-optical neural networks without any…

Optical neural networks (ONNs) perform extensive computations using photons instead of electrons, resulting in passively energy-efficient and low-latency computing. Among various ONNs, the diffractive optical neural networks (DONNs)…

The increasing complexity of neural networks and the energy consumption associated with training and inference create a need for alternative neuromorphic approaches, e.g. using optics. Current proposals and implementations rely on physical…

Optics · Physics 2023-08-31 Clara C. Wanjura , Florian Marquardt

Optics and photonics has recently captured interest as a platform to accelerate linear matrix processing, that has been deemed as a bottleneck in traditional digital electronic architectures. In this paper, we propose an all-photonic…

Quantum state tomography (QST) is a crucial ingredient for almost all aspects of experimental quantum information processing. As an analog of the "imaging" technique in the quantum settings, QST is born to be a data science problem, where…

Quantum Physics · Physics 2021-06-10 Ying Zuo , Chenfeng Cao , Ningping Cao , Xuanying Lai , Bei Zeng , Shengwang Du

Due to their intrinsic capabilities on parallel signal processing, optical neural networks (ONNs) have attracted extensive interests recently as a potential alternative to electronic artificial neural networks (ANNs) with reduced power…

Signal Processing · Electrical Eng. & Systems 2024-03-05 Yi-Feng Liu , Rui-Yao Ren , Dai-Bao Hou , Hai-Zhong Weng , Bo-Wen Wang , Ke-Jie Huang , Xing Lin , Feng Liu , Chen-Hui Li , Chao-Yuan Jin

Neural networks have proven effective for solving many difficult computational problems. Implementing complex neural networks in software is very computationally expensive. To explore the limits of information processing, it will be…

Neural and Evolutionary Computing · Computer Science 2017-04-20 Jeffrey M. Shainline , Sonia M. Buckley , Richard P. Mirin , Sae Woo Nam

In this work, we present numerical results concerning an integrated photonic non-linear activation function that relies on a power independent, non-linear phase to amplitude conversion in a passive optical resonator. The underlying…

Optics · Physics 2024-02-07 George Sarantoglou , Adonis Bogris , Charis Mesaritakis

In recent years, the computational demands of deep learning applications have necessitated the introduction of energy-efficient hardware accelerators. Optical neural networks are a promising option; however, thus far they have been largely…

Optical neural networks (ONNs) enable high speed parallel and energy efficient processing compared to conventional digital electronic counterparts. However, realizing large scale systems is an open problem. Among various integrated and…

Deep neural networks have achieved remarkable breakthroughs by leveraging multiple layers of data processing to extract hidden representations, albeit at the cost of large electronic computing power. To enhance energy efficiency and speed,…

Optical wireless communication offers unprecedented communication speeds that can support the massive use of the Internet on a daily basis. In indoor environments, optical wireless networks are usually multi-user multiple-input…

Signal Processing · Electrical Eng. & Systems 2021-11-30 Ahmad Adnan Qidan , Taisir El-Gorashi1 , Jaafar M. H. Elmirghani

Conventional integrated circuits (ICs) struggle to meet the escalating demands of artificial intelligence (AI). This has sparked a renewed interest in an unconventional computing paradigm: neuromorphic (brain-inspired) computing. However,…

Optical neural networks (ONNs) are emerging as a promising neuromorphic computing paradigm for object recognition, offering unprecedented advantages in light-speed computation, ultra-low power consumption, and inherent parallelism. However,…

Recent success in deep neural networks has generated strong interest in hardware accelerators to improve speed and energy consumption. This paper presents a new type of photonic accelerator based on coherent detection that is scalable to…

Emerging Technologies · Computer Science 2019-05-21 Ryan Hamerly , Liane Bernstein , Alexander Sludds , Marin Soljačić , Dirk Englund

Activation functions play a decisive role in determining the capacity of Deep Neural Networks as they enable neural networks to capture inherent nonlinearities present in data fed to them. The prior research on activation functions…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Jamshaid Ul Rahman , Faiza Makhdoom , Dianchen Lu

Photonic neural networks benefit from both the high channel capacity- and the wave nature of light acting as an effective weighting mechanism through linear optics. The neuron's activation function, however, requires nonlinearity which can…

Artificial neural networks usually consist of successive linear multiply-accumulate operations and nonlinear activation functions. However, most optical neural networks only achieve the linear operation in the optical domain, while the…

Optics · Physics 2023-11-03 Guanting Liu , Yiwei Shen , Ruiqian Li , Jingyi Yu , Xuming He , Cheng Wang

The optical neural network (ONN) is a promising hardware platform for next-generation neurocomputing due to its high parallelism, low latency, and low energy consumption. Previous ONN architectures are mainly designed for general matrix…

Emerging Technologies · Computer Science 2022-07-19 Chenghao Feng , Jiaqi Gu , Hanqing Zhu , Zhoufeng Ying , Zheng Zhao , David Z. Pan , Ray T. Chen

Parametrized quantum circuits are essential components of variational quantum algorithms. Until now, optical implementations of these circuits have relied solely on adjustable linear optical units. In this study, we demonstrate that using…

Quantum Physics · Physics 2025-01-22 E. A. Chernykh , M. Yu. Saygin , G. I. Struchalin , S. P. Kulik , S. S. Straupe