English
Related papers

Related papers: Reprogrammable Electro-Optic Nonlinear Activation …

200 papers

Diffractive optical neural networks (DONNs) have demonstrated unparalleled energy efficiency and parallelism by processing information directly in the optical domain. However, their computational expressivity is constrained by static,…

Optics · Physics 2026-03-11 Ziang Yin , Qi Jing , Raktim Sarma , Rena Huang , Yu Yao , Jiaqi Gu

Over the past decade, artificial intelligence (AI) has led to disruptive advancements in fundamental sciences and everyday technologies. Among various machine learning algorithms, deep neural networks have become instrumental in revealing…

Optical computing is an emerging technology for next-generation efficient artificial intelligence (AI) due to its ultra-high speed and efficiency. Electromagnetic field simulation is critical to the design, optimization, and validation of…

Emerging Technologies · Computer Science 2022-09-22 Jiaqi Gu , Zhengqi Gao , Chenghao Feng , Hanqing Zhu , Ray T. Chen , Duane S. Boning , David Z. Pan

Activation functions are crucial in deep learning models since they introduce non-linearity into the networks, allowing them to learn from errors and make adjustments, which is essential for learning complex patterns. The essential purpose…

Machine Learning · Computer Science 2023-10-17 Koushik Biswas , Meghana Karri , Ulaş Bağcı

To develop active nanomaterials that can instantly respond to external stimuli with designed mechanical motions is an important step towards the realization of nanomachines and nanorobots. Herein, we present our finding of a versatile…

Applied Physics · Physics 2020-01-08 Zexi Liang , Daniel Teal , Donglei Fan

Binarization of neural network models is considered as one of the promising methods to deploy deep neural network models on resource-constrained environments such as mobile devices. However, Binary Neural Networks (BNNs) tend to suffer from…

Machine Learning · Computer Science 2021-03-31 Hyungjun Kim , Jihoon Park , Changhun Lee , Jae-Joon Kim

Photonic convolutional accelerators have emerged as low-energy alternatives to power-demanding digital convolutional neural networks, though they often face limitations in scalability. In this work, we introduce a convolutional photonic…

Optics · Physics 2025-12-24 Georgios Moustakas , Adonis Bogris , Charis Mesaritakis

We present a method to train self-binarizing neural networks, that is, networks that evolve their weights and activations during training to become binary. To obtain similar binary networks, existing methods rely on the sign activation…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Fayez Lahoud , Radhakrishna Achanta , Pablo Márquez-Neila , Sabine Süsstrunk

Diffractive deep neural network (DNNet) is a novel machine learning framework on the modulation of optical transmission. Diffractive network would get predictions at the speed of light. It's pure passive architecture, no additional power…

Machine Learning · Computer Science 2019-12-24 Yingshi Chen , Jinfeng Zhu

As computing resource demands continue to escalate in the face of big data, cloud-connectivity and the internet of things, it has become imperative to develop new low-power, scalable architectures. Neuromorphic photonics, or photonic neural…

In the current research of neural networks, the activation function is manually specified by human and not able to change themselves during training. This paper focus on how to make the activation function trainable for deep neural…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Zhaohe Liao

Activation functions are the linchpins of deep learning, profoundly influencing both the representational capacity and training dynamics of neural networks. They shape not only the nature of representations but also optimize convergence…

Machine Learning · Computer Science 2023-12-04 Juyoung Yun

Purpose: Optical imaging is evolving as a key technique for advanced sensing in the operating room. Recent research has shown that machine learning algorithms can be used to address the inverse problem of converting pixel-wise multispectral…

Optical nonlinear functions are crucial for various applications in integrated photonics, such as all-optical information processing, photonic neural networks and on-chip ultrafast light sources. Due to the weak nonlinearities in most…

Light's ability to perform massive linear operations parallelly has recently inspired numerous demonstrations of optics-assisted artificial neural networks (ANN). However, a clear advantage of optics over purely digital ANN in a…

Optical implementation of artificial neural networks has been attracting great attention due to its potential in parallel computation at speed of light. Although all-optical deep neural networks (AODNNs) with a few neurons have been…

Optics · Physics 2021-05-26 Ying Zuo , Zhao Yujun , You-Chiuan Chen , Shengwang Du , Junwei Liu

Today, machine learning tools, particularly artificial neural networks, have become crucial for diverse applications. However, current digital computing tools to train and deploy artificial neural networks often struggle with massive data…

Emerging Technologies · Computer Science 2025-02-14 Bora Çarpınlıoğlu , Uğur Teğin

We introduce a principled method to train end-to-end analog neural networks by stochastic gradient descent. In these analog neural networks, the weights to be adjusted are implemented by the conductances of programmable resistive devices…

Neural and Evolutionary Computing · Computer Science 2020-06-11 Jack Kendall , Ross Pantone , Kalpana Manickavasagam , Yoshua Bengio , Benjamin Scellier

We apply in simulation a reservoir computer based on evanescently coupled GaAs microrings for real-time compensation of a nonlinear distortion of a 50 Gbaud 16-QAM signal with the launch power up to 12 dBm in a standard single-mode optical…

Optics · Physics 2024-05-13 Ivan K. Boikov , Daniel Brunner , Alfredo De Rossi

In modern artificial intelligence, convolutional neural networks (CNNs) have become a cornerstone for visual and perceptual tasks. However, their implementation on conventional electronic hardware faces fundamental bottlenecks in speed and…