English
Related papers

Related papers: 20-GHz bandwidth optical activation function based…

200 papers

A wide variety of activation functions have been proposed for neural networks. The Rectified Linear Unit (ReLU) is especially popular today. There are many practical reasons that motivate the use of the ReLU. This paper provides new…

Machine Learning · Statistics 2020-10-19 Rahul Parhi , Robert D. Nowak

The reason behind CNNs capability to learn high-dimensional complex features from the images is the non-linearity introduced by the activation function. Several advanced activation functions have been discovered to improve the training…

Machine Learning · Computer Science 2022-11-15 Jeevanshi Sharma

Reliable, versatile galaxy activity diagnostics are essential for understanding galaxy evolution. Traditional methods frequently necessitate extensive preprocessing, such as starlight subtraction and emission line deblending (e.g.,…

Astrophysics of Galaxies · Physics 2026-02-25 C. Daoutis , A. Zezas , E. Kyritsis , K. Kouroumpatzakis , P. Bonfini

Silicon photonics in conjunction with complementary metal-oxide-semiconductor (CMOS) fabrication has greatly enhanced the development of integrated optical phased arrays. This facilitates a dynamic control of light in a compact form factor…

We report a single-frequency, narrow-linewidth semiconductor pulsed laser based on pump current modulation and optical injection locking technique. A monolithic non-planar ring oscillator laser is employed as the seed source to guarantee…

Convolutional Neural Networks (CNNs) have been widely applied. But as the CNNs grow, the number of arithmetic operations and memory footprint also increase. Furthermore, typical non-linear activation functions do not allow associativity of…

Machine Learning · Computer Science 2021-11-10 Eduardo Vera Sousa , Leandro A. F. Fernandes , Cristina Nader Vasconcelos

Electro-optic modulation, the imprinting of a radio-frequency (RF) waveform on an optical carrier, is one of the most important photonics functions, being crucial for high-bandwidth signal generation, optical switching, waveform shaping,…

We demonstrate a free-space amplitude modulator for mid-infrared radiation (lambda=9.6 um) that operates at room temperature up to at least 20 GHz (above the -3dB cutoff frequency measured at 8.2 GHz). The device relies on the ultra-fast…

In contrast to radio frequency (RF), where the modulation bandwidth is restricted by regulations to avoid interference, the available bandwidth in optical wireless communication (OWC) is primarily constrained by system components. To…

Signal Processing · Electrical Eng. & Systems 2026-05-06 Xiaochen Liu , Jean-Paul M. G. Linnartz , Thiago E. B. Cunha

Oscillatory dynamics have recently proven highly effective in machine learning (ML), particularly through State-Space-Models (SSM) that leverage structured linear recurrences for long-range temporal processing. Resonate-and-Fire neurons…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Angqi Liu , Filippo Moro , Sebastian Billaudelle , Melika Payvand

Activation functions play a key role in providing remarkable performance in deep neural networks, and the rectified linear unit (ReLU) is one of the most widely used activation functions. Various new activation functions and improvements on…

Machine Learning · Computer Science 2019-08-27 Yang Liu , Jianpeng Zhang , Chao Gao , Jinghua Qu , Lixin Ji

The rapid expansion of generative AI drives unprecedented demands for high-performance computing. Training large-scale AI models now requires vast interconnected GPU clusters across multiple data centers. Multi-scale AI training and…

Optomechanical systems combine extreme sensitivity and bandwidth in the control of mechanical motion, of interest for various applications. Integrated on a chip, actuated and detected all-optically by a single laser, they could disrupt…

Successive linear transforms followed by nonlinear "activation" functions can approximate nonlinear functions to arbitrary precision given sufficient layers. The number of necessary layers is dependent on, in part, by the nature of the…

Neural and Evolutionary Computing · Computer Science 2018-09-26 Andrei Nicolae

This paper presents a theoretical and experimental investigation of optical signal regeneration properties of a non-linear optical loop mirror using a semiconductor optical amplifier as the active element (SOA-NOLM). While this device has…

Deep neural networks have been successfully used in diverse emerging domains to solve real world complex problems with may more deep learning(DL) architectures, being developed to date. To achieve these state-of-the-art performances, the DL…

Machine Learning · Computer Science 2018-11-09 Chigozie Nwankpa , Winifred Ijomah , Anthony Gachagan , Stephen Marshall

Deep neural networks have achieved remarkable breakthroughs by leveraging multiple layers of data processing to extract hidden representations, albeit at the cost of large electronic computing power. To enhance energy efficiency and speed,…

In neural networks, non-linearity is introduced by activation functions. One commonly used activation function is Rectified Linear Unit (ReLU). ReLU has been a popular choice as an activation but has flaws. State-of-the-art functions like…

Machine Learning · Computer Science 2021-12-23 Advait Vagerwal

One of the fundamental limits of classical optical microscopy is the diffraction limit of optical resolution. It results from the finite bandwidth of the optical transfer function (or OTF) of an optical microscope, which restricts the…

Optics · Physics 2022-03-11 Sjoerd Stallinga , Niels Radmacher , Antoine Delon , Jörg Enderlein

Optical beamforming networks (OBFNs) based on optical true time delay lines (OTTDLs) are well-known as the promising candidate to solve the bandwidth limitation of traditional electronic phased array antennas (PAAs) due to beam squinting.…