Related papers: 20-GHz bandwidth optical activation function based…
This paper explores the expressive power of deep neural networks for a diverse range of activation functions. An activation function set $\mathscr{A}$ is defined to encompass the majority of commonly used activation functions, such as…
The expressive power of artificial neural networks crucially depends on the nonlinearity of their activation functions. Though a wide variety of nonlinear activation functions have been proposed for use in artificial neural networks, a…
We report an integrated all-optical radio frequency spectrum analyzer based on a ~ 4cm long doped silica glass waveguide, with a bandwidth greater than 2.5 THz. We use this device to characterize the intensity power spectrum of ultrahigh…
We experimentally study a fiber loop laser with an integrated Erbium doped fiber (EDF). The output optical spectrum is measured as a function of the EDF temperature. We find that below a critical temperature of about 10K the measured…
Inducing and leveraging sparse activations during training and inference is a promising avenue for improving the computational efficiency of deep networks, which is increasingly important as network sizes continue to grow and their…
Activation functions are essential to introduce nonlinearity into neural networks, with the Rectified Linear Unit (ReLU) often favored for its simplicity and effectiveness. Motivated by the structural similarity between a shallow…
Fourier Analysis Network (FAN) was recently proposed as a simple way to improve neural network performance by replacing part of Rectified Linear Unit (ReLU) activations with sine and cosine functions. Although several studies have reported…
Optical frequency combs provide a phase-coherent interface between optical and microwave domains, underpinning advances in precision metrology, spectroscopy, and time-frequency transfer. Most conventional comb architectures are limited to…
This work reports single-frequency laser oscillation at 1003.4 nm of an optically pumped external cavity semiconductor laser. By using a gain structure bonded onto a high conductivity substrate, we demonstrate both theoretically and…
We demonstrate a continuously RF tunable orthogonally polarized optical single sideband (OP-OSSB) generator based on dual cascaded micro-ring resonators. By splitting the input double sideband signal into an orthogonally polarized carrier…
Semiconductor lasers capable of generating a vortex beam with a specific orbital angular momentum (OAM) order are highly attractive for applications ranging from nanoparticle manipulation, imaging and microscopy to fibre and quantum…
We present a domain decomposition-based deep learning method for solving elliptic and parabolic interface problems with discontinuous coefficients in two to ten dimensions. Our Multi-Activation Function (MAF) approach employs two…
We discuss the main features of a new optical system capable of laser action: the active complex optical network, or lasing network (LANER). The system is experimentally realized with optical fibers linked each other with suitable optical…
The detection of ultrafast optical and radio-frequency (RF) signals is crucial for applications ranging from high-speed communications to advanced sensing. However, conventional detectors are fundamentally constrained by their intrinsic…
Activation functions are non-linearities in neural networks that allow them to learn complex mapping between inputs and outputs. Typical choices for activation functions are ReLU, Tanh, Sigmoid etc., where the choice generally depends on…
Optical computing could reduce the energy cost of artificial intelligence by leveraging the parallelism and propagation speed of light. However, implementing nonlinear activation, essential for machine learning, remains challenging in…
In this work, we examine the approximation capabilities of deep neural networks utilizing the Rectified Quadratic Unit (ReQU) activation function, defined as \(\max(0,x)^2\), for approximating H\"older-regular functions with respect to the…
We report a mode-locked Ti:sapphire femtosecond laser with 5GHz repetition rate. Spectral broadening of the 24 fs pulses in a microstructured fiber yields an octave-spanning spectrum and permits self-referencing and active stabilization of…
Optical Flow (OF) is the movement pattern of pixels or edges that is caused in a visual scene by the relative motion between an agent and a scene. OF is used in a wide range of computer vision algorithms and robotics applications. While the…
A tapered semiconductor amplifier is injection seeded by a femtosecond optical frequency comb at 780 nm from a mode-locked Ti:sapphire laser. Energy gains over 17 dB (12 dB) are obtained for 1 mW (20 mW) of average input power when the…