A Generalization Method of Partitioned Activation Function for Complex Number
Neural and Evolutionary Computing
2018-02-09 v1 Artificial Intelligence
Complex Variables
Abstract
A method to convert real number partitioned activation function into complex number one is provided. The method has 4em variations; 1 has potential to get holomorphic activation, 2 has potential to conserve complex angle, and the last 1 guarantees interaction between real and imaginary parts. The method has been applied to LReLU and SELU as examples. The complex number activation function is an building block of complex number ANN, which has potential to properly deal with complex number problems. But the complex activation is not well established yet. Therefore, we propose a way to extend the partitioned real activation to complex number.
Cite
@article{arxiv.1802.02987,
title = {A Generalization Method of Partitioned Activation Function for Complex Number},
author = {HyeonSeok Lee and Hyo Seon Park},
journal= {arXiv preprint arXiv:1802.02987},
year = {2018}
}
Comments
Complex Activation Function, Holomorphic, Phase-preserving, real-complex interaction