Related papers: LULU operators for functions of continuous argumen…
We describe the supports of a class of real-valued maps on $C*(X)$ introduced by Radul. Using this description, a characterization of compact-valued retracts of a given space in terms of functional extenders is obtained. For example, if…
We propose \textbf{ULU}, a novel non-monotonic, piecewise activation function defined as $\{f(x;\alpha_1),x<0; f(x;\alpha_2),x>=0 \}$, where $f(x;\alpha)=0.5x(tanh(\alpha x)+1),\alpha >0$. ULU treats positive and negative inputs…
We start with a realisation of a Lie algebra with the basis operators $L=\langle Q_m\rangle$, $Q_m=\zeta_{mj}(x_i)\partial_{x_j}$, where $x_i$ are some variables that may be regarded as dependent or independent in construction of some…
The classical $L^2$ estimate for the $\overline{\partial}$ operators is a basic tool in complex analysis of several variables. Naturally, it is expected to extend this estimate to infinite dimensional complex analysis, but this is a…
Eigenvalues of the Lam\'e operator are studied as complex-analytic functions in period $\tau$ of an elliptic function. We investigate the branching of eigenvalues numerically and clarify the relationship between the branching of eigenvalues…
We provide a numerical method to determine the critical lengths of linear differential operators with constant real coefficients. The need for such a procedure arises when the orders increase. The interest of this article is clearly on the…
In this paper we study continuous semigroups of positive operators on general vector lattices equipped with the relative uniform topology $\tau_{ru}$. We introduce the notions of strong continuity with respect to $\tau_{ru}$ and relative…
In this note, we consider the space of all continuous operators with respect to the unbounded topology on locally solid vector lattices. We investigate whether this space forms a band. In addition, we look into some situations under which,…
Our work proposes a novel approach to designing activation functions by focusing on their gradients and deriving the corresponding activation functions using integration. We introduce the Expanded Integral of the Exponential Linear Unit…
This study is an attempt at generalizing the class of partially hypoelliptic differential operators to a class of pseudodifferential operators, Symbol ideals are formed on the set of lineality and we discuss suitable topologies that allow…
Linear temporal logic (LTL) is a specification language for finite sequences (called traces) widely used in program verification, motion planning in robotics, process mining, and many other areas. We consider the problem of learning LTL…
Activation functions are essential to introduce nonlinearity into neural networks, with the Rectified Linear Unit (ReLU) often favored for its simplicity and effectiveness. Motivated by the structural similarity between a shallow…
We study infinite order differential operators acting in the spaces of exponential type entire functions. We derive conditions under which such operators preserve the set of Laguerre entire functions which consists of the polynomials…
Activation functions play a key role in providing remarkable performance in deep neural networks, and the rectified linear unit (ReLU) is one of the most widely used activation functions. Various new activation functions and improvements on…
In this paper, we characterize complementable operators and provide more precise expressions for the Schur complement of these operators using a single Douglas solution. We demonstrate the existence of subspaces where the given operator is…
This article proposed a new approach to the determination of the spectrum for nonlinear continuous operators in the Banach spaces and using it investigated the spectrum of some classes of operators. Here shows that in nonlinear operators…
This paper investigates the ability of finite samples to identify two-layer irreducible shallow networks with various nonlinear activation functions, including rectified linear units (ReLU) and analytic functions such as the logistic…
For some time now, conformal field theories in two dimensions have been studied as integrable systems. Much of the success of these studies is related to the existence of an operator algebra of the theory. In this paper, some of the…
Rectified Linear Units (ReLU) seem to have displaced traditional 'smooth' nonlinearities as activation-function-du-jour in many - but not all - deep neural network (DNN) applications. However, nobody seems to know why. In this article, we…
We study the Rectified Linear Unit (ReLU) dual, an existing dual formulation for stochastic programs that reformulates non-anticipativity constraints using ReLU functions to generate tight, non-convex, and mixed-integer representable cuts.…