Related papers: Derivative of the truncated singular value and eig…
A simple theory of the covariant derivatives, deformed derivatives and relative covariant derivatives of multivector and multiform fields is presented using algebraic and analytical tools developed in previous papers.
Starting from space-discretisation of Maxwell's equations, various classical formulations are proposed for the simulation of electromagnetic fields. They differ in the phenomena considered as well as in the variables chosen for…
This paper presents a collection of useful formulas of dynamic derivatives on time scales, systematically collected for reference purposes. As an application, we define trigonometric and hyperbolic functions on time scales in such a way the…
The concept of local fractional derivative was introduced in order to be able to study the local scaling behavior of functions. However it has turned out to be much more useful. It was found that simple equations involving these operators…
We introduce a notion of fractional (noninteger order) derivative on an arbitrary nonempty closed subset of the real numbers (on a time scale). Main properties of the new operator are proved and several illustrative examples given.
In the present article, a new method for the evaluation of fractional derivatives of arbitrary real order is proposed. Numerous but inequivalent formulations have been given in the past. Some of them exhibit unsatisfactory properties such…
In this paper, some new results on the distribution of the generalized singular value decomposition (GSVD) are presented.
This report describes the computation of gradients by algorithmic differentiation for statistically optimum beamforming operations. Especially the derivation of complex-valued functions is a key component of this approach. Therefore the…
In this paper, we extend the eigenvalue method of the algebraic Riccati equation to the differential Riccati equation (DRE) in contraction analysis. One of the main results is showing that solutions to the DRE can be expressed as functions…
This contribution proposes a new formulation to efficiently compute directional derivatives of order one to fourth. The formulation is based on automatic differentiation implemented with dual numbers. Directional derivatives are particular…
We present a new algorithm for solving an eigenvalue problem for a real symmetric arrowhead matrix. The algorithm computes all eigenvalues and all components of the corresponding eigenvectors with high relative accuracy in $O(n^{2})$…
We describe a Lagrange-Newton framework for the derivation of learning rules with desirable convergence properties and apply it to the case of principal component analysis (PCA). In this framework, a Newton descent is applied to an extended…
This work concerns the distance in 2-norm from a matrix polynomial to a nearest polynomial with a specified number of its eigenvalues at specified locations in the complex plane. Perturbations are allowed only on the constant coefficient…
We investigate the automatic differentiation of dominant eigensolver where only a small proportion of eigenvalues and corresponding eigenvectors are obtained. Backpropagation through the dominant eigensolver involves solving certain…
We use the displacement operator to derive an infinite series of integer order derivatives for the Gr\"{u}nwald-Letnikov fractional derivative and show its correspondence to the Riemann-Liouville and Caputo fractional derivatives. We…
Eigendecomposition of symmetric matrices is at the heart of many computer vision algorithms. However, the derivatives of the eigenvectors tend to be numerically unstable, whether using the SVD to compute them analytically or using the Power…
The notion of a local fractional derivative (LFD) was introduced recently for functions of a single variable. LFD was shown to be useful in studying fractional differentiability properties of fractal and multifractal functions. It was…
Updating a truncated Singular Value Decomposition (SVD) is crucial in representation learning, especially when dealing with large-scale data matrices that continuously evolve in practical scenarios. Aligning SVD-based models with fast-paced…
Singular Value Decomposition (SVD) is the basic body of many statistical algorithms and few users question whether SVD is properly handling its job. SVD aims at evaluating the decomposition that best approximates a data matrix, given some…
This paper aims to define, quantify, and analyze the feature complexity that is learned by a DNN. We propose a generic definition for the feature complexity. Given the feature of a certain layer in the DNN, our method disentangles feature…