Related papers: IFOHAM-an iterative algorithm based on the first-o…

First order shape optimization methods, in general, require a large number of iterations until they reach a locally optimal design. While higher order methods can significantly reduce the number of iterations, they exhibit only local…

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Graphical models have found widespread applications in many areas of modern statistics and machine learning. Iterative Proportional Fitting (IPF) and its variants have become the default method for undirected graphical model estimation, and…

A new non-perturbative approach is proposed to solve time-independent Schr\"{o}dinger equations in quantum mechanics and chromodynamics (QCD). It is based on the homotopy analysis method (HAM), which was developed by the author for highly…

A step-search sequential quadratic programming method is proposed for solving nonlinear equality constrained stochastic optimization problems. It is assumed that constraint function values and derivatives are available, but only stochastic…

Given an approximation to a multiple isolated solution of a polynomial system of equations, we have provided a symbolic-numeric deflation algorithm to restore the quadratic convergence of Newton's method. Using first-order derivatives of…

In this paper, we investigate a new extragradient algorithm for solving pseudomonotone equilibrium problems on Hadamard manifolds. The algorithm uses a variable stepsize which is updated at each iteration and based on some previous…

Dirac $\delta-$ distributionally sourced differential equations emerge in many dynamical physical systems from machine learning, finance, neuroscience, and seismology to black hole perturbation theory. These systems lack exact analytical…

Iterative Filtering (IF) is an alternative technique to the Empirical Mode Decomposition (EMD) algorithm for the decomposition of non-stationary and non-linear signals. Recently in [1] IF has been proved to be convergent for any $L^2$…

Implicit inverse problems, in which noisy observations of a physical quantity are used to infer a nonlinear functional applied to an associated function, are inherently ill posed and often exhibit non uniqueness of solutions. Such problems…

We present a generalized version of the ITIM algorithm for the identification of interfacial molecules, which is able to treat arbitrarily shaped interfaces. The algorithm exploits the similarities between the concept of probe sphere used…

Holographic search algorithms such as direct search and simulated annealing allow high-quality holograms to be generated at the expense of long execution times. This is due to single iteration computational costs of $O(N_x N_y)$ and number…

In this paper we construct high order numerical methods for solving third and fourth orders nonlinear functional differential equations (FDE). They are based on the discretization of iterative methods on continuous level with the use of the…

In this paper we apply the Fast Iterative Method (FIM) for solving general Hamilton-Jacobi-Bellman (HJB) equations and we compare the results with an accelerated version of the Fast Sweeping Method (FSM). We find that FIM can be indeed used…

Here we present an efficient method for finding and using a nonlocal symmetry admitted by a rational second order ordinary differential equation (rational 2ODE) in order to find a Liouvillian first integral (belonging to a vast class of…

The purpose of this paper is to give a convergence analysis of the iterative scheme: \bee u_n^\dl=qu_{n-1}^\dl+(1-q)T_{a_n}^{-1}K^*f_\dl,\quad u_0^\dl=0,\eee where $T:=K^*K,\quad T_a:=T+aI,\quad q\in(0,1),\quad a_n:=\alpha_0q^n,…

In this paper, we propose and investigate a novel memory architecture for neural networks called Hierarchical Attentive Memory (HAM). It is based on a binary tree with leaves corresponding to memory cells. This allows HAM to perform memory…

Nonresonant Hopf-Hopf singularity in neutral functional differential equation (NFDE) is considered. An algorithm for calculating the third-order normal form is established by using the formal adjoint theory, center manifold theorem and the…

We devise and evaluate numerically a Hybrid High-Order (HHO) method for incremental associative plasticity with small deformations. The HHO method uses as discrete unknowns piecewise polynomials of order $k\ge1$ on the mesh skeleton,…

A variety of complex biological, natural and man-made systems exhibit non-Markovian dynamics that can be modeled through fractional order differential equations, yet, we lack sample comlexity aware system identification strategies. Towards…