English
Related papers

Related papers: On two families of iterative methods without memor…

200 papers

First-order methods for solving convex optimization problems have been at the forefront of mathematical optimization in the last 20 years. The rapid development of this important class of algorithms is motivated by the success stories…

Optimization and Control · Mathematics 2021-01-07 Pavel Dvurechensky , Mathias Staudigl , Shimrit Shtern

We construct six infinite series of families of pairs of curves (X,Y) of arbitrarily high genus, defined over number fields, together with an explicit isogeny from the Jacobian of X to the Jacobian of Y splitting multiplication by 2, 3, or…

Number Theory · Mathematics 2019-02-20 Benjamin Smith

Recently Ahmadi et al. (2021) and Tagliaferro (2022) proposed some iterative methods for the numerical solution of linear systems which, under the classical hypothesis of strict diagonal dominance, typically converge faster than the Jacobi…

Numerical Analysis · Mathematics 2024-04-11 Paolo Novati , Fulvio Tagliaferro , Marino Zennaro

In this paper, we provide an overview of first-order and second-order variants of the gradient descent method that are commonly used in machine learning. We propose a general framework in which 6 of these variants can be interpreted as…

Machine Learning · Computer Science 2021-08-17 Thomas Pierrot , Nicolas Perrin , Olivier Sigaud

Starting from an A-stable rational approximation to $\rm{e}^z$ of order $p$, $$r(z)= 1+ z+ \cdots + z^p/ p! + O(z^{p+1}),$$ families of stable methods are proposed to time discretize abstract IVP's of the type $u'(t) = A u(t) + f(t)$. These…

Numerical Analysis · Mathematics 2024-10-16 Carlos Arranz-Simón , Cesar Palencia

In this paper we study the convergence of Newton-Raphson method. For this method there exists some convergence results which are practically not very useful and just guarantee the convergence of this method when the first term of this…

General Mathematics · Mathematics 2021-12-10 Hassan Khandani

The initialization of equation-based differential-algebraic system models, and more in general the solution of many engineering and scientific problems, require the solution of systems of nonlinear equations. Newton-Raphson's method is…

Numerical Analysis · Mathematics 2021-02-22 Francesco Casella , Bernhard Bachmann

The success of machine learning methods heavily relies on having an appropriate representation for data at hand. Traditionally, machine learning approaches relied on user-defined heuristics to extract features encoding structural…

Machine Learning · Statistics 2018-10-29 Ming Yu , Zhuoran Yang , Tuo Zhao , Mladen Kolar , Zhaoran Wang

We propose and analyse a 2-parameter family of 2-player games on two heaps of tokens, and present a strategy based on a class of sequences. The strategy looks easy, but is actually hard. A class of exotic numeration systems is then used,…

Combinatorics · Mathematics 2007-05-23 Aviezri S. Fraenkel

We obtain solutions to the recursive sequences of the form $$x_{n + 1} = \frac{x_{n - 3}x_{n }}{x_{n - 2}(a_n + b_nx_{n -3}x_{n})}$$ where $a_n$ and $b_n$ are arbitrary sequences of real numbers, and the initial values are gives as;…

Dynamical Systems · Mathematics 2019-02-19 Mensah Folly-Gbetoula , Darlison Nyirenda

We present a simple yet powerful technique for forming iterative methods of various convergence orders. Methods of various convergence orders (four, six, eight and ten) are formed through a modest modification of the classical Newton…

Numerical Analysis · Mathematics 2009-12-22 Sanjay Kumar Khattri

In this work, we develop first-order (Hessian-free) and zero-order (derivative-free) implementations of the Cubically regularized Newton method for solving general non-convex optimization problems. For that, we employ finite difference…

Optimization and Control · Mathematics 2023-09-06 Nikita Doikov , Geovani Nunes Grapiglia

We develop a novel, fundamental and surprisingly simple randomized iterative method for solving consistent linear systems. Our method has six different but equivalent interpretations: sketch-and-project, constrain-and-approximate, random…

Numerical Analysis · Mathematics 2016-01-07 Robert M. Gower , Peter Richtárik

One-parameter natural exponential family (NEF) plays fundamental roles in probability and statistics. This article contains two independent results: (a) A conjecture of Bar-Lev, Bshouty and Enis states that a polynomial with a simple root…

Statistics Theory · Mathematics 2018-03-05 Xiongzhi Chen

Iteration methods based on barycentric rational interpolation are derived that exhibit accelerating orders of convergence. For univariate root search, the derivative-free methods approach quadratic convergence and the first-derivative…

Numerical Analysis · Mathematics 2020-11-11 Sebastian Cassel

Hypothesis testing and other statistical inference procedures are most efficient when a reliable low-dimensional parametric family can be specified. We propose a method that learns such a family when one exists but its form is not known a…

Methodology · Statistics 2017-11-29 William Fithian , Daniel Ting

Numerical solutions for flows in partially saturated porous media pose challenges related to the non-linearity and elliptic-parabolic degeneracy of the governing Richards' equation. Iterative methods are therefore required to manage the…

Numerical Analysis · Mathematics 2024-02-02 Nicolae Suciu , Florin A. Radu , Jakob S. Stokke , Emil Cătinaş , Andra Malina

In the first part of planned series of papers the formal general solutions to selection of 80 examples of different types of second order nonlinear PDEs in two independent variables with constant parameters are given. The main goal here is…

Mathematical Physics · Physics 2008-01-29 Yu. N. Kosovtsov

We analyze families of non-autonomous systems of first-order ordinary differential equations admitting a common time-dependent superposition rule, i.e., a time-dependent map expressing any solution of each of these systems in terms of a…

Classical Analysis and ODEs · Mathematics 2011-11-22 Jose F. Carinena , Janusz Grabowski , Javier de Lucas

We present a three-point iterative method without memory for solving nonlinear equations in one variable. The proposed method provides convergence order eight with four function evaluations per iteration. Hence, it possesses a very high…

Numerical Analysis · Mathematics 2016-02-24 Gunar Matthies , Mehdi Salimi , Somayeh Sharifi , Juan Luis Varona