English
Related papers

Related papers: Adaptative Step Size Selection for Homotopy Method…

200 papers

We study the cost of multiplication modulo triangular families of polynomials. Following previous work by Li, Moreno Maza and Schost, we propose an algorithm that relies on homotopy and fast evaluation-interpolation techniques. We obtain a…

Symbolic Computation · Computer Science 2009-01-26 Alin Bostan , Muhammad Chowdhury , Joris van der Hoeven , Eric Schost

A reparametrization (of a continuous path) is given by a surjective weakly increasing self-map of the unit interval. We show that the monoid of reparametrizations (with respect to compositions) can be understood via ``stop-maps'' that allow…

General Topology · Mathematics 2007-06-26 Martin Raussen , Ulrich Fahrenberg

In this work, we propose new adaptive step size strategies that improve several stochastic gradient methods. Our first method (StoPS) is based on the classical Polyak step size (Polyak, 1987) and is an extension of the recent development of…

Machine Learning · Computer Science 2022-08-11 Samuel Horváth , Konstantin Mishchenko , Peter Richtárik

We consider stochastic zero-order optimization problems, which arise in settings from simulation optimization to reinforcement learning. We propose an adaptive sampling quasi-Newton method where we estimate the gradients of a stochastic…

Optimization and Control · Mathematics 2019-10-31 Raghu Bollapragada , Stefan M. Wild

We present a family of distributed forward-backward methods with variable stepsizes to find a solution of structured monotone inclusion problems. The framework is constructed by means of relocated fixed-point iterations, extending the…

Optimization and Control · Mathematics 2026-01-23 Felipe Atenas , Minh N. Dao , Matthew K. Tam

We introduce and study the complexity of Path Packing. Given a graph $G$ and a list of paths, the task is to embed the paths edge-disjoint in $G$. This generalizes the well known Hamiltonian-Path problem. Since Hamiltonian Path is…

Computational Complexity · Computer Science 2019-10-02 Jan Dreier , Janosch Fuchs , Tim A. Hartmann , Philipp Kuinke , Peter Rossmanith , Bjoern Tauer , Hung-Lung Wang

We present a Monte Carlo method that allows efficient and unbiased sampling of Hamiltonian walks on a cubic lattice. Such walks are self-avoiding and visit each lattice site exactly once. They are often used as simple models of globular…

Statistical Mechanics · Physics 2013-05-29 Jesper Lykke Jacobsen

Sparse coding is typically solved by iterative optimization techniques, such as the Iterative Shrinkage-Thresholding Algorithm (ISTA). Unfolding and learning weights of ISTA using neural networks is a practical way to accelerate estimation.…

Machine Learning · Statistics 2019-05-28 Pierre Ablin , Thomas Moreau , Mathurin Massias , Alexandre Gramfort

Let $\K$ be a field of characteristic zero and $\Kbar$ be an algebraic closure of $\K$. Consider a sequence of polynomials$G=(g\_1,\dots,g\_s)$ in $\K[X\_1,\dots,X\_n]$, a polynomial matrix $\F=[f\_{i,j}] \in \K[X\_1,\dots,X\_n]^{p \times…

Symbolic Computation · Computer Science 2018-03-01 Jonathan D. Hauenstein , Mohab Safey El Din , Éric Schost , Thi Xuan Vu

For solving constrained (pseudo)-monotone variational inequality, we prove that the upper bound of stepsize $\frac{1}{2L}$ established for the Popov's algorithm and the forward-reflected-backward algorithm is tight. For unconstrained case,…

Optimization and Control · Mathematics 2026-03-09 Nhung Hong Nguyen , Thanh Quoc Trinh , Phan Tu Vuong

A method for solving zero-finding problems is developed by tracking homotopy paths, which define connecting channels between an auxiliary problem and the objective problem. Current algorithms' success highly relies on empirical knowledge,…

Optimization and Control · Mathematics 2021-08-24 Yang Wang , Francesco Topputo

In this paper, we introduce a Gauss-Newton method for solving the complex phase retrieval problem. In contrast to the real-valued setting, the Gauss-Newton matrix for complex-valued signals is rank-deficient and, thus, non-invertible. To…

Numerical Analysis · Mathematics 2024-06-17 Meng Huang

We propose an adaptive accelerated gradient method for solving smooth convex optimization problems. The method incorporates a scheme to determine the step size adaptively, by means of a local estimation of the smoothness constant, which is…

Optimization and Control · Mathematics 2025-12-24 Zepeng Wang , Juan Peypouquet

The homotopy analysis method known from its successful applications to obtain quasi-analytical approximations of solutions of ordinary and partial differential equations is applied to stochastic differential equations with Gaussian…

Statistical Mechanics · Physics 2014-10-08 Maciej Janowicz , Filip Krzyżewski , Joanna Kaleta , Marian Rusek , Arkadiusz Orłowski

When solving the Hamiltonian path problem it seems natural to be given additional precedence constraints for the order in which the vertices are visited. For example one could decide whether a Hamiltonian path exists for a fixed starting…

Discrete Mathematics · Computer Science 2025-02-28 Jesse Beisegel , Fabienne Ratajczak , Robert Scheffler

The reciprocal square root is an important computation for which many sophisticated algorithms exist (see for example \cite{Moroz,863046,863031} and the references therein). A common theme is the use of Newton's method to refine the…

Numerical Analysis · Mathematics 2021-12-30 Carlos F. Borges

In this article, we consider nonlinear complementarity problem. We introduce a new homotopy function for finding the solution of nonlinear complementarity problem through the trajectory . We show that the homotopy path approaching the…

Optimization and Control · Mathematics 2022-09-02 A. Dutta , A. K. Das

Traditional force-controlled bipedal walking utilizes highly bent knees, resulting in high torques as well as inefficient, and unnatural motions. Even with advanced planning of center of mass height trajectories, significant amounts of…

Robotics · Computer Science 2019-08-01 Robert J. Griffin , Sylvain Bertrand , Georg Wiedebach , Alexander Leonessa , Jerry Pratt

The homotopy analysis method is studied in the present paper. The question of convergence of the homotopy analysis method is resolved. It is proven that under a special constraint the homotopy analysis method does converge to the exact…

Mathematical Physics · Physics 2010-06-24 Mustafa Turkyilmazoglu

We provide a numerically robust and fast method capable of exploiting the local geometry when solving large-scale stochastic optimisation problems. Our key innovation is an auxiliary variable construction coupled with an inverse Hessian…

Machine Learning · Statistics 2018-02-14 Adrian Wills , Thomas Schön