English
Related papers

Related papers: Newton Nonholonomic Source Seeking for Distance-De…

200 papers

This paper investigates the sparse phase retrieval problem, which aims to recover a sparse signal from a system of quadratic measurements. In this work, we propose a novel non-convex algorithm, termed Gradient Hard Thresholding Pursuit…

Numerical Analysis · Mathematics 2025-02-18 Licheng Dai , Xiliang Lu , Juntao You

Our proposal is on a new stochastic optimizer for non-convex and possibly non-smooth objective functions typically defined over large dimensional design spaces. Towards this, we have tried to bridge noise-assisted global search and faster…

Machine Learning · Computer Science 2025-03-03 Uttam Suman , Mariya Mamajiwala , Mukul Saxena , Ankit Tyagi , Debasish Roy

We propose a novel linesearch variant of the trust region normal map-based semismooth Newton method developed in [Ouyang and Milzarek, Math. Program. 212(1-2), 389--435 (2025)] for solving a class of nonsmooth, nonconvex composite-type…

Optimization and Control · Mathematics 2026-02-16 Hanfeng Zeng , Wenqing Ouyang , Andre Milzarek

In this paper we consider the problem of localizing a set of broadband sources from a finite window of measurements. In the case of narrowband sources this can be reduced to the problem of spectral line estimation, where our goal is simply…

Signal Processing · Electrical Eng. & Systems 2022-10-24 Coleman DeLude , Rakshith Sharma , Santhosh Karnik , Christopher Hood , Mark Davenport , Justin Romberg

This paper concerns applications of a recently-developed output-tracking technique to trajectory control of autonomous vehicles. The technique is based on three principles: Newton-Raphson flow for solving algebraic equations,output…

Systems and Control · Computer Science 2019-03-07 Shashwat Shivam , Ian Buckley , Yorai Wardi , Carla Seatzu , Magnus Egerstedt

Environment perception, including object detection and distance estimation, is one of the most crucial tasks for autonomous driving. Many attentions have been paid on the object detection task, but distance estimation only arouse few…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Jing Zhu , Yi Fang , Husam Abu-Haimed , Kuo-Chin Lien , Dongdong Fu , Junli Gu

Newton's method for polynomial root finding is one of mathematics' most well-known algorithms. The method also has its shortcomings: it is undefined at critical points, it could exhibit chaotic behavior and is only guaranteed to converge…

Numerical Analysis · Mathematics 2020-03-03 Bahman Kalantari

Second-order methods are provably faster than first-order methods, and their efficient implementations for large-scale optimization problems have attracted significant attention. Yet, optimization problems in ML often have nonsmooth…

Optimization and Control · Mathematics 2026-02-10 Amal Alphonse , Pavel Dvurechensky , Clemens Sirotenko

In this paper we develop convergence and acceleration theory for Anderson acceleration applied to Newton's method for nonlinear systems in which the Jacobian is singular at a solution. For these problems, the standard Newton algorithm…

Numerical Analysis · Mathematics 2023-10-27 Matt Dallas , Sara Pollock

A method for locating first order saddle points on the energy surface of a magnetic system is described and several applications presented where the mechanism of various magnetic transitions is identified. The starting point for the…

Computational Physics · Physics 2025-01-17 Hendrik Schrautzer , Moritz Sallermann , Pavel F. Bessarab , Hannes Jónsson

Minimizing loss functions is central to machine-learning training. Although first-order methods dominate practical applications, higher-order techniques such as Newton's method can deliver greater accuracy and faster convergence, yet are…

Machine Learning · Computer Science 2025-11-25 Giuseppe Carrino , Elena Loli Piccolomini , Elisa Riccietti , Theo Mary

Second-order methods for neural network optimization have several advantages over methods based on first-order gradient descent, including better scaling to large mini-batch sizes and fewer updates needed for convergence. But they are…

Machine Learning · Computer Science 2017-12-21 Huishuai Zhang , Caiming Xiong , James Bradbury , Richard Socher

We introduce a new second order stochastic algorithm to estimate the entropically regularized optimal transport cost between two probability measures. The source measure can be arbitrary chosen, either absolutely continuous or discrete,…

Statistics Theory · Mathematics 2022-03-03 Bernard Bercu , Jérémie Bigot , Sébastien Gadat , Emilia Siviero

This paper develops an accurate, efficient filter (called the `TT filter') for tracking multiple targets using a spatially-distributed network of amplitude sensors that estimate distance but not direction. Several innovations are included…

Systems and Control · Electrical Eng. & Systems 2020-09-18 Christopher Thron , Khoi Tran , Joseph Raquepas

The purpose of this work is to investigate root finding problems defined on (quasi-)metric spaces, and ranging in Euclidean spaces. The motivation for this line of inquiry stems from recent models in biology and phylogenetics, where…

Optimization and Control · Mathematics 2025-10-28 Titus Pinta

We present a derivative-based algorithm for nonlinearly constrained optimization problems that is tolerant of inaccuracies in the data. The algorithm solves a semi-smooth set of nonlinear equations that are equivalent to the first-order…

Optimization and Control · Mathematics 2017-09-21 Jason E. Hicken , Pengfei Meng , Alp Dener

Hard-thresholding-based algorithms have seen various advantages for sparse optimization in controlling the sparsity and allowing for fast computation. Recent research shows that when techniques of the Newton-type methods are integrated,…

Optimization and Control · Mathematics 2022-11-11 Shenglong Zhou

We develop several new communication-efficient second-order methods for distributed optimization. Our first method, NEWTON-STAR, is a variant of Newton's method from which it inherits its fast local quadratic rate. However, unlike Newton's…

Machine Learning · Computer Science 2021-02-16 Rustem Islamov , Xun Qian , Peter Richtárik

A damped Newton's method to find a singularity of a vector field in Riemannian setting is presented with global convergence study. It is ensured that the sequence generated by the proposed method reduces to a sequence generated by the…

Optimization and Control · Mathematics 2018-07-20 M. A. A. Bortoloti , T. A. Fernandes , O. P. Ferreira , Jinyun Yuan

This work discusses a novel method for estimating the location of a gas source based on spatially distributed concentration measurements taken, e.g., by a mobile robot or flying platform that follows a predefined trajectory to collect…

Machine Learning · Computer Science 2024-05-08 Victor Scott Prieto Ruiz , Patrick Hinsen , Thomas Wiedemann , Constantin Christof , Dmitriy Shutin