English
Related papers

Related papers: An O(log N) Parallel Algorithm for Newton Step Com…

200 papers

We study finite-sum non-convex optimization $\min_{x\in\mathbb{R}^d} F(x) \;=\; \frac{1}{n}\sum_{i=1}^n f_i(x)$ and analyze a variance-reduced cubic Newton method based on EMA-smoothed SARAH estimators for both gradient and Hessian…

Optimization and Control · Mathematics 2026-04-28 Dmitry Pasechnyuk-Vilensky , Dmitry Kamzolov , Martin Takáč

Real-world three-phase microgrids face two interconnected challenges: 1. time-varying uncertainty from renewable generation and demand, and 2. persistent phase imbalances caused by uneven distributed energy resources DERs, load asymmetries,…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Pablo Cortés , Alejandra Tabares , Fredy Franco

Subspace-based signal processing techniques, such as the Estimation of Signal Parameters via Rotational Invariant Techniques (ESPRIT) algorithm, are popular methods for spectral estimation. These algorithms can achieve the so-called…

Information Theory · Computer Science 2024-10-29 Zhiyan Ding , Ethan N. Epperly , Lin Lin , Ruizhe Zhang

We propose an inexact infeasible arc-search interior-point method for solving linear optimization problems. The method combines an arc-search strategy with inexact solutions to Newton systems and admits a polynomial iteration complexity…

Optimization and Control · Mathematics 2026-01-08 Einosuke Iida , Makoto Yamashita

In this paper, a globally convergent Newton-type proximal gradient method is developed for composite multi-objective optimization problems where each objective function can be represented as the sum of a smooth function and a nonsmooth…

Optimization and Control · Mathematics 2024-10-25 Md Abu Talhamainuddin Ansary

A Newton-type active set algorithm for large-scale minimization subject to polyhedral constraints is proposed. The algorithm consists of a gradient projection step, a second-order Newton-type step in the null space of the constraint matrix,…

Optimization and Control · Mathematics 2021-01-12 William W. Hager , Davoud Ataee Tarzanagh

We present complexity and numerical results for a new asynchronous parallel algorithmic method for the minimization of the sum of a smooth nonconvex function and a convex nonsmooth regularizer, subject to both convex and nonconvex…

Optimization and Control · Mathematics 2017-01-23 Loris Cannelli , Francisco Facchinei , Vyacheslav Kungurtsev , Gesualdo Scutari

We present a unified probabilistic framework for simultaneous trajectory estimation and planning (STEAP). Estimation and planning problems are usually considered separately, however, within our framework we show that solving them…

Robotics · Computer Science 2018-07-30 Mustafa Mukadam , Jing Dong , Frank Dellaert , Byron Boots

Hamiltonian Monte Carlo (HMC) and related algorithms have become routinely used in Bayesian computation. In this article, we present a simple and provably accurate method to improve the efficiency of HMC and related algorithms with…

Computation · Statistics 2020-03-10 Akihiko Nishimura , David Dunson

Proximal methods are known to identify the underlying substructure of nonsmooth optimization problems. Even more, in many interesting situations, the output of a proximity operator comes with its structure at no additional cost, and…

Optimization and Control · Mathematics 2023-02-10 Gilles Bareilles , Franck Iutzeler , Jérôme Malick

Imprecise measurements of a point set P = (p1, ..., pn) can be modelled by a family of regions F = (R1, ..., Rn), where each imprecise region Ri contains a unique point pi. A retrieval models an accurate measurement by replacing an…

Computational Geometry · Computer Science 2025-12-09 Sarita de Berg , Ivor van der Hoog , Eva Rotenberg , Daniel Rutschmann , Sampson Wong

The present paper is concerned with a recursive algorithm as a preprocessing step to find the convex hull of $n$ random points uniformly distributed in the plane. For such a set of points, it is shown that eliminating all but $O(\log n)$ of…

Data Structures and Algorithms · Computer Science 2024-03-19 Mohammad Heydari , Ashkan Khalifeh

In this paper, we consider the implications of the fact that parallel raw-power can be exploited by a generic Metropolis--Hastings algorithm if the proposed values are independent. In particular, we present improvements to the independent…

Computation · Statistics 2015-03-17 Pierre Jacob , Christian P. Robert , Murray H. Smith

Randomized parallel algorithms for many fundamental problems achieve optimal linear work in expectation, but upgrading this guarantee to hold with high probability (whp) remains a recurring theoretical challenge. In this paper, we address…

Data Structures and Algorithms · Computer Science 2026-03-03 Chase Hutton , Adam Melrod

Motion planning is a key aspect of robotics. A common approach to address motion planning problems is trajectory optimization. Trajectory optimization can represent the high-level behaviors of robots through mathematical formulations.…

Robotics · Computer Science 2024-08-21 Fatemeh Rastgar

Delaunay Triangulation(DT) is one of the important geometric problems that is used in various branches of knowledge such as computer vision, terrain modeling, spatial clustering and networking. Kinetic data structures have become very…

Computational Geometry · Computer Science 2023-08-15 Nazanin Hadiniya , Mohammad Ghodsi

This study proposes a Newton based multiple objective optimization algorithm for hyperparameter search. The first order differential (gradient) is calculated using finite difference method and a gradient matrix with vectorization is formed…

Optimization and Control · Mathematics 2024-01-09 Qinwu Xu

The study of approximate matching in the Massively Parallel Computations (MPC) model has recently seen a burst of breakthroughs. Despite this progress, however, we still have a far more limited understanding of maximal matching which is one…

Data Structures and Algorithms · Computer Science 2023-10-17 Soheil Behnezhad , MohammadTaghi Hajiaghayi , David G. Harris

Optimizing smooth convex functions in stochastic settings, where only noisy estimates of gradients and Hessians are available, is a fundamental problem in optimization. While first-order methods possess a low per-iteration cost, their…

Statistics Theory · Mathematics 2026-02-06 Antoine Godichon-Baggioni , Bruno Portier , Guillaume Sallé

In this work we study quantum algorithms for Hopcroft's problem which is a fundamental problem in computational geometry. Given $n$ points and $n$ lines in the plane, the task is to determine whether there is a point-line incidence. The…

Quantum Physics · Physics 2024-05-03 Vladimirs Andrejevs , Aleksandrs Belovs , Jevgēnijs Vihrovs