English
Related papers

Related papers: An O(log N) Parallel Algorithm for Newton Step Com…

200 papers

In this paper, we consider a recursive estimation problem for linear regression where the signal to be estimated admits a sparse representation and measurement samples are only sequentially available. We propose a convergent parallel…

Optimization and Control · Mathematics 2017-12-12 Yang Yang , Mengyi Zhang , Marius Pesavento , Daniel P. Palomar

In this paper, a restricted memory quasi-Newton bundle method for minimizing a locally Lipschitz continuous function over a Riemannian manifold is proposed. The curvature information of the objective function is approximated by applying a…

Optimization and Control · Mathematics 2026-05-04 Chunming Tang , Shajie Xing , Wen Huang , Jinbao Jian

Quasi-Newton methods are widely used for solving convex optimization problems due to their ease of implementation, practical efficiency, and strong local convergence guarantees. However, their global convergence is typically established…

Optimization and Control · Mathematics 2025-08-28 Artem Agafonov , Vladislav Ryspayev , Samuel Horváth , Alexander Gasnikov , Martin Takáč , Slavomir Hanzely

Many important geometric estimation problems take the form of synchronization over the special Euclidean group: estimate the values of a set of poses given a set of relative measurements between them. This problem is typically formulated as…

Robotics · Computer Science 2017-02-07 David M. Rosen , Luca Carlone , Afonso S. Bandeira , John J. Leonard

We propose a novel quantum algorithm for solving linear optimization problems by quantum-mechanical simulation of the central path. While interior point methods follow the central path with an iterative algorithm that works with successive…

Quantum Physics · Physics 2024-10-17 Brandon Augustino , Jiaqi Leng , Giacomo Nannicini , Tamás Terlaky , Xiaodi Wu

Most existing work uses dual decomposition and subgradient methods to solve Network Utility Maximization (NUM) problems in a distributed manner, which suffer from slow rate of convergence properties. This work develops an alternative…

Optimization and Control · Mathematics 2015-03-17 Ermin Wei , Asuman Ozdaglar , Ali Jadbabaie

This work introduces a moving anchor acceleration technique to extragradient algorithms for smooth structured minimax problems. The moving anchor is introduced as a generalization of the original algorithmic anchoring framework, i.e. the…

Optimization and Control · Mathematics 2025-06-03 James K. Alcala , Yat Tin Chow , Mahesh Sunkula

In the context of Markov decision processes running in continuous time, one of the most intriguing challenges is the efficient approximation of finite horizon reachability objectives. A multitude of sophisticated model checking algorithms…

Systems and Control · Computer Science 2015-08-03 Yuliya Butkova , Hassan Hatefi , Holger Hermanns , Jan Krcal

Continuum robots, made from flexible materials with continuous backbones, have several advantages over traditional rigid robots. Some of them are the ability to navigate through narrow or confined spaces, adapt to irregular or changing…

Robotics · Computer Science 2023-08-09 Hend Abdelaziz , Ayman Nada , Hiroyuki Ishii , Haitham El-Hussieny

Motivated by recent advances in serverless cloud computing, in particular the "function as a service" (FaaS) model, we consider the problem of minimizing a convex function in a massively parallel fashion, where communication between workers…

Optimization and Control · Mathematics 2024-10-03 Elad Romanov , Fangzhao Zhang , Mert Pilanci

Matrix completion is the problem of recovering a low rank matrix by observing a small fraction of its entries. A series of recent works [KOM12,JNS13,HW14] have proposed fast non-convex optimization based iterative algorithms to solve this…

Numerical Analysis · Computer Science 2014-11-06 Prateek Jain , Praneeth Netrapalli

In this work, we present a globalized stochastic semismooth Newton method for solving stochastic optimization problems involving smooth nonconvex and nonsmooth convex terms in the objective function. We assume that only noisy gradient and…

Optimization and Control · Mathematics 2018-03-12 Andre Milzarek , Xiantao Xiao , Shicong Cen , Zaiwen Wen , Michael Ulbrich

We study a class of monotone inclusions called "self-concordant inclusion" which covers three fundamental convex optimization formulations as special cases. We develop a new generalized Newton-type framework to solve this inclusion. Our…

Optimization and Control · Mathematics 2017-07-25 Quoc Tran-Dinh , Tianxiao Sun , Shu Lu

Convex hulls are a fundamental geometric tool used in a number of algorithms. A famous paper by Akl and Toussaint in 1978 described a way to reduce the number of points involved in the computation, which is since known as the Akl-Toussaint…

Computational Geometry · Computer Science 2013-04-10 Jean Souviron

Mutual exclusion (ME) is one of the most commonly used techniques to handle conflicts in concurrent systems. Traditionally, mutual exclusion algorithms have been designed under the assumption that a process does not fail while…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-04 Sahil Dhoked , Neeraj Mittal

The Metropolis-Hastings algorithm allows one to sample asymptotically from any probability distribution $\pi$. There has been recently much work devoted to the development of variants of the MH update which can handle scenarios where such…

Computation · Statistics 2018-03-28 Christophe Andrieu , Arnaud Doucet , Sinan Yıldırım , Nicolas Chopin

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

Recently, the predicate detection problem was shown to be in the parallel complexity class NC. In this paper, we give the first work-optimal parallel algorithm to solve the predicate detection problem on a distributed computation with $n$…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-03 Rohan Garg

Pseudo-arclength continuation is a well-established method for generating a numerical curve approximating the solution of an underdetermined system of nonlinear equations. It is an inherently sequential predictor-corrector method in which…

Numerical Analysis · Mathematics 2013-12-13 Dhavide Aruliah , Lennaert van Veen , Alex Dubitski

When globally optimal solutions of complicated optimization problems cannot be located by evolutionary algorithms (EAs) in polynomial expected running time, the hitting time/running time analysis is not flexible enough to accommodate the…

Neural and Evolutionary Computing · Computer Science 2020-12-01 Cong Wang , Yu Chen , Jun He , Chengwang Xie