English
Related papers

Related papers: Continuation Path Learning for Homotopy Optimizati…

200 papers

Hyperparameter optimization (HPO) is generally treated as a bi-level optimization problem that involves fitting a (probabilistic) surrogate model to a set of observed hyperparameter responses, e.g. validation loss, and consequently…

Machine Learning · Computer Science 2021-10-18 Hadi S. Jomaa , Jonas Falkner , Lars Schmidt-Thieme

Imaging Inverse problems aim to reconstruct an underlying image from undersampled, coded, and noisy observations. Within the wide range of reconstruction frameworks, the unrolling algorithm is one of the most popular due to the synergistic…

Image and Video Processing · Electrical Eng. & Systems 2026-04-16 Roman Jacome , Romario Gualdrón-Hurtado , Leon Suarez-Rodriguez , Henry Arguello

Real world problems always have different multiple solutions. For instance, optical engineers need to tune the recording parameters to get as many optimal solutions as possible for multiple trials in the varied-line-spacing holographic…

Neural and Evolutionary Computing · Computer Science 2015-08-04 Ka-Chun Wong

We consider a suboptimal solution path algorithm for the Support Vector Machine. The solution path algorithm is an effective tool for solving a sequence of a parametrized optimization problems in machine learning. The path of the solutions…

Machine Learning · Computer Science 2011-05-04 Masayuki Karasuyama , Ichiro Takeuchi

Alternating-Current Optimal Power Flow (AC-OPF) is framed as a NP-hard non-convex optimization problem that solves for the most economical dispatch of grid generation given the AC-network and device constraints. Although there are no…

Optimization and Control · Mathematics 2023-08-29 Amritanshu Pandey , Aayushya Agarwal , Larry Pileggi

We consider the problem of optimal path planning in different homotopy classes in a given environment. Though important in robotics applications, path-planning with reasoning about homotopy classes of trajectories has typically focused on…

Robotics · Computer Science 2017-10-10 Subhrajit Bhattacharya , Robert Ghrist

We propose a new homotopy-based conditional gradient method for solving convex optimization problems with a large number of simple conic constraints. Instances of this template naturally appear in semidefinite programming problems arising…

Optimization and Control · Mathematics 2025-01-31 Pavel Dvurechensky , Gabriele Iommazzo , Shimrit Shtern , Mathias Staudigl

This paper shows how a class of non-convex optimization problems constrained by discretized nonlinear partial differential equations may be solved to global optimality using an interior point continuation method. The solution procedure…

Optimization and Control · Mathematics 2020-03-13 Jorn Baayen , Teresa Piovesan , Jesse VanderWees

The paper aims to propose a suitable method in finding the solution of tensor complementarity problem. The tensor complementarity problem is a subclass of nonlinear complementarity problems for which the involved function is defined by a…

Optimization and Control · Mathematics 2022-05-05 A. Dutta , Bharat Kumar , Deepmala , A. K. Das

In traditional topology optimization, the computing time required to iteratively update the material distribution within a design domain strongly depends on the complexity or size of the problem, limiting its application in real engineering…

Computational Engineering, Finance, and Science · Computer Science 2024-05-14 Gabriel Garayalde , Matteo Torzoni , Matteo Bruggi , Alberto Corigliano

Optimization problems with nonlinear cost functions and combinatorial constraints appear in many real-world applications but remain challenging to solve efficiently compared to their linear counterparts. To bridge this gap, we propose…

Machine Learning · Computer Science 2023-07-20 Aaron Ferber , Taoan Huang , Daochen Zha , Martin Schubert , Benoit Steiner , Bistra Dilkina , Yuandong Tian

In this paper we propose a primal-dual homotopy method for $\ell_1$-minimization problems with infinity norm constraints in the context of sparse reconstruction. The natural homotopy parameter is the value of the bound for the constraints…

Optimization and Control · Mathematics 2016-11-01 Christoph Brauer , Dirk A. Lorenz , Andreas M. Tillmann

Multi-agent trajectory planning requires ensuring both safety and efficiency, yet deadlocks remain a significant challenge, especially in obstacle-dense environments. Such deadlocks frequently occur when multiple agents attempt to traverse…

Robotics · Computer Science 2025-07-29 Haoze Dong , Meng Guo , Chengyi He , Zhongkui Li

Developing efficient and guaranteed nonconvex algorithms has been an important challenge in modern machine learning. Algorithms with good empirical performance such as stochastic gradient descent often lack theoretical guarantees. In this…

Machine Learning · Statistics 2017-06-15 Anima Anandkumar , Yuan Deng , Rong Ge , Hossein Mobahi

Learning to optimize (L2O) parametric approximations of AC optimal power flow (AC-OPF) solutions offers the potential for fast, reusable decision-making in real-time power system operations. However, the inherent nonconvexity of AC-OPF…

Machine Learning · Computer Science 2025-11-18 Shimiao Li , Aaron Tuor , Draguna Vrabie , Larry Pileggi , Jan Drgona

Alternating-Current Optimal Power Flow (AC-OPF) is an optimization problem critical for planning and operating the power grid. The problem is traditionally formulated using only continuous variables. Typically, control devices with…

Optimization and Control · Mathematics 2021-10-15 Timothy McNamara , Amritanshu Pandey , Aayushya Agarwal , Larry Pileggi

Numerical continuation in the context of optimization can be used to mitigate convergence issues due to a poor initial guess. In this work, we extend this idea to Riemannian optimization problems, that is, the minimization of a target…

Optimization and Control · Mathematics 2023-05-30 Axel Séguin , Daniel Kressner

Path-following algorithms are frequently used in composite optimization problems where a series of subproblems, with varying regularization hyperparameters, are solved sequentially. By reusing the previous solutions as initialization,…

Optimization and Control · Mathematics 2021-12-10 Eugene Ndiaye , Ichiro Takeuchi

We describe, study, and experiment with an algorithm for finding all solutions of systems of polynomial equations using homotopy continuation and monodromy. This algorithm follows a framework developed in previous work and can operate in…

Symbolic Computation · Computer Science 2018-06-01 Nathan Bliss , Timothy Duff , Anton Leykin , Jeff Sommars

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values. Recent work has shown that including the…

Machine Learning · Computer Science 2020-10-23 Kai Wang , Bryan Wilder , Andrew Perrault , Milind Tambe