English
Related papers

Related papers: Residual regularization path-following methods for…

200 papers

In the context of linear inverse problems, we propose and study a general iterative regularization method allowing to consider large classes of regularizers and data-fit terms. The algorithm we propose is based on a primal-dual diagonal…

Optimization and Control · Mathematics 2017-08-04 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

The state space dynamics representation is the most general approach for nonlinear systems and often chosen for system identification. During training, the state trajectory can deform significantly leading to poor data coverage of the state…

Machine Learning · Computer Science 2025-07-11 Hermann Klein , Max Heinz Herkersdorf , Oliver Nelles

Trajectory planning for mobile robots in cluttered environments remains a major challenge due to narrow passages, where conventional methods often fail or generate suboptimal paths. To address this issue, we propose the adaptive trajectory…

Robotics · Computer Science 2025-10-31 Hahjin Lee , Young J. Kim

Recently, the regularized functional matching pursuit (RFMP) was introduced as a greedy algorithm for linear ill-posed inverse problems. This algorithm incorporates the Tikhonov-Phillips regularization which implies the necessity of a…

Numerical Analysis · Mathematics 2016-11-04 Martin Gutting , Bianca Kretz , Volker Michel , Roger Telschow

In this article, we introduce a new homotopy function to trace the trajectory by applying modified homotopy continuation method for finding the solution of the linear complementarity problem. Earlier several authors attempted to propose…

Optimization and Control · Mathematics 2021-11-24 A. Dutta , A. K. Das , R. Jana

Trust region methods, such as TRPO, are often used to stabilize policy optimization algorithms in reinforcement learning (RL). While current trust region strategies are effective for continuous control, they typically require a…

Artificial Intelligence · Computer Science 2018-02-26 Ofir Nachum , Mohammad Norouzi , Kelvin Xu , Dale Schuurmans

This paper investigates online algorithms for smooth time-varying optimization problems, focusing first on methods with constant step-size, momentum, and extrapolation-length. Assuming strong convexity, precise results for the tracking…

Optimization and Control · Mathematics 2024-07-16 Liam Madden , Stephen Becker , Emiliano Dall'Anese

Greedy first-order methods, such as coordinate descent with Gauss-Southwell rule or matching pursuit, have become popular in optimization due to their natural tendency to propose sparse solutions and their refined convergence guarantees. In…

Optimization and Control · Mathematics 2024-03-06 Céline Moucer , Adrien Taylor , Francis Bach

We develop a trust-region method for minimizing the sum of a smooth term $f$ and a nonsmooth term $h$), both of which can be nonconvex. Each iteration of our method minimizes a possibly nonconvex model of $f + h$ in a trust region. The…

Optimization and Control · Mathematics 2021-08-04 Aleksandr Y. Aravkin , Robert Baraldi , Dominique Orban

Optimization, a key tool in machine learning and statistics, relies on regularization to reduce overfitting. Traditional regularization methods control a norm of the solution to ensure its smoothness. Recently, topological methods have…

Machine Learning · Computer Science 2020-11-11 Arnur Nigmetov , Aditi S. Krishnapriyan , Nicole Sanderson , Dmitriy Morozov

Probabilistic sampling methods have become very popular to solve single-shot path planning problems. Rapidly-exploring Random Trees (RRTs) in particular have been shown to be very efficient in solving high dimensional problems. Even though…

Artificial Intelligence · Computer Science 2009-12-03 Nicolas A. Barriga , Mauricio Araya-López , Mauricio Solar

We propose a novel linesearch variant of the trust region normal map-based semismooth Newton method developed in [Ouyang and Milzarek, Math. Program. 212(1-2), 389--435 (2025)] for solving a class of nonsmooth, nonconvex composite-type…

Optimization and Control · Mathematics 2026-02-16 Hanfeng Zeng , Wenqing Ouyang , Andre Milzarek

We propose a stochastic first-order trust-region method with inexact function and gradient evaluations for solving finite-sum minimization problems. Using a suitable reformulation of the given problem, our method combines the inexact…

Optimization and Control · Mathematics 2022-10-25 Stefania Bellavia , Natasa Krejic , Benedetta Morini , Simone Rebegoldi

For a wide variety of regularization methods, algorithms computing the entire solution path have been developed recently. Solution path algorithms do not only compute the solution for one particular value of the regularization parameter but…

Machine Learning · Computer Science 2009-03-30 Bernd Gärtner , Joachim Giesen , Martin Jaggi , Torsten Welsch

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

Optimization and Control · Mathematics 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

Feature selection and regularization are becoming increasingly prominent tools in the efforts of the reinforcement learning (RL) community to expand the reach and applicability of RL. One approach to the problem of feature selection is to…

Machine Learning · Computer Science 2012-07-03 Christopher Painter-Wakefield , Ronald Parr

The paper addresses the problem of low-rank trace norm minimization. We propose an algorithm that alternates between fixed-rank optimization and rank-one updates. The fixed-rank optimization is characterized by an efficient factorization…

Optimization and Control · Mathematics 2013-06-04 B. Mishra , G. Meyer , F. Bach , R. Sepulchre

We consider optimal control problems that have binary-valued control input functions and a perimeter regularization. We develop and analyze a trust-region algorithm that solves a sequence of subproblems in which the regularization term and…

Optimization and Control · Mathematics 2025-01-15 Paul Manns , Vanja Nikolić

In many domains of empirical sciences, discovering the causal structure within variables remains an indispensable task. Recently, to tackle with unoriented edges or latent assumptions violation suffered by conventional methods, researchers…

Machine Learning · Computer Science 2024-12-30 Shixuan Liu , Yanghe Feng , Keyu Wu , Guangquan Cheng , Jincai Huang , Zhong Liu

Regularization methods allow one to handle a variety of inferential problems where there are more covariates than cases. This allows one to consider a potentially enormous number of covariates for a problem. We exploit the power of these…

Methodology · Statistics 2012-10-03 Yoonkyung Lee , Steven N. MacEachern , Yoonsuh Jung