English
Related papers

Related papers: Piecewise linear regularized solution paths

200 papers

We consider partially-specified optimization problems where the goal is to actively, but efficiently, acquire missing information about the problem in order to solve it. An algorithm designer wishes to solve a linear program (LP), $\max…

Data Structures and Algorithms · Computer Science 2021-09-07 Shuran Zheng , Bo Waggoner , Yang Liu , Yiling Chen

We present a novel approach to address the multi-agent sparse contextual linear bandit problem, in which the feature vectors have a high dimension $d$ whereas the reward function depends on only a limited set of features - precisely $s_0…

Machine Learning · Computer Science 2023-05-31 Haniyeh Barghi , Xiaotong Cheng , Setareh Maghsudi

We propose a novel method for planning shortest length piecewise-linear motions through complex environments punctured with static, moving, or even morphing obstacles. Using a moment optimization approach, we formulate a hierarchy of…

Robotics · Computer Science 2020-10-19 Bachir El Khadir , Jean Bernard Lasserre , Vikas Sindhwani

Consider the following class of learning schemes: $$\hat{\boldsymbol{\beta}} := \arg\min_{\boldsymbol{\beta}}\;\sum_{j=1}^n \ell(\boldsymbol{x}_j^\top\boldsymbol{\beta}; y_j) + \lambda R(\boldsymbol{\beta}),\qquad\qquad (1) $$ where…

Machine Learning · Statistics 2018-07-10 Shuaiwen Wang , Wenda Zhou , Haihao Lu , Arian Maleki , Vahab Mirrokni

In this paper, we study a class of approximation problems, appearing in data approximation and signal processing. The approximations are constructed as combinations of polynomial splines (piecewise polynomials), whose parameters are subject…

Optimization and Control · Mathematics 2015-03-05 Zahra Roshan Zamir , Nadezda Sukhorukova

We consider convex and nonconvex constrained optimization with a partially separable objective function: agents minimize the sum of local objective functions, each of which is known only by the associated agent and depends on the variables…

Optimization and Control · Mathematics 2020-10-20 Loris Cannelli , Francisco Facchinei , Gesualdo Scutari , Vyacheslav Kungurtsev

We propose a novel linesearch variant of the trust region normal map-based semismooth Newton method developed in [Ouyang and Milzarek, Math. Program. 212(1-2), 389--435 (2025)] for solving a class of nonsmooth, nonconvex composite-type…

Optimization and Control · Mathematics 2026-02-16 Hanfeng Zeng , Wenqing Ouyang , Andre Milzarek

We consider the motion-planning problem of planning a collision-free path of a robot in the presence of risk zones. The robot is allowed to travel in these zones but is penalized in a super-linear fashion for consecutive accumulative time…

Robotics · Computer Science 2017-03-10 Oren Salzman , Brian Hou , Siddhartha Srinivasa

Lasso regression is a widely employed approach within the $\ell_1$ regularization framework used to promote sparsity and recover piecewise smooth signals $f:[a,b) \rightarrow \mathbb{R}$ when the given observations are obtained from noisy,…

Numerical Analysis · Mathematics 2025-07-01 Yao Xiao , Anne Gelb , Aditya Viswanathan

This paper studies sparse linear regression analysis with outliers in the responses. A parameter vector for modeling outliers is added to the standard linear regression model and then the sparse estimation problem for both coefficients and…

Statistics Theory · Mathematics 2015-05-21 Shota Katayama , Hironori Fujisawa

Least-absolute-deviations (LAD) line fitting is robust to outliers but computationally more involved than least squares regression. Although the literature includes linear and near-linear time algorithms for the LAD line fitting problem,…

Machine Learning · Statistics 2025-12-25 Stefan Volz , Martin Storath , Andreas Weinmann

We introduce a new multi-dimensional nonlinear embedding -- Piecewise Flat Embedding (PFE) -- for image segmentation. Based on the theory of sparse signal recovery, piecewise flat embedding with diverse channels attempts to recover a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-13 Chaowei Fang , Zicheng Liao , Yizhou Yu

We consider the problem of finding tuned regularized parameter estimators for linear models. We start by showing that three known optimal linear estimators belong to a wider class of estimators that can be formulated as a solution to a…

Statistics Theory · Mathematics 2023-05-03 Per Mattsson , Dave Zachariah , Petre Stoica

High-dimensional data sets are often analyzed and explored via the construction of a latent low-dimensional space which enables convenient visualization and efficient predictive modeling or clustering. For complex data structures, linear…

Machine Learning · Computer Science 2022-05-25 Oskar Allerbo , Rebecka Jörnsten

We study the flexible piecewise exponential model in a high dimensional setting where the number of covariates $p$ grows proportionally to the number of observations $n$ and under the hypothesis of random uncorrelated Gaussian designs. We…

Statistics Theory · Mathematics 2025-02-03 Emanuele Massa

It is shown how piecewise differentiable functions $F: \mathbb R^n \mapsto \mathbb R^m $ that are defined by evaluation programs can be approximated locally by a piecewise linear model based on a pair of sample points $\check x$ and $\hat…

Numerical Analysis · Mathematics 2017-08-14 Andreas Griewank , Tom Streubel , Lutz Lehmann , Manuel Radons , Richard Hasenfelder

The parametric shortest path problem is to find the shortest paths in graph where the edge costs are of the form w_ij+lambda where each w_ij is constant and lambda is a parameter that varies. The problem is to find shortest path trees for…

Data Structures and Algorithms · Computer Science 2015-06-02 Neal Young , Robert Tarjan , James Orlin

We investigate the sign problem in field theories by using the path optimization method with use of the neural network. For theories with the sign problem, integral in the complexified variable space is a promising approach to obtain a…

High Energy Physics - Lattice · Physics 2022-09-21 Akira Ohnishi , Yuto Mori , Kouji Kashiwa

It was recently established that for convex optimization problems with sparse optimal solutions (be it entry-wise sparsity or matrix rank-wise sparsity) it is possible to design first-order methods with linear convergence rates that depend…

Optimization and Control · Mathematics 2026-03-20 Dan Garber

This paper addresses optimization problems constrained by partial differential equations with uncertain coefficients. In particular, the robust control problem and the average control problem are considered for a tracking type cost…

Optimization and Control · Mathematics 2017-11-08 Andreas Van Barel , Stefan Vandewalle