English
Related papers

Related papers: A fast algorithm for solving the lasso problem exa…

200 papers

In this paper we propose an approach for solving systems of nonlinear equations without computing function derivatives. Motivated by the application area of tomographic absorption spectroscopy, which is a highly-nonlinear problem with…

Optimization and Control · Mathematics 2024-05-15 F. J. Aragón-Artacho , W. Cai , Y. Censor , A. Gibali , C. Shui , D. Torregrosa-Belén

The problem of finding a vector with the fewest nonzero elements that satisfies an underdetermined system of linear equations is an NP-complete problem that is typically solved numerically via convex heuristics or nicely-behaved nonconvex…

Optimization and Control · Mathematics 2018-02-07 Robert Hesse , D. Russell Luke , Patrick Neumann

Tactical selection of experiments to estimate an underlying model is an innate task across various fields. Since each experiment has costs associated with it, selecting statistically significant experiments becomes necessary. Classic linear…

Optimization and Control · Mathematics 2021-03-30 Raj K. Velicheti , Amber Srivastava , Srinivasa M. Salapaka

We consider the problem of efficiently solving large-scale linear least squares problems that have one or more linear constraints that must be satisfied exactly. Whilst some classical approaches are theoretically well founded, they can face…

Numerical Analysis · Mathematics 2021-12-24 Jennifer Scott , Miroslav Tuma

In the recent past, several sampling-based algorithms have been proposed to compute trajectories that are collision-free and dynamically-feasible. However, the outputs of such algorithms are notoriously jagged. In this paper, by focusing on…

Robotics · Computer Science 2015-10-28 Zhijie Zhu , Edward Schmerling , Marco Pavone

This paper addresses the challenge of Lidar-Inertial Odometry (LIO) in dynamic environments, where conventional methods often fail due to their static-world assumptions. Traditional LIO algorithms perform poorly when dynamic objects…

Robotics · Computer Science 2025-10-28 Chen Zhiqiang , Le Gentil Cedric , Lin Fuling , Lu Minghao , Qiao Qiyuan , Xu Bowen , Qi Yuhua , Lu Peng

In this work, we develop analysis and algorithms for a class of (stochastic) bilevel optimization problems whose lower-level (LL) problem is strongly convex and linearly constrained. Most existing approaches for solving such problems rely…

Optimization and Control · Mathematics 2025-04-08 Prashant Khanduri , Ioannis Tsaknakis , Yihua Zhang , Sijia Liu , Mingyi Hong

The increasing reliance on numerical methods for controlling dynamical systems and training machine learning models underscores the need to devise algorithms that dependably and efficiently navigate complex optimization landscapes.…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Andrea Martin , Luca Furieri

We consider ``one-at-a-time'' coordinate-wise descent algorithms for a class of convex optimization problems. An algorithm of this kind has been proposed for the $L_1$-penalized regression (lasso) in the literature, but it seems to have…

Computation · Statistics 2007-12-18 Jerome Friedman , Trevor Hastie , Holger Höfling , Robert Tibshirani

Setting regularization parameters for Lasso-type estimators is notoriously difficult, though crucial in practice. The most popular hyperparameter optimization approach is grid-search using held-out validation data. Grid-search however…

Collision detection appears as a canonical operation in a large range of robotics applications from robot control to simulation, including motion planning and estimation. While the seminal works on the topic date back to the 80s, it is only…

We consider efficient implementations of the generalized lasso dual path algorithm of Tibshirani and Taylor (2011). We first describe a generic approach that covers any penalty matrix D and any (full column rank) matrix X of predictor…

Computation · Statistics 2014-11-04 Taylor Arnold , Ryan Tibshirani

This article studies the solutions of time-dependent differential inclusions which is motivated by their utility in the modeling of certain physical systems. The differential inclusion is described by a time-dependent set-valued mapping…

Optimization and Control · Mathematics 2021-07-05 Kanat Camlibel , Luigi Iannelli , Aneel Tanwani

We consider a general decomposable convex optimization problem. By using right-hand side allocation technique, it can be transformed into a collection of small dimensional optimization problems. The master problem is a convex non-smooth…

Optimization and Control · Mathematics 2020-10-05 Igor V. Konnov

In order to solve the minimization of a nonsmooth convex function, we design an inertial second-order dynamic algorithm, which is obtained by approximating the nonsmooth function by a class of smooth functions. By studying the asymptotic…

Optimization and Control · Mathematics 2021-12-20 Xin Qu , Wei Bian

We propose an exact algorithm for solving the longest simple path problem between two given vertices in undirected weighted graphs. By using graph partitioning and dynamic programming, we obtain an algorithm that is significantly faster…

Data Structures and Algorithms · Computer Science 2019-05-10 Kai Fieger , Tomas Balyo , Christian Schulz , Dominik Schreiber

This paper presents an iterative data-driven algorithm for solving dynamic multi-objective (MO) optimal control problems arising in control of nonlinear continuous-time systems. It is first shown that the Hamiltonian functional…

Systems and Control · Electrical Eng. & Systems 2021-01-26 Majid Mazouchi , Yongliang Yang , Hamidreza Modares

In optimization, it is known that when the objective functions are strictly convex and well-conditioned, gradient-based approaches can be extremely effective, e.g., achieving the exponential rate of convergence. On the other hand, the…

Machine Learning · Statistics 2023-03-08 Yujie Zhao , Xiaoming Huo

We present a path algorithm for the generalized lasso problem. This problem penalizes the $\ell_1$ norm of a matrix D times the coefficient vector, and has a wide range of applications, dictated by the choice of D. Our algorithm is based on…

Statistics Theory · Mathematics 2015-03-17 Ryan J. Tibshirani , Jonathan Taylor

In this paper, we propose and analyse a family of generalised stochastic composite mirror descent algorithms. With adaptive step sizes, the proposed algorithms converge without requiring prior knowledge of the problem. Combined with an…

Optimization and Control · Mathematics 2022-11-22 Weijia Shao , Fikret Sivrikaya , Sahin Albayrak