English
Related papers

Related papers: Lasso formulation of the shortest path problem

200 papers

Dynamic Mode Decomposition (DMD) yields a linear, approximate model of a system's dynamics that is built from data. We seek to reduce the order of this model by identifying a reduced set of modes that best fit the output. We adopt a model…

Machine Learning · Statistics 2020-01-20 John Graff , Xianzhang Xu , Francis D. Lagor , Tarunraj Singh

We present an alternating direction method of multipliers (ADMM) for a generic overlapping group lasso problem, where the groups can be overlapping in an arbitrary way. Meanwhile, we prove the lower bounds and upper bounds for both the…

Statistics Theory · Mathematics 2023-10-31 Youming Zhao

We compute approximate solutions to L0 regularized linear regression using L1 regularization, also known as the Lasso, as an initialization step. Our algorithm, the Lass-0 ("Lass-zero"), uses a computationally efficient stepwise search to…

Machine Learning · Statistics 2016-02-18 William Herlands , Maria De-Arteaga , Daniel Neill , Artur Dubrawski

We study the complexity of the entire regularization path for least squares regression with 1-norm penalty, known as the Lasso. Every regression parameter in the Lasso changes linearly as a function of the regularization value. The number…

Data Structures and Algorithms · Computer Science 2018-06-11 Yuanzhi Li , Yoram Singer

In this paper, we propose a new stochastic alternating direction method of multipliers (ADMM) algorithm, which incrementally approximates the full gradient in the linearized ADMM formulation. Besides having a low per-iteration complexity as…

Machine Learning · Computer Science 2013-08-19 Leon Wenliang Zhong , James T. Kwok

This paper details a new algorithm to solve the shortest path problem in valued graphs. Its complexity is $O(D \log v)$ where $D$ is the graph diameter and $v$ its number of vertices. This complexity has to be compared to the one of the…

Data Structures and Algorithms · Computer Science 2007-05-23 Michel Koskas

While the shortest path problem has myriad applications, the computational efficiency of suitable algorithms depends intimately on the underlying problem domain. In this paper, we focus on domains where evaluating the edge weight function…

Data Structures and Algorithms · Computer Science 2016-06-15 Christopher M. Dellin , Siddhartha S. Srinivasa

The quadratic shortest path problem is the problem of finding a path in a directed graph such that the sum of interaction costs over all pairs of arcs on the path is minimized. We derive several semidefinite programming relaxations for the…

Optimization and Control · Mathematics 2017-08-23 Hao Hu , Renata Sotirov

The least squares problem with L1-regularized regressors, called Lasso, is a widely used approach in optimization problems where sparsity of the regressors is desired. This formulation is fundamental for many applications in signal…

Optimization and Control · Mathematics 2021-04-26 Andreea B. Alexandru , Anastasios Tsiamis , George J. Pappas

The least-absolute shrinkage and selection operator (LASSO) is a regularization technique for estimating sparse signals of interest emerging in various applications and can be efficiently solved via the alternating direction method of…

Information Theory · Computer Science 2022-08-25 Huiyue Yi , Yan Xu , Wuxiong Zhang , Hui Xu

We study the use of machine learning techniques to solve a fundamental shortest path problem, known as the single-source many-targets shortest path problem (SSMTSP). Given a directed graph with non-negative edge weights, our goal is to…

Data Structures and Algorithms · Computer Science 2023-03-07 Willem Feijen , Guido Schäfer

We consider a class of sparse learning problems in high dimensional feature space regularized by a structured sparsity-inducing norm which incorporates prior knowledge of the group structure of the features. Such problems often pose a…

Optimization and Control · Mathematics 2014-02-11 Zhiwei Qin , Donald Goldfarb

Finding a shortest path in a graph is one of the most classic problems in algorithmic and graph theory. While we dispose of quite efficient algorithms for this ordinary problem (like the Dijkstra or Bellman-Ford algorithms), some slight…

Data Structures and Algorithms · Computer Science 2024-08-05 Abderrahim Bendahi , Adrien Fradin

We apply the network Lasso to solve binary classification and clustering problems for network-structured data. To this end, we generalize ordinary logistic regression to non-Euclidean data with an intrinsic network structure. The resulting…

Machine Learning · Computer Science 2018-08-15 Henrik Ambos , Nguyen Tran , Alexander Jung

Regularization is widely used in statistics and machine learning to prevent overfitting and gear solution towards prior information. In general, a regularized estimation problem minimizes the sum of a loss function and a penalty term. The…

Computation · Statistics 2012-01-18 Hua Zhou , Yichao Wu

The Constraint Shortest Path (CSP) problem is as follows. An $n$-vertex graph is given, each edge/arc assigned two weights. Let us call them "cost" and "length" for definiteness. Finding a min-cost upper-bounded length path between a given…

Data Structures and Algorithms · Computer Science 2022-04-12 Adil Erzin , Roman Plotnikov , Ilya Ladygin

We study connections between Dykstra's algorithm for projecting onto an intersection of convex sets, the augmented Lagrangian method of multipliers or ADMM, and block coordinate descent. We prove that coordinate descent for a regularized…

Computation · Statistics 2017-05-16 Ryan J. Tibshirani

We present an Alternating Direction Method of Multipliers (ADMM) algorithm for solving optimization problems with an l_1 regularized least-squares cost function subject to recursive equality constraints. The considered optimization problem…

Systems and Control · Computer Science 2012-03-20 Mariette Annergren , Anders Hansson , Bo Wahlberg

The method of ``Total Least Squares'' is proposed as a more natural way (than ordinary least squares) to approximate the data if both the matrix and and the right-hand side are contaminated by ``errors''. In this tutorial note, we give a…

Rings and Algebras · Mathematics 2025-10-20 P. P. N. de Groen

A multiple interval-valued linear regression model considering all the cross-relationships between the mids and spreads of the intervals has been introduced recently. A least-squares estimation of the regression parameters has been carried…

Statistics Theory · Mathematics 2016-02-09 Marta García Bárzana , Ana Colubi , Erricos John Kontoghiorghes