English
Related papers

Related papers: Complexity Analysis of the Lasso Regularization Pa…

200 papers

We study the parameterized complexity of finding shortest s-t-paths with an additional fairness requirement. The task is to compute a shortest path in a vertex-colored graph where each color appears (roughly) equally often in the solution.…

Data Structures and Algorithms · Computer Science 2024-05-30 Matthias Bentert , Leon Kellerhals , Rolf Niedermeier

High-dimensional regression often suffers from heavy-tailed noise and outliers, which can severely undermine the reliability of least-squares based methods. To improve robustness, we adopt a non-smooth Wilcoxon score based rank objective…

Machine Learning · Statistics 2026-01-29 Meixia Lin , Meijiao Shi , Yunhai Xiao , Qian Zhang

We consider the problem of planning a collision-free path of a robot in the presence of risk zones. The robot is allowed to travel in these zones but is penalized in a super-linear fashion for consecutive accumulative time spent there. We…

Computational Geometry · Computer Science 2017-03-10 Oren Salzman , Siddhartha Srinivasa

Path analysis is a model class of structural equation modeling (SEM), which it describes causal relations among measured variables in the form of a multiple linear regression. This paper presents two estimation formulations, one each for…

Optimization and Control · Mathematics 2019-05-03 Anupon Pruttiakaravanich , Jitkomut Songsiri

In recent years, there is a growing interest in combining techniques attributed to the areas of Statistics and Machine Learning in order to obtain the benefits of both approaches. In this article, the statistical technique lasso for…

Machine Learning · Statistics 2023-09-08 David Delgado , Ernesto Curbelo , Danae Carreras

The problem of solving linear systems is one of the most fundamental problems in computer science, where given a satisfiable linear system $(A,b)$, for $A \in \mathbb{R}^{n \times n}$ and $b \in \mathbb{R}^n$, we wish to find a vector $x…

Data Structures and Algorithms · Computer Science 2021-06-25 Mitali Bafna , Nikhil Vyas

We consider optimal route planning when the objective function is a general nonlinear and non-monotonic function. Such an objective models user behavior more accurately, for example, when a user is risk-averse, or the utility function needs…

Data Structures and Algorithms · Computer Science 2015-11-24 Ger Yang , Evdokia Nikolova

Learning sparse models from data is an important task in all those frameworks where relevant information should be identified within a large dataset. This can be achieved by formulating and solving suitable sparsity promoting optimization…

Optimization and Control · Mathematics 2025-02-18 V. Cerone , S. M. Fosson , D. Regruto , A. Salam

We apply classical and Bayesian lasso regularizations to a family of models with the presence of mixture and process variables. We analyse the performance of these estimates with respect to ordinary least squares estimators by a simulation…

Proximal gradient methods have been found to be highly effective for solving minimization problems with non-negative constraints or L1-regularization. Under suitable nondegeneracy conditions, it is known that these algorithms identify the…

Optimization and Control · Mathematics 2018-10-16 Julie Nutini , Mark Schmidt , Warren Hare

We consider the stochastic approximation problem where a convex function has to be minimized, given only the knowledge of unbiased estimates of its gradients at certain points, a framework which includes machine learning methods based on…

Machine Learning · Computer Science 2013-06-11 Francis Bach , Eric Moulines

We study the replacement paths problem in the $\mathsf{CONGEST}$ model of distributed computing. Given an $s$-$t$ shortest path $P$, the goal is to compute, for every edge $e$ in $P$, the shortest-path distance from $s$ to $t$ avoiding $e$.…

Data Structures and Algorithms · Computer Science 2025-08-28 Yi-Jun Chang , Yanyu Chen , Dipan Dey , Gopinath Mishra , Hung Thuan Nguyen , Bryce Sanchez

To minimize or upper-bound the value of a function "robustly", we might instead minimize or upper-bound the "epsilon-robust regularization", defined as the map from a point to the maximum value of the function within an epsilon-radius. This…

Optimization and Control · Mathematics 2010-06-10 Adrian S. Lewis , C. H. Jeffrey Pang

Regularized linear models, such as Lasso, have attracted great attention in statistical learning and data science. However, there is sporadic work on constructing efficient data collection for regularized linear models. In this work, we…

Methodology · Statistics 2021-04-06 C. Devon Lin , Peter Chien , Xinwei Deng

We establish a bound of $O(n^2k^{1+\eps})$, for any $\eps>0$, on the combinatorial complexity of the set $\T$ of line transversals of a collection $\P$ of $k$ convex polyhedra in $\reals^3$ with a total of $n$ facets, and present a…

Computational Geometry · Computer Science 2008-07-09 Haim Kaplan , Natan Rubin , Micha Sharir

We introduce the localized Lasso, which is suited for learning models that are both interpretable and have a high predictive power in problems with high dimensionality $d$ and small sample size $n$. More specifically, we consider a function…

Machine Learning · Statistics 2016-10-17 Makoto Yamada , Koh Takeuchi , Tomoharu Iwata , John Shawe-Taylor , Samuel Kaski

We generalize to tree graphs obtained by connecting path graphs an oracle result obtained for the Fused Lasso over the path graph. Moreover we show that it is possible to substitute in the oracle inequality the minimum of the distances…

Statistics Theory · Mathematics 2020-10-22 Francesco Ortelli , Sara van de Geer

Consider a computer network that consists of a path with $n$ nodes. The nodes are labeled with inputs from a constant-sized set, and the task is to find output labels from a constant-sized set subject to some local constraints---more…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-19 Alkida Balliu , Sebastian Brandt , Yi-Jun Chang , Dennis Olivetti , Mikaël Rabie , Jukka Suomela

The Lasso and the basis pursuit in compressed sensing and machine learning are convex optimization problems with three parameters: the regularization scalar, the observation vector and the data matrix. Relative to the first two parameters,…

Optimization and Control · Mathematics 2025-07-22 Kaiwen Meng , Pengcheng Wu , Xiaoqi Yang

We present a novel binary convex reformulation of the sparse regression problem that constitutes a new duality perspective. We devise a new cutting plane method and provide evidence that it can solve to provable optimality the sparse…

Optimization and Control · Mathematics 2017-09-29 Dimitris Bertsimas , Bart Van Parys