English
Related papers

Related papers: A Combinatorial Algorithm to Compute Regularizatio…

200 papers

Quadratic assignment problem is one of the great challenges in combinatorial optimization. It has many applications in Operations research and Computer Science. In this paper, the author extends the most-used rounding approach to a…

Computational Complexity · Computer Science 2011-05-11 Wajeb Gharibi , Yong Xia

We propose a combinatorial method for computing explicit solutions to multi-parametric quadratic programs, which can be used to compute explicit control laws for linear model predictive control. In contrast to classical methods, which are…

Optimization and Control · Mathematics 2024-04-09 Daniel Arnström , Daniel Axehill

Compositional data have two unique characteristics compared to typical multivariate data: the observed values are nonnegative and their summand is exactly one. To reflect these characteristics, a specific regularized regression model with…

Machine Learning · Computer Science 2018-12-24 Jong-June Jeon , Yongdai Kim , Sungho Won , Hosik Choi

There is growing body of learning problems for which it is natural to organize the parameters into matrix, so as to appropriately regularize the parameters under some matrix norm (in order to impose some more sophisticated prior knowledge).…

Machine Learning · Computer Science 2010-10-19 Sham M. Kakade , Shai Shalev-Shwartz , Ambuj Tewari

The purpose of this note is to survey a methodology to solve systems of polynomial equations and inequalities. The techniques we discuss use the algebra of multivariate polynomials with coefficients over a field to create large-scale linear…

Optimization and Control · Mathematics 2011-12-08 Jesus A. De Loera , Peter N. Malkin , Pablo A. Parrilo

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

We consider the problem of minimizing a sum of several convex non-smooth functions. We introduce a new algorithm called the selective linearization method, which iteratively linearizes all but one of the functions and employs simple…

Optimization and Control · Mathematics 2016-08-16 Yu Du , Xiaodong Lin , Andrzej Ruszczynski

The numerical methods for differential equation solution allow obtaining a discrete field that converges towards the solution if the method is applied to the correct problem. Nevertheless, the numerical methods have the restricted class of…

Numerical Analysis · Mathematics 2023-07-03 Alexander Hvatov , Tatiana Tikhonova

In this paper we present an algorithmic framework for solving a class of combinatorial optimization problems on graphs with bounded pathwidth. The problems are NP-hard in general, but solvable in linear time on this type of graphs. The…

Data Structures and Algorithms · Computer Science 2012-12-18 Mugurel Ionut Andreica

The performance of penalized likelihood approaches depends profoundly on the selection of the tuning parameter; however, there is no commonly agreed-upon criterion for choosing the tuning parameter. Moreover, penalized likelihood estimation…

Methodology · Statistics 2018-05-09 Yang Liu , Peng Wang

We study a group of new methods to solve an open problem that is the shortest paths problem on a given fix-weighted instance. It is the real significance at a considerable altitude to reach our aim to meet these qualities of generic,…

Discrete Mathematics · Computer Science 2016-11-30 Yong Tan

Many applications require minimizing a family of optimization problems indexed by some hyperparameter $\lambda \in \Lambda$ to obtain an entire solution path. Traditional approaches proceed by discretizing $\Lambda$ and solving a series of…

Optimization and Control · Mathematics 2025-03-12 Qiran Dong , Paul Grigas , Vishal Gupta

Probabilistic sampling methods have become very popular to solve single-shot path planning problems. Rapidly-exploring Random Trees (RRTs) in particular have been shown to be very efficient in solving high dimensional problems. Even though…

Artificial Intelligence · Computer Science 2009-12-03 Nicolas A. Barriga , Mauricio Araya-López , Mauricio Solar

In this work, we investigate data fitting problems with random noises. A randomized progressive iterative regularization method is proposed. It works well for large-scale matrix computations and converges in expectation to the least-squares…

Numerical Analysis · Mathematics 2025-06-05 Dakang Cen , Wenlong Zhang , Junbin Zhong

$ \ell_1 $-regularized linear inverse problems are frequently used in signal processing, image analysis, and statistics. The correct choice of the regularization parameter $ t \in \mathbb{R}_{\geq 0} $ is a delicate issue. Instead of…

Optimization and Control · Mathematics 2016-05-03 Björn Bringmann , Daniel Cremers , Felix Krahmer , Michael Möller

Randomized algorithms provide solutions to two ubiquitous problems: (1) the distributed calculation of a principal component analysis or singular value decomposition of a highly rectangular matrix, and (2) the distributed calculation of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-09 Huamin Li , Yuval Kluger , Mark Tygert

Many combinatorial optimization problems can be formulated as the search for a subgraph that satisfies certain properties and minimizes the total weight. We assume here that the vertices correspond to points in a metric space and can take…

Data Structures and Algorithms · Computer Science 2024-12-25 Marin Bougeret , Jérémy Omer , Michael Poss

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

The quadratic shortest path problem is the problem of finding a path in a directed graph such that the sum of interaction costs over all pairs of arcs on the path is minimized. We derive several semidefinite programming relaxations for the…

Optimization and Control · Mathematics 2017-08-23 Hao Hu , Renata Sotirov

Evaluating performance across optimization algorithms on many problems presents a complex challenge due to the diversity of numerical scales involved. Traditional data processing methods, such as hypothesis testing and Bayesian inference,…

Optimization and Control · Mathematics 2024-09-10 Yunpeng Jinng , Qunfeng Liu