English
Related papers

Related papers: An Active Set Algorithm for Nonlinear Optimization…

200 papers

In model predictive control (MPC) an optimization problem has to be solved at each time step, which in real-time applications makes it important to solve these optimization problems efficiently and to have good upper bounds on worst-case…

Optimization and Control · Mathematics 2020-04-13 Daniel Arnström , Daniel Axehill

The Pixel Array (PA) Method, originally introduced by Spivak et. al., is a fast method for solving nonlinear or linear systems. One of its distinguishing features is that it presents all solutions within a bounding box, represented by a…

Analysis of PDEs · Mathematics 2018-08-07 Cynthia T. Liu , David I. Spivak

Diverse optimization algorithms correctly identify, in finite time, intrinsic constraints that must be active at optimality. Analogous behavior extends beyond optimization to systems involving partly smooth operators, and in particular to…

Optimization and Control · Mathematics 2019-02-05 Adrian S. Lewis , Calvin Wylie

This paper proposes a novel population-based meta-heuristic optimization algorithm, called Perfectionism Search Algorithm (PSA), which is based on the psychological aspects of perfectionism. The PSA algorithm takes inspiration from one of…

Optimization and Control · Mathematics 2023-10-16 A. Ghodousian , M. Mollakazemiha , N. Karimian

We propose a feasible active set method for convex quadratic programming problems with non-negativity constraints. This method is specifically designed to be embedded into a branch-and-bound algorithm for convex quadratic mixed integer…

Optimization and Control · Mathematics 2015-12-09 Christoph Buchheim , Marianna De Santis , Stefano Lucidi , Francesco Rinaldi , Long Trieu

This article focuses on the multi-objective optimization of stochastic simulators with high output variance, where the input space is finite and the objective functions are expensive to evaluate. We rely on Bayesian optimization algorithms,…

Optimization and Control · Mathematics 2022-07-21 Bruno Barracosa , Julien Bect , Héloïse Dutrieux Baraffe , Juliette Morin , Josselin Fournel , Emmanuel Vazquez

In the literature, there are a few researches to design some parameters in the Proximal Point Algorithm (PPA), especially for the multi-objective convex optimizations. Introducing some parameters to PPA can make it more flexible and…

Optimization and Control · Mathematics 2018-12-11 Jianchao Bai , Jicheng Li , Pingfan Dai , Jiaofen Li

This paper considers the problem of minimizing an expectation function over a closed convex set, coupled with a {\color{black} functional or expectation} constraint on either decision variables or problem parameters. We first present a new…

Optimization and Control · Mathematics 2020-10-05 Guanghui Lan , Zhiqiang Zhou

In this paper, we propose a novel Dual Inexact Splitting Algorithm (DISA) for distributed convex composite optimization problems, where the local loss function consists of a smooth term and a possibly nonsmooth term composed with a linear…

Optimization and Control · Mathematics 2023-04-25 Luyao Guo , Xinli Shi , Shaofu Yang , Jinde Cao

Online Passive-Aggressive (PA) learning is a class of online margin-based algorithms suitable for a wide range of real-time prediction tasks, including classification and regression. PA algorithms are formulated in terms of deterministic…

Machine Learning · Statistics 2015-09-09 Arnold Salas , Stephen J. Roberts , Michael A. Osborne

We propose an approach based on machine learning to solve two-stage linear adaptive robust optimization (ARO) problems with binary here-and-now variables and polyhedral uncertainty sets. We encode the optimal here-and-now decisions, the…

Machine Learning · Computer Science 2026-04-21 Dimitris Bertsimas , Cheol Woo Kim

Polyhedral convex set optimization problems are the simplest optimization problems with set-valued objective function. Their role in set optimization is comparable to the role of linear programs in scalar optimization. Vector linear…

Optimization and Control · Mathematics 2024-01-26 Andreas Löhne

The success of compressed sensing relies essentially on the ability to efficiently find an approximately sparse solution to an under-determined linear system. In this paper, we developed an efficient algorithm for the sparsity promoting…

Information Theory · Computer Science 2015-06-18 Qibin Fan , Yuling Jiao , Xiliang Lu

We consider optimization problems over the Stiefel manifold whose objective function is the summation of a smooth function and a nonsmooth function. Existing methods for solving this kind of problems can be classified into three classes.…

Optimization and Control · Mathematics 2019-05-14 Shixiang Chen , Shiqian Ma , Anthony Man-Cho So , Tong Zhang

Traditional mathematical programming solvers require long computational times to solve constrained minimization problems of complex and large-scale physical systems. Therefore, these problems are often transformed into unconstrained ones,…

Optimization and Control · Mathematics 2024-05-06 Ksenija Stepanovic , Wendelin Böhmer , Mathijs de Weerdt

Sparse principal component analysis (PCA) and sparse canonical correlation analysis (CCA) are two essential techniques from high-dimensional statistics and machine learning for analyzing large-scale data. Both problems can be formulated as…

Machine Learning · Statistics 2019-03-28 Shixiang Chen , Shiqian Ma , Lingzhou Xue , Hui Zou

Linear optimization is many times algorithmically simpler than non-linear convex optimization. Linear optimization over matroid polytopes, matching polytopes and path polytopes are example of problems for which we have simple and efficient…

Machine Learning · Computer Science 2015-08-17 Dan Garber , Elad Hazan

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

The progressive hedging algorithm (PHA) is a cornerstone among algorithms for large-scale stochastic programming problems. However, its traditional implementation is hindered by some limitations, including the requirement to solve all…

Optimization and Control · Mathematics 2025-03-13 Di Zhang , Yihang Zhang , Suvrajeet Sen

The Alternating Minimization Algorithm (AMA) has been proposed by Tseng to solve convex programming problems with two-block separable linear constraints and objectives, whereby (at least) one of the components of the latter is assumed to be…

Optimization and Control · Mathematics 2018-06-04 Sandy Bitterlich , Radu Ioan Bot , Ernö Robert Csetnek , Gert Wanka