English
Related papers

Related papers: Matrix-Free Convex Optimization Modeling

200 papers

This paper introduces an abstract framework for randomized subspace correction methods for convex optimization, which unifies and generalizes a broad class of existing algorithms, including domain decomposition, multigrid, and block…

Optimization and Control · Mathematics 2026-04-28 Boou Jiang , Jongho Park , Jinchao Xu

The integration of optimization problems within neural network architectures represents a fundamental shift from traditional approaches to handling constraints in deep learning. While it is long known that neural networks can incorporate…

Machine Learning · Computer Science 2024-12-31 Calder Katyal

This review presents modern gradient-free methods to solve convex optimization problems. By gradient-free methods, we mean those that use only (noisy) realizations of the objective value. We are motivated by various applications where…

In this paper we present a new algorithmic realization of a projection-based scheme for general convex constrained optimization problem. The general idea is to transform the original optimization problem to a sequence of feasibility…

Optimization and Control · Mathematics 2019-11-12 Aviv Gibali , Karl-Heinz Küfer , Daniel Reem , Philipp Süss

Data-driven Model Predictive Control (MPC), where the system model is learned from data with machine learning, has recently gained increasing interests in the control community. Gaussian Processes (GP), as a type of statistical models, are…

Systems and Control · Computer Science 2019-10-03 Truong X. Nghiem

We present a simple transformation of any linear program or semidefinite program into an equivalent convex optimization problem whose only constraints are linear equations. The objective function is defined on the whole space, making…

Optimization and Control · Mathematics 2014-10-07 James Renegar

One of the main applications of semidefinite programming lies in linear systems and control theory. Many problems in this subject, certainly the textbook classics, have matrices as variables, and the formulas naturally contain…

Operator Algebras · Mathematics 2011-12-30 J. William Helton , Igor Klep , Scott McCullough

Constraint programming can definitely be seen as a model-driven paradigm. The users write programs for modeling problems. These programs are mapped to executable models to calculate the solutions. This paper focuses on efficient model…

Artificial Intelligence · Computer Science 2010-02-16 Raphael Chenouard , Laurent Granvilliers , Ricardo Soto

In this paper we address the speed planning problem for a vehicle over an assigned path with the aim of minimizing a weighted sum of travel time and energy consumption under suitable constraints (maximum allowed speed, maximum traction or…

Optimization and Control · Mathematics 2025-07-22 Stefano Ardizzoni , Luca Consolini , Mattia Laurini , Marco Locatelli

The use of convex regularizers allows for easy optimization, though they often produce biased estimation and inferior prediction performance. Recently, nonconvex regularizers have attracted a lot of attention and outperformed convex ones.…

Optimization and Control · Mathematics 2017-02-14 Quanming Yao , James. T Kwok

We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic…

Optimization and Control · Mathematics 2021-08-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

We consider the global optimization of nonconvex mixed-integer quadratic programs with linear equality constraints. In particular, we present a new class of convex quadratic relaxations which are derived via quadratic cuts. To construct…

Optimization and Control · Mathematics 2021-06-28 Carlos J. Nohra , Arvind U. Raghunathan , Nikolaos V. Sahinidis

Optimization is an essential component for solving problems in wide-ranging fields. Ideally, the objective function should be designed such that the solution is unique and the optimization problem can be solved stably. However, the…

Robotics · Computer Science 2020-07-27 Takayuki Osa

We describe a convex programming approach to the calculation of lower bounds on the minimum cost of constrained decentralized control problems with nonclassical information structures. The class of problems we consider entail the…

Optimization and Control · Mathematics 2019-06-05 Weixuan Lin , Eilyan Bitar

We present a novel method for global motion planning of robotic systems that interact with the environment through contacts. Our method directly handles the hybrid nature of such tasks using tools from convex optimization. We formulate the…

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

We study a multi-period convex quadratic optimization problem, where the state evolves dynamically as an affine function of the state, control, and indicator variables in each period. We begin by projecting out the state variables using…

Optimization and Control · Mathematics 2024-12-24 Jisun Lee , Andrés Gómez , Alper Atamtürk

Devising efficient algorithms that track the optimizers of continuously varying convex optimization problems is key in many applications. A possible strategy is to sample the time-varying problem at constant rate and solve the resulting…

Optimization and Control · Mathematics 2017-11-28 Andrea Simonetto

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

We propose the convex factorization machine (CFM), which is a convex variant of the widely used Factorization Machines (FMs). Specifically, we employ a linear+quadratic model and regularize the linear term with the $\ell_2$-regularizer and…