English
Related papers

Related papers: A Constraint-Reduced MPC Algorithm for Convex Quad…

200 papers

Deep neural networks (DNNs) frequently contain far more weights, represented at a higher precision, than are required for the specific task which they are trained to perform. Consequently, they can often be compressed using techniques such…

Machine Learning · Computer Science 2020-12-03 Vinu Joseph , Saurav Muralidharan , Animesh Garg , Michael Garland , Ganesh Gopalakrishnan

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

We expose in a tutorial fashion the mechanisms which underlie the synthesis of optimization algorithms based on dynamic integral quadratic constraints. We reveal how these tools from robust control allow to design accelerated gradient…

Optimization and Control · Mathematics 2023-09-18 Carsten W. Scherer , Christian Ebenbauer , Tobias Holicki

This work considers the problem of computing the canonical polyadic decomposition (CPD) of large tensors. Prior works mostly leverage data sparsity to handle this problem, which is not suitable for handling dense tensors that often arise in…

Signal Processing · Electrical Eng. & Systems 2020-03-26 Xiao Fu , Shahana Ibrahim , Hoi-To Wai , Cheng Gao , Kejun Huang

In this paper, we study the problem of decomposing a superposition of a low-rank matrix and a sparse matrix when a relatively few linear measurements are available. This problem arises in many data processing tasks such as aligning multiple…

Information Theory · Computer Science 2012-03-01 Arvind Ganesh , Kerui Min , John Wright , Yi Ma

Constrained tensor and matrix factorization models allow to extract interpretable patterns from multiway data. Therefore identifiability properties and efficient algorithms for constrained low-rank approximations are nowadays important…

Machine Learning · Computer Science 2022-01-24 Jeremy E. Cohen

Mixed-integer convex quadratic programs with indicator variables (MIQP) encompass a wide range of applications, from statistical learning to energy, finance, and logistics. The outer approximation (OA) algorithm has been proven efficient in…

Optimization and Control · Mathematics 2023-12-11 Linchuan Wei , Simge Küçükyavuz

We consider multi-agent, convex optimization programs subject to separable constraints, where the constraint function of each agent involves only its local decision vector, while the decision vectors of all agents are coupled via a common…

Optimization and Control · Mathematics 2017-04-05 Luca Deori , Kostas Margellos , Maria Prandini

A dual adaptive model predictive control (MPC) algorithm is presented for linear, time-invariant systems subject to bounded disturbances and parametric uncertainty in the state-space matrices. Online set-membership identification is…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Anilkumar Parsi , Andrea Iannelli , Roy S. Smith

This manuscript develops a new framework to analyze and design iterative optimization algorithms built on the notion of Integral Quadratic Constraints (IQC) from robust control theory. IQCs provide sufficient conditions for the stability of…

Optimization and Control · Mathematics 2021-05-27 Laurent Lessard , Benjamin Recht , Andrew Packard

In sparse coding, we attempt to extract features of input vectors, assuming that the data is inherently structured as a sparse superposition of basic building blocks. Similarly, neural networks perform a given task by learning features of…

Machine Learning · Computer Science 2022-02-16 Deborah Pereg , Israel Cohen , Anthony A. Vassiliou

Given a sample covariance matrix, we examine the problem of maximizing the variance explained by a linear combination of the input variables while constraining the number of nonzero coefficients in this combination. This is known as sparse…

Optimization and Control · Mathematics 2010-12-24 Youwei Zhang , Alexandre d'Aspremont , Laurent El Ghaoui

In this study, we consider the subset selection problems with submodular or monotone discrete objective functions under partition matroid constraints where the thresholds are dynamic. We focus on POMC, a simple Pareto optimization approach…

Neural and Evolutionary Computing · Computer Science 2020-12-17 Anh Viet Do , Frank Neumann

Constraint programming (CP) is a paradigm used to model and solve constraint satisfaction and combinatorial optimization problems. In CP, problems are modeled with constraints that describe acceptable solutions and solved with backtracking…

Quantum Physics · Physics 2021-09-29 Kyle E. C. Booth , Bryan O'Gorman , Jeffrey Marshall , Stuart Hadfield , Eleanor Rieffel

Model predictive control is a powerful tool to generate complex motions for robots. However, it often requires solving non-convex problems online to produce rich behaviors, which is computationally expensive and not always practical in real…

Robotics · Computer Science 2022-09-21 Avadesh Meduri , Huaijiang Zhu , Armand Jordana , Ludovic Righetti

In this paper, a multi-parameterized proximal point algorithm combining with a relaxation step is developed for solving convex minimization problem subject to linear constraints. We show its global convergence and sublinear convergence rate…

Numerical Analysis · Mathematics 2019-07-11 Jianchao Bai , Ke Guo , Xiaokai Chang

Faster, cheaper, and more power efficient optimization solvers than those currently offered by general-purpose solutions are required for extending the use of model predictive control (MPC) to resource-constrained embedded platforms. We…

Systems and Control · Computer Science 2017-10-13 Juan L. Jerez , Paul J. Goulart , Stefan Richter , George A. Constantinides , Eric C. Kerrigan , Manfred Morari

A novel decomposition scheme to solve parametric non-convex programs as they arise in Nonlinear Model Predictive Control (NMPC) is presented. It consists of a fixed number of alternating proximal gradient steps and a dual update per time…

Optimization and Control · Mathematics 2014-12-25 Jean-Hubert Hours , Colin N. Jones

Distributed model predictive control (MPC) has been proven a successful method in regulating the operation of large-scale networks of constrained dynamical systems. This paper is concerned with cooperative distributed MPC in which the…

Optimization and Control · Mathematics 2021-06-29 Georgios Darivianakis , Angelos Georghiou , John Lygeros

Quadratic Unconstrained Binary Optimization models are useful for solving a diverse range of optimization problems. Constraints can be added by incorporating quadratic penalty terms into the objective, often with the introduction of slack…

Optimization and Control · Mathematics 2021-05-18 Amit Verma , Mark Lewis