English
Related papers

Related papers: Scylla: a matrix-free fix-propagate-and-project he…

200 papers

We present a technique for producing valid dual bounds for nonconvex quadratic optimization problems. The approach leverages an elegant piecewise linear approximation for univariate quadratic functions due to Yarotsky, formulating this…

Optimization and Control · Mathematics 2021-03-30 Ben Beach , Robert Hildebrand , Joey Huchette

The idea of unfolding iterative algorithms as deep neural networks has been widely applied in solving sparse coding problems, providing both solid theoretical analysis in convergence rate and superior empirical performance. However, for…

Machine Learning · Computer Science 2020-10-27 Yuhai Song , Zhong Cao , Kailun Wu , Ziang Yan , Changshui Zhang

Most numerical methods for conic problems use the homogenous primal-dual embedding, which yields a primal-dual solution or a certificate establishing primal or dual infeasibility. Following Patrinos (and others, 2018), we express the…

Optimization and Control · Mathematics 2018-11-07 E. Busseti , W. Moursi , S. Boyd

The simplex method is one of the most fundamental technologies for solving linear programming (LP) problems and has been widely applied to different practical applications. In the past literature, how to improve and accelerate the simplex…

Optimization and Control · Mathematics 2021-11-08 Mengyu Huang , Yuxing Zhong , Huiwen Yang , Jiazheng Wang , Fan Zhang , Bo Bai , Ling Shi

This paper proposes a novel family of primal-dual-based distributed algorithms for smooth, convex, multi-agent optimization over networks that uses only gradient information and gossip communications. The algorithms can also employ…

Optimization and Control · Mathematics 2020-03-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

We propose a primal heuristic for quadratic mixed-integer problems. Our method extends the Boscia framework -- originally a mixed-integer convex solver leveraging a Frank-Wolfe-based branch-and-bound approach -- to address nonconvex…

Optimization and Control · Mathematics 2025-10-21 Gioni Mexi , Deborah Hendrych , Sébastien Designolle , Mathieu Besançon , Sebastian Pokutta

This paper studies the distributed optimization problem when the objective functions might be nondifferentiable and subject to heterogeneous set constraints. Unlike existing subgradient methods, we focus on the case when the exact…

Optimization and Control · Mathematics 2021-11-23 Kui Zhu , Yutao Tang

We present PDLP, a practical first-order method for linear programming (LP) that can solve to the high levels of accuracy that are expected in traditional LP applications. In addition, it can scale to very large problems because its core…

Optimization and Control · Mathematics 2022-01-10 David Applegate , Mateo Díaz , Oliver Hinder , Haihao Lu , Miles Lubin , Brendan O'Donoghue , Warren Schudy

We propose a new exact approach for solving integer linear programming (ILP) problems which we will call projective splitting algorithms (PSAs). Unlike classical methods for solving ILP problems, PSAs conduct the search for the optimal…

Optimization and Control · Mathematics 2014-04-16 Federico Rodes , Isabel Mendez-Diaz , Paula Zabala

We present an algorithm for minimizing an objective with hard-to-compute gradients by using a related, easier-to-access function as a proxy. Our algorithm is based on approximate proximal point iterations on the proxy combined with…

Machine Learning · Computer Science 2023-06-08 Blake Woodworth , Konstantin Mishchenko , Francis Bach

In this paper, we propose a distributed algorithm for solving loosely coupled problems with chordal sparsity which relies on primal-dual interior-point methods. We achieve this by distributing the computations at each iteration, using…

Optimization and Control · Mathematics 2015-06-30 Sina Khoshfetrat Pakazad , Anders Hansson , Martin S. Andersen

We propose an unconstrained optimization method based on the well-known primal-dual hybrid gradient (PDHG) algorithm. We first formulate the optimality condition of the unconstrained optimization problem as a saddle point problem. We then…

Optimization and Control · Mathematics 2024-08-29 X. Zuo , S. Osher , W. Li

We present a framework to train a structured prediction model by performing smoothing on the inference algorithm it builds upon. Smoothing overcomes the non-smoothness inherent to the maximum margin structured prediction objective, and…

Machine Learning · Statistics 2019-02-11 Krishna Pillutla , Vincent Roulet , Sham M. Kakade , Zaid Harchaoui

This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as a mixed integer quadratically constrained program. To…

This paper develops a new storage-optimal algorithm that provably solves generic semidefinite programs (SDPs) in standard form. This method is particularly effective for weakly constrained SDPs. The key idea is to formulate an approximate…

Optimization and Control · Mathematics 2020-06-19 Lijun Ding , Alp Yurtsever , Volkan Cevher , Joel A. Tropp , Madeleine Udell

This paper is devoted to the design of efficient primal-dual algorithm (PDA) for solving convex optimization problems with known saddle-point structure. We present a new PDA with larger acceptable range of parameters and correction, which…

Optimization and Control · Mathematics 2019-12-04 Xiaokai Chang , Sanyang Liu

Generalized linear mixed models are useful in studying hierarchical data with possibly non-Gaussian responses. However, the intractability of likelihood functions poses challenges for estimation. We develop a new method suitable for this…

Methodology · Statistics 2022-01-26 Zexi Song , Zhiqiang Tan

Data plane verification has grown into a powerful tool to ensure network correctness. However, existing methods with monolithic models have memory requirements tied to network sizes, and the existing method of scaling out is too limited in…

Networking and Internet Architecture · Computer Science 2024-11-18 Kuan-Yen Chou , Santhosh Prabhu , Giri Subramanian , Wenxuan Zhou , Aanand Nayyar , Brighten Godfrey , Matthew Caesar

The demand for classical-quantum hybrid algorithms to solve large-scale combinatorial optimization problems using quantum annealing (QA) has increased. One approach involves obtaining an approximate solution using classical algorithms and…

Quantum Physics · Physics 2024-11-12 Taisei Takabayashi , Masayuki Ohzeki

We consider a general class of combinatorial optimization problems including among others allocation, multiple knapsack, matching or travelling salesman problems. The standard version of those problems is the maximum weight optimization…

Data Structures and Algorithms · Computer Science 2018-01-24 Viet Hung Nguyen , Paul Weng