English
Related papers

Related papers: Global solutions to folded concave penalized nonco…

200 papers

Mixed-integer nonlinear optimization encompasses a broad class of problems that present both theoretical and computational challenges. We propose a new type of method to solve these problems based on a branch-and-bound algorithm with convex…

Optimization and Control · Mathematics 2024-07-19 Deborah Hendrych , Hannah Troppens , Mathieu Besançon , Sebastian Pokutta

In this paper, we mainly study one class of convex mixed-integer nonlinear programming problems (MINLPs) with non-differentiable data. By dropping the differentiability assumption, we substitute gradients with subgradients obtained from KKT…

Optimization and Control · Mathematics 2015-09-22 Zhou Wei , M. Montaz Ali

Efficient methods to provide sub-optimal solutions to non-convex optimization problems with knowledge of the solution's sub-optimality would facilitate the widespread application of nonlinear optimal control algorithms. To that end,…

Optimization and Control · Mathematics 2023-04-10 Prithvi Akella , Aaron D. Ames

A novel correction algorithm is proposed for multi-class classification problems with corrupted training data. The algorithm is non-intrusive, in the sense that it post-processes a trained classification model by adding a correction…

Machine Learning · Computer Science 2020-02-13 Jun Hou , Tong Qin , Kailiang Wu , Dongbin Xiu

In this paper, we propose a novel solution for non-convex problems of multiple variables, especially for those typically solved by an alternating minimization (AM) strategy that splits the original optimization problem into a set of…

Machine Learning · Computer Science 2022-06-28 Jingyuan Xia , Shengxi Li , Jun-Jie Huang , Imad Jaimoukha , Deniz Gunduz

In this paper, we consider a class of nonconvex problems with linear constraints appearing frequently in the area of image processing. We solve this problem by the penalty method and propose the iteratively reweighted alternating…

Optimization and Control · Mathematics 2019-02-13 Tao Sun , Dongsheng Li , Hao Jiang , Zhe Quan

The placement problem in Very Large-Scale Integration (VLSI) circuits is a critical step in chip design. Its primary goal is to optimize the wirelength of circuit components within a confined area while adhering to nonoverlapping…

Optimization and Control · Mathematics 2026-05-06 Yi-Shuang Yue , Yu-Hong Dai , Haijun Yu

Forecasting high-dimensional dynamical systems is a fundamental challenge in various fields, such as geosciences and engineering. Neural Ordinary Differential Equations (NODEs), which combine the power of neural networks and numerical…

Machine Learning · Computer Science 2024-10-16 Dibyajyoti Chakraborty , Seung Whan Chung , Troy Arcomano , Romit Maulik

We propose an algorithm for generating explicit solutions of multiparametric mixed-integer convex programs to within a given suboptimality tolerance. The algorithm is applicable to a very general class of optimization problems, but is most…

Optimization and Control · Mathematics 2019-06-12 Danylo Malyuta , Behcet Acikmese

Recently non-convex optimization approaches for solving machine learning problems have gained significant attention. In this paper we explore non-convex boosting in classification by means of integer programming and demonstrate real-world…

Machine Learning · Computer Science 2020-02-13 Marc E. Pfetsch , Sebastian Pokutta

A linear program with linear complementarity constraints (LPCC) requires the minimization of a linear objective over a set of linear constraints together with additional linear complementarity constraints. This class has emerged as a…

Optimization and Control · Mathematics 2018-02-09 Bin Yu , John E. Mitchell , Jong-Shi Pang

Optimization with nonnegative orthogonality constraints has wide applications in machine learning and data sciences. It is NP-hard due to some combinatorial properties of the constraints. We first propose an equivalent optimization…

Optimization and Control · Mathematics 2021-01-01 Bo Jiang , Xiang Meng , Zaiwen Wen , Xiaojun Chen

Outer-approximation-based branch-and-bound is a common algorithmic framework for solving MINLPs (mixed-integer nonlinear programs) to global optimality, with branching variable selection critically influencing overall performance. In modern…

Optimization and Control · Mathematics 2026-02-12 Timo Berthold , Fritz Geis

We propose a convex-concave programming approach for the labeled weighted graph matching problem. The convex-concave programming formulation is obtained by rewriting the weighted graph matching problem as a least-square problem on the set…

Computer Vision and Pattern Recognition · Computer Science 2008-10-27 Mikhail Zaslavskiy , Francis Bach , Jean-Philippe Vert

We propose a penalized method for the least squares estimator of a multivariate concave regression function. This estimator is formulated as a quadratic programming (QP) problem with $O(n^2)$ constraints, where n is the number of…

Computation · Statistics 2016-08-16 Abolfazl Keshvari

This article presents a new method for computing guaranteed convex and concave relaxations of nonlinear stochastic optimal control problems with final-time expected-value cost functions. This method is motivated by similar methods for…

Optimization and Control · Mathematics 2017-11-27 Yuanxun Shao , Dillard Robertson , Joseph Kirk Scott

Using machine learning to solve combinatorial optimization (CO) problems is challenging, especially when the data is unlabeled. This work proposes an unsupervised learning framework for CO problems. Our framework follows a standard…

Machine Learning · Computer Science 2022-10-25 Haoyu Wang , Nan Wu , Hang Yang , Cong Hao , Pan Li

Nonconvex optimization problems arise in many areas of computational science and engineering and are (approximately) solved by a variety of algorithms. Existing algorithms usually only have local convergence or subsequence convergence of…

Optimization and Control · Mathematics 2015-08-21 Yangyang Xu , Wotao Yin

Recent deep reinforcement learning methods have achieved remarkable success in solving multi-objective combinatorial optimization problems (MOCOPs) by decomposing them into multiple subproblems, each associated with a specific weight…

Artificial Intelligence · Computer Science 2026-03-23 Mingfeng Fan , Jianan Zhou , Yifeng Zhang , Yaoxin Wu , Jinbiao Chen , Guillaume Adrien Sartoretti

Stochastic gradient descent (SGD) method is popular for solving non-convex optimization problems in machine learning. This work investigates SGD from a viewpoint of graduated optimization, which is a widely applied approach for non-convex…

Optimization and Control · Mathematics 2023-08-15 Da Li , Jingjing Wu , Qingrun Zhang