English
Related papers

Related papers: Global relaxation-based LP-Newton method for multi…

200 papers

We address the problem of model selection for Support Vector Machine (SVM) classification. For fixed functional form of the kernel, model selection amounts to tuning kernel parameters and the slack penalty coefficient $C$. We begin by…

Disordered Systems and Neural Networks · Physics 2007-05-23 Carl Gold , Peter Sollich

In this paper, we present a new adaptive feature scaling scheme for ultrahigh-dimensional feature selection on Big Data. To solve this problem effectively, we first reformulate it as a convex semi-infinite programming (SIP) problem and then…

Machine Learning · Computer Science 2019-12-17 Mingkui Tan , Ivor W. Tsang , Li Wang

The graph partition problem (GPP) aims at clustering the vertex set of a graph into a fixed number of disjoint subsets of given sizes such that the sum of weights of edges joining different sets is minimized. This paper investigates the…

Optimization and Control · Mathematics 2023-08-02 Frank de Meijer , Renata Sotirov , Angelika Wiegele , Shudian Zhao

In this paper, we present a novel method for solving multiobjective linear programming problems (MOLPP) that overcomes the need to calculate the optimal value of each objective function. This method is a follow-up to our previous work on…

Optimization and Control · Mathematics 2024-07-02 Mustapha Kaci , Sonia Radjef

Typical behavior of the linear programming (LP) problem is studied as a relaxation of the minimum vertex cover, a type of integer programming (IP) problem. A lattice-gas model on the Erd\"os-R\'enyi random graphs of $\alpha$-uniform…

Disordered Systems and Neural Networks · Physics 2016-06-01 Satoshi Takabe , Koji Hukushima

We consider an extension of the set covering problem (SCP) introducing (i)~multicover and (ii)~generalized upper bound (GUB)~constraints. For the conventional SCP, the pricing method has been introduced to reduce the size of instances, and…

Data Structures and Algorithms · Computer Science 2018-01-09 Shunji Umetani , Masanao Arakawa , Mutsunori Yagiura

The generalized Gauss-Newton (GGN) optimization method incorporates curvature estimates into its solution steps, and provides a good approximation to the Newton method for large-scale optimization problems. GGN has been found particularly…

Machine Learning · Computer Science 2024-04-24 Adeyemi D. Adeoye , Philipp Christian Petersen , Alberto Bemporad

In this paper, we present a novel embedded feature selection method based on a Multi-layer Perceptron (MLP) network and generalize it for group-feature or sensor selection problems, which can control the level of redundancy among the…

Machine Learning · Computer Science 2024-09-26 Aytijhya Saha , Nikhil R. Pal

In this paper, we propose a a gradient-based neural network model to solve the mathematical programming problems with complementary constraints (MPCC). In order to facilitate tractable optimization, the problem MPCC is transformed via a…

Optimization and Control · Mathematics 2026-03-24 Anurag Jayswal , Ajeet Kumar

Linear programming (LP) relaxations are widely employed in exact solution methods for multilinear programs (MLP). One example is the family of Recursive McCormick Linearization (RML) strategies, where bilinear products are substituted for…

Optimization and Control · Mathematics 2022-07-20 Arvind U Raghunathan , Carlos Cardonha , David Bergman , Carlos J Nohra

This paper introduces a novel algorithm for Mixed-Integer Nonlinear Programming (MINLP) problems with multilinear interpolations of look-up tables. These problems arise when objective or constraints contain black-box functions only known at…

Signomial geometric programming (SGP) is a computationally challenging, NP-Hard class of nonconvex nonlinear optimization problems. SGP can be solved iteratively using a sequence of convex relaxations; consequently, the strength of such…

Optimization and Control · Mathematics 2024-06-11 Milad Dehghani Filabadi , Chen Chen

In computer vision, many problems such as image segmentation, pixel labelling, and scene parsing can be formulated as binary quadratic programs (BQPs). For submodular problems, cuts based methods can be employed to efficiently solve…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Peng Wang , Chunhua Shen , Anton van den Hengel , Philip H. S. Torr

This work considers polynomial optimization problems where the objective admits a low-rank canonical polyadic tensor decomposition. We introduce LRPOP (low-rank polynomial optimization), a new hierarchy of semidefinite programming…

Optimization and Control · Mathematics 2025-12-10 Llorenç Balada Gaggioli , Didier Henrion , Milan Korda

This paper concerns with a noisy structured low-rank matrix recovery problem which can be modeled as a structured rank minimization problem. We reformulate this problem as a mathematical program with a generalized complementarity constraint…

Optimization and Control · Mathematics 2017-03-14 Shujun Bi , Shaohua Pan , Defeng Sun

In this paper we consider the problem of Gaussian process classifier (GPC) model selection with different Leave-One-Out (LOO) Cross Validation (CV) based optimization criteria and provide a practical algorithm using LOO predictive…

Machine Learning · Computer Science 2012-06-27 Sundararajan Sellamanickam , Sathiya Keerthi Selvaraj

We introduce a new criterion, the Rank Selection Criterion (RSC), for selecting the optimal reduced rank estimator of the coefficient matrix in multivariate response regression models. The corresponding RSC estimator minimizes the Frobenius…

Statistics Theory · Mathematics 2011-10-18 Florentina Bunea , Yiyuan She , Marten H. Wegkamp

Solving different types of optimization models (including parameters fitting) for support vector machines on large-scale training data is often an expensive computational task. This paper proposes a multilevel algorithmic framework that…

Machine Learning · Statistics 2014-10-14 Talayeh Razzaghi , Ilya Safro

While large margin classifiers are originally an outcome of an optimization framework, support vectors (SVs) can be obtained from geometric approaches. This article presents advances in the use of Gabriel graphs (GGs) in binary and…

Machine Learning · Computer Science 2025-12-16 Vítor M. Hanriot , Luiz C. B. Torres , Antônio P. Braga

In this work, we consider the low rank decomposition (SDPR) of general convex semidefinite programming problems (SDP) that contain both a positive semidefinite matrix and a nonnegative vector as variables. We develop a rank-support-adaptive…

Optimization and Control · Mathematics 2023-12-14 Tianyun Tang , Kim-Chuan Toh