English
Related papers

Related papers: Worst-Case Linear Discriminant Analysis as Scalabl…

200 papers

We introduce Sieve-SDP, a simple facial reduction algorithm to preprocess semidefinite programs (SDPs). Sieve-SDP inspects the constraints of the problem to detect lack of strict feasibility, deletes redundant rows and columns, and reduces…

Optimization and Control · Mathematics 2021-03-02 Yuzixuan , Zhu , Gabor Pataki , Quoc Tran-Dinh

Semidefinite programs (SDP) are one of the most versatile frameworks in numerical optimization, serving as generalizations of many conic programs and as relaxations of NP-hard combinatorial problems. Their main drawback is their…

Optimization and Control · Mathematics 2022-02-28 Biel Roig-Solvas , Mario Sznaier

Several algorithms are available in the literature for finding the entire set of Pareto-optimal solutions in MultiObjective Linear Programming (MOLP). However, it has not been proposed so far an interior point algorithm that finds all…

Optimization and Control · Mathematics 2011-12-30 Víctor Blanco , Justo Puerto , Safae El-Haj Ben-Ali

Motivated by applications in wireless communications, this paper develops semidefinite programming (SDP) relaxation techniques for some mixed binary quadratically constrained quadratic programs (MBQCQP) and analyzes their approximation…

Optimization and Control · Mathematics 2014-03-18 Zi Xu , Mingyi Hong , Zhi-Quan Luo

Linear Discriminant Analysis (LDA) is a well-known method for dimensionality reduction and classification. Previous studies have also extended the binary-class case into multi-classes. However, many applications, such as object detection…

Machine Learning · Computer Science 2013-09-24 Gang Chen

Linear Discriminant Analysis (LDA) is a widely-used supervised dimensionality reduction method in computer vision and pattern recognition. In null space based LDA (NLDA), a well-known LDA extension, between-class distance is maximized in…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Shuai Zheng , Feiping Nie , Chris Ding , Heng Huang

Many problems of systems control theory boil down to solving polynomial equations, polynomial inequalities or polyomial differential equations. Recent advances in convex optimization and real algebraic geometry can be combined to generate…

Optimization and Control · Mathematics 2013-09-13 Didier Henrion

We suppose the existence of an oracle which solves any semidefinite programming (SDP) problem satisfying Slater's condition simultaneously at its primal and dual sides. We note that such an oracle might not be able to directly solve general…

Optimization and Control · Mathematics 2022-03-10 Bruno F. Lourenço , Masakazu Muramatsu , Takashi Tsuchiya

This paper proposes an improved linear discriminant analysis called spectrally-corrected and regularized LDA (SRLDA). This method integrates the design ideas of the sample spectrally-corrected covariance matrix and the regularized…

Machine Learning · Statistics 2024-03-11 Hua Li , Wenya Luo , Zhidong Bai , Huanchao Zhou , Zhangni Pu

Semidefinite Programming (SDP) provides tight lower bounds for Optimal Power Flow problems. However, solving large-scale SDP problems requires exploiting sparsity. In this paper, we experiment several clique decomposition algorithms that…

Optimization and Control · Mathematics 2019-12-20 Julie Sliwak , Miguel Anjos , Lucas Létocart , Jean Maeght , Emiliano Traversi

In this paper, by improving the variable-splitting approach, we propose a new semidefinite programming (SDP) relaxation for the nonconvex quadratic optimization problem over the $\ell_1$ unit ball (QPL1). It dominates the state-of-the-art…

Optimization and Control · Mathematics 2014-01-03 Yong Xia , Yu-Jun Gong , Sheng-Nan Han

A hierarchy of semidefinite programming (SDP) relaxations approximates the global optimum of polynomial optimization problems of noncommuting variables. Generating the relaxation, however, is a computationally demanding task, and only…

Mathematical Software · Computer Science 2015-06-15 Peter Wittek

Semidefinite programming (SDP) relaxation has emerged as a promising approach for neural network verification, offering tighter bounds than other convex relaxation methods for deep neural networks (DNNs) with ReLU activations. However, we…

Machine Learning · Computer Science 2025-06-13 Ryota Ueda , Takami Sato , Ken Kobayashi , Kazuhide Nakata

Dynamic optimization problems involving discrete decisions have several applications, yet lead to challenging optimization problems that must be addressed efficiently. Combining discrete variables with potentially nonlinear constraints…

Optimization and Control · Mathematics 2024-09-17 Zedong Peng , Albert Lee , David E. Bernal Neira

The Engineers' Salary Prediction Challenge requires classifying salary categories into three classes based on tabular data. The job description is represented as a 300-dimensional word embedding incorporated into the tabular features,…

Machine Learning · Computer Science 2025-09-17 Liam Ressel , Hamza A. A. Gardi

In this paper, we study high-dimensional sparse Quadratic Discriminant Analysis (QDA) and aim to establish the optimal convergence rates for the classification error. Minimax lower bounds are established to demonstrate the necessity of…

Methodology · Statistics 2019-12-09 T. Tony Cai , Linjun Zhang

Dimensionality reduction (DR) of data is a crucial issue for many machine learning tasks, such as pattern recognition and data classification. In this paper, we present a quantum algorithm and a quantum circuit to efficiently perform linear…

Quantum Physics · Physics 2023-04-03 Kai Yu , Gong-De Guo , Song Lin

The Symmetric Primal-Dual Symplex Pivot Decision Strategy (spdspds) is a novel iterative algorithm to solve linear programming problems. A symplex pivoting operation is simply an exchange between a basic variable and a non-basic variable,…

Optimization and Control · Mathematics 2026-05-19 Keshava Prasad Halemane

This paper introduces a novel optimization algorithm designed for nonlinear least-squares problems. The method is derived by preconditioning the gradient descent direction using the Singular Value Decomposition (SVD) of the Jacobian. This…

Numerical Analysis · Mathematics 2026-02-11 Zhipeng Chang , Wenrui Hao , Nian Liu

The semidefinite programming (SDP) relaxation has proven to be extremely strong for many hard discrete optimization problems. This is in particular true for the quadratic assignment problem (QAP), arguably one of the hardest NP-hard…

Optimization and Control · Mathematics 2015-12-18 Danilo Elias Oliveira , Henry Wolkowicz , Yangyang Xu