English
Related papers

Related papers: A Penalty Approach for Differentiation Through Bla…

200 papers

Deep neural networks (DNNs) have been showed to be highly vulnerable to imperceptible adversarial perturbations. As a complementary type of adversary, patch attacks that introduce perceptible perturbations to the images have attracted the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zhaoyu Chen , Bo Li , Shuang Wu , Shouhong Ding , Wenqiang Zhang

This paper presents PIQP, a high-performance toolkit for solving generic sparse quadratic programs (QP). Combining an infeasible Interior Point Method (IPM) with the Proximal Method of Multipliers (PMM), the algorithm can handle…

Optimization and Control · Mathematics 2023-09-18 Roland Schwan , Yuning Jiang , Daniel Kuhn , Colin N. Jones

In this work, we propose the joint use of a mixed penalty-interior point method and direct search, for addressing nonlinearly constrained derivative-free optimization problems. A merit function is considered, wherein the set of nonlinear…

Optimization and Control · Mathematics 2025-09-16 Andrea Brilli , Ana L. Custódio , Giampaolo Liuzzi , Everton J. Silva

Dimensionality reduction is a first step of many machine learning pipelines. Two popular approaches are principal component analysis, which projects onto a small number of well chosen but non-interpretable directions, and feature selection,…

Machine Learning · Statistics 2018-12-27 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

Many contemporary signal processing, machine learning and wireless communication applications can be formulated as nonconvex nonsmooth optimization problems. Often there is a lack of efficient algorithms for these problems, especially when…

Information Theory · Computer Science 2017-12-14 Qingjiang Shi , Mingyi Hong , Xiao Fu , Tsung-Hui Chang

Determinantal point processes (DPPs) have attracted significant attention as an elegant model that is able to capture the balance between quality and diversity within sets. DPPs are parameterized by a positive semi-definite kernel matrix.…

Machine Learning · Statistics 2019-05-30 Mike Gartrell , Elvis Dohmatob , Jon Alberdi

Kernel-free quadratic surface support vector machines (QSVM) have recently gained traction due to their flexibility in modeling nonlinear decision boundaries without relying on kernel functions. However, the introduction of a full quadratic…

Machine Learning · Computer Science 2026-03-09 Ahmad Mousavi , Ramin Zandvakili , Zheming Gao

In this paper we propose new methods to statistically assess $f$-Differential Privacy ($f$-DP), a recent refinement of differential privacy (DP) that remedies certain weaknesses of standard DP (including tightness under algorithmic…

Cryptography and Security · Computer Science 2025-06-16 Önder Askin , Holger Dette , Martin Dunsche , Tim Kutta , Yun Lu , Yu Wei , Vassilis Zikas

In the first part of this work [32], we introduce a convex parabolic relaxation for quadratically-constrained quadratic programs, along with a sequential penalized parabolic relaxation algorithm to recover near-optimal feasible solutions.…

Optimization and Control · Mathematics 2022-08-09 Ramtin Madani , Mersedeh Ashraphijuo , Mohsen Kheirandishfard , Alper Atamturk

Subset selection problems ask for a small, diverse yet representative subset of the given data. When pairwise similarities are captured by a kernel, the determinants of submatrices provide a measure of diversity or independence of items…

Data Structures and Algorithms · Computer Science 2016-07-07 Tarun Kathuria , Amit Deshpande

We introduce DiffOpt.jl, a Julia library to differentiate through the solution of optimization problems with respect to arbitrary parameters present in the objective and/or constraints. The library builds upon MathOptInterface, thus…

Machine Learning · Computer Science 2023-08-01 Mathieu Besançon , Joaquim Dias Garcia , Benoît Legat , Akshay Sharma

In this paper, based on a $Q$-linear convergence analysis and an estimate of the linear convergence factor of the proximal point (PP) algorithm for solving box constrained quadratic programming (BQP) problems, an accelerated proximal point…

Optimization and Control · Mathematics 2020-01-15 Guoqiang Wang , Bo Yu , Zixuan Chen

In this paper, we discuss the solution of a Quadratic Eigenvalue Complementarity Problem (QEiCP) by using Difference of Convex (DC) programming approaches. We first show that QEiCP can be represented as dc programming problem. Then we…

Optimization and Control · Mathematics 2019-02-14 Yi-Shuai Niu , Joaquim Judice , Hoai An Le thi , Dinh Tao Pham

In this paper,we propose a Multi-Objective Sequential Quadratic Programming (MOSQP) algorithm for constrained multi-objective optimization problems,basd on a low-order smooth penalty function as the merit function for line search. The…

Optimization and Control · Mathematics 2025-03-13 Zanyang Kong

We propose a penalized method for the least squares estimator of a multivariate concave regression function. This estimator is formulated as a quadratic programming (QP) problem with $O(n^2)$ constraints, where n is the number of…

Computation · Statistics 2016-08-16 Abolfazl Keshvari

Sequential quadratic programming (SQP) methods have been remarkably successful in solving a broad range of nonlinear optimization problems. These methods iteratively construct and solve quadratic programming (QP) subproblems to compute…

Optimization and Control · Mathematics 2025-12-08 Anugrah Jo Joshy , John T. Hwang

This paper provides an overview, analysis, and comparison of second-order dynamic optimization algorithms, i.e., constrained Differential Dynamic Programming (DDP) and Sequential Quadratic Programming (SQP). Although a variety of these…

Optimization and Control · Mathematics 2026-01-05 Yuichiro Aoyama , Oswin So , Augustinos D. Saravanos , Evangelos A. Theodorou

We introduce a QPLEX Decision Process (QDP) as a model for dynamic control of queueing systems with non-stationary arrivals, general service distributions, and service-level chance constraints. QDPs integrate QPLEX, a computational modeling…

Optimization and Control · Mathematics 2026-05-19 Antonius B. Dieker , Steven T. Hackman , Zitong Wang , Yunhao Yan

We extend a primal-dual fixed point algorithm (PDFP) proposed in [5] to solve two kinds of separable multi-block minimization problems, arising in signal processing and imaging science. This work shows the flexibility of applying PDFP…

Optimization and Control · Mathematics 2016-02-02 Peijun Chen , Jianguo Huang , Xiaoqun Zhang

Determinantal point processes (DPPs) are a useful probabilistic model for selecting a small diverse subset out of a large collection of items, with applications in summarization, stochastic optimization, active learning and more. Given a…

Machine Learning · Computer Science 2020-07-01 Daniele Calandriello , Michał Dereziński , Michal Valko