English
Related papers

Related papers: Global and Robust Optimization for Non-Convex Quad…

200 papers

This paper addresses the optimization problem of minimizing non-convex continuous functions, which is relevant in the context of high-dimensional machine learning applications characterized by over-parametrization. We analyze a randomized…

Machine Learning · Computer Science 2025-02-28 Jim Zhao , Aurelien Lucchi , Nikita Doikov

Non-convex quadratically constrained quadratic programming (QCQP) problems have numerous applications in signal processing, machine learning, and wireless communications, albeit the general QCQP is NP-hard, and several interesting special…

Optimization and Control · Mathematics 2016-09-21 Kejun Huang , Nicholas D. Sidiropoulos

Many large-scale and distributed optimization problems can be brought into a composite form in which the objective function is given by the sum of a smooth term and a nonsmooth regularizer. Such problems can be solved via a proximal…

Optimization and Control · Mathematics 2020-06-26 Sepideh Hassan-Moghaddam , Mihailo R. Jovanović

We study optimization of finite sums of geodesically smooth functions on Riemannian manifolds. Although variance reduction techniques for optimizing finite-sums have witnessed tremendous attention in the recent years, existing work is…

Optimization and Control · Mathematics 2017-04-11 Hongyi Zhang , Sashank J. Reddi , Suvrit Sra

Branch and bound algorithms have been developed for reliability analysis of coherent systems. They exhibit a set of advantages; in particular, they can find a computationally efficient representation of a system failure or survival event,…

Optimization and Control · Mathematics 2024-10-31 Ji-Eun Byun , Hyeuk Ryu , Daniel Straub

Mathematical programs with complementarity constraints are notoriously difficult to solve due to their nonconvexity and lack of constraint qualifications in every feasible point. This work focuses on the subclass of quadratic programs with…

Optimization and Control · Mathematics 2021-06-01 Jonas Hall , Armin Nurkanovic , Florian Messerer , Moritz Diehl

Many resource allocation tasks are challenging global (i.e., non-convex) optimization problems. The main issue is that the computational complexity of these problems grows exponentially in the number of variables instead of polynomially as…

Information Theory · Computer Science 2019-10-17 Bho Matthiesen , Eduard A. Jorswieck

Block coordinate descent (BCD) methods are prevalent in large scale optimization problems due to the low memory and computational costs per iteration, the predisposition to parallelization, and the ability to exploit the structure of the…

Optimization and Control · Mathematics 2025-10-31 Luis Briceño-Arias , Paulo Gonçalves , Guillaume Lauga , Nelly Pustelnik , Elisa Riccietti

Batch Bayesian optimisation and Bayesian quadrature have been shown to be sample-efficient methods of performing optimisation and quadrature where expensive-to-evaluate objective functions can be queried in parallel. However, current…

Machine Learning · Computer Science 2023-07-06 Masaki Adachi , Satoshi Hayakawa , Saad Hamid , Martin Jørgensen , Harald Oberhauser , Micheal A. Osborne

The submodular knapsack problem (SKP), which seeks to maximize a submodular set function by selecting a subset of elements within a given budget, is an important discrete optimization problem. The majority of existing approaches to solving…

Data Structures and Algorithms · Computer Science 2025-07-16 Yimin Hao , Yi Zhou , Chao Xu , Zhang-Hua Fu

This paper explores a new class of constrained difference programming problems, where the objective and constraints are formulated as differences of functions, without requiring their convexity. To investigate such problems, novel variants…

Optimization and Control · Mathematics 2026-04-21 Boris S. Mordukhovich , Yixia Song , Shangzhi Zeng , Jin Zhang

We consider Nash-Cournot oligopolistic equilibrium models involving separable concave cost functions. In contrast to the models with linear and convex cost functions, in these models a local equilibrium point may not be a global one. We…

Optimization and Control · Mathematics 2018-05-08 Le Dung Muu , Nguyen Van Quy

In this article, we use the monotonic optimization approach to propose an outcome-space outer approximation by copolyblocks for solving strictly quasiconvex multiobjective programming problems and especially in the case that the objective…

Optimization and Control · Mathematics 2020-03-26 Tran Ngoc Thang , Vijender Kumar Solanki , Tuan Anh Dao , Nguyen Thi Ngoc Anh , Hai V. Pham

Balancing the trade-off between safety and efficiency is of significant importance for path planning under uncertainty. Many risk-aware path planners have been developed to explicitly limit the probability of collision to an acceptable…

Robotics · Computer Science 2022-10-26 Fei Meng , Liangliang Chen , Han Ma , Jiankun Wang , Max Q. -H. Meng

This paper delves into the challenging issues in uncertain multi-objective optimization, where uncertainty permeates nonsmooth nonconvex objective and constraint functions. In this context, we investigate highly robust (weakly efficient)…

Optimization and Control · Mathematics 2025-01-14 Morteza Rahimi , Majid Soleimani-damaneh

Machine learning algorithms in high-dimensional settings are highly susceptible to the influence of even a small fraction of structured outliers, making robust optimization techniques essential. In particular, within the…

Machine Learning · Computer Science 2025-04-25 Changyu Gao , Andrew Lowy , Xingyu Zhou , Stephen J. Wright

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

Distributionally Robust Optimization (DRO), as a popular method to train robust models against distribution shift between training and test sets, has received tremendous attention in recent years. In this paper, we propose and analyze…

Machine Learning · Computer Science 2023-08-17 Qi Qi , Jiameng Lyu , Kung sik Chan , Er Wei Bai , Tianbao Yang

Stochastic nonconvex optimization problems with nonlinear constraints have a broad range of applications in intelligent transportation, cyber-security, and smart grids. In this paper, first, we propose an inexact-proximal accelerated…

Optimization and Control · Mathematics 2021-07-08 Morteza Boroun , Afrooz Jalilzadeh

Semidefinite programming (SDP) relaxations have been intensively used for solving discrete quadratic optimization problems, in particular in the binary case. For the general non-convex integer case with box constraints, the branch-and-bound…

Optimization and Control · Mathematics 2019-01-30 Christoph Buchheim , Maribel Montenegro , Angelika Wiegele