English
Related papers

Related papers: SGORP: A Subgradient-based Method for d-Dimensiona…

200 papers

Asynchronous parallel optimization algorithms for solving large-scale machine learning problems have drawn significant attention from academia to industry recently. This paper proposes a novel algorithm, decoupled asynchronous proximal…

Optimization and Control · Mathematics 2016-05-24 Yitan Li , Linli Xu , Xiaowei Zhong , Qing Ling

We present two stochastic descent algorithms that apply to unconstrained optimization and are particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained…

Optimization and Control · Mathematics 2019-04-30 David Kozak , Stephen Becker , Alireza Doostan , Luis Tenorio

This paper presents an efficient gradient projection-based method for structural topological optimization problems characterized by a nonlinear objective function which is minimized over a feasible region defined by bilateral bounds and a…

Computational Engineering, Finance, and Science · Computer Science 2020-06-16 Zhi Zeng , Fulei Ma

As VLSI designs grow in complexity, partitioning is widely adopted to accelerate physical design through parallel computing. However, traditional hypergraph partitioning methods often degrade in performance when applied to 2D layouts due to…

Emerging Technologies · Computer Science 2026-04-21 Chen Liu , Hongxin Kong , Lang Feng , Wenchao Qian , Wuxi Li

Linear programming (LP) relaxation is a standard technique for solving hard combinatorial optimization (CO) problems. Here we present a gradient descent algorithm which exploits the special structure of some LP relaxations induced by CO…

Optimization and Control · Mathematics 2020-11-17 Alexey Antonov

This paper considers a class of constrained stochastic composite optimization problems whose objective function is given by the summation of a differentiable (possibly nonconvex) component, together with a certain non-differentiable (but…

Optimization and Control · Mathematics 2013-09-06 Saeed Ghadimi , Guanghui Lan , Hongchao Zhang

Configuration Optimization Problems (COPs), which involve minimizing a loss function over a set of discrete points $\boldsymbol{\gamma} \subset P$, are common in areas like Model Order Reduction, Active Learning, and Optimal Experimental…

Numerical Analysis · Mathematics 2024-10-24 Evie Nielen , Oliver Tse , Karen Veroy

Decentralized optimization with orthogonality constraints is found widely in scientific computing and data science. Since the orthogonality constraints are nonconvex, it is quite challenging to design efficient algorithms. Existing…

Optimization and Control · Mathematics 2024-01-09 Lei Wang , Xin Liu

Compared to natural images, medical images usually show stronger visual patterns and therefore this adds flexibility and elasticity to resource-limited clinical applications by injecting proper priors into neural networks. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Hang Zhang , Rongguang Wang , Jinwei Zhang , Dongdong Liu , Chao Li , Jiahao Li

We introduce an efficient and scalable method for density-based multi-material topology optimization, integrating classical mirror descent techniques with point-wise polytopal design constraints. Such constraints arise naturally in this…

Numerical Analysis · Mathematics 2026-05-15 Peter Gangl , Brendan Keith , Dohyun Kim , Boyan S. Lazarov , Thomas M. Surowiec

The Storage Location Assignment Problem (SLAP) and the Picker Routing Problem (PRP) have received significant attention in the literature due to their pivotal role in the performance of the Order Picking (OP) activity, the most…

Discrete Mathematics · Computer Science 2024-07-19 Thibault Prunet , Nabil Absi , Diego Cattaruzza

The balanced hypergraph partitioning problem (HGP) is to partition the vertex set of a hypergraph into k disjoint blocks of bounded weight, while minimizing an objective function defined on the hyperedges. Whereas real-world applications…

Data Structures and Algorithms · Computer Science 2021-02-03 Tobias Heuer , Nikolai Maas , Sebastian Schlag

We investigate the problem of finding second-order stationary points (SOSP) in differentially private (DP) stochastic non-convex optimization. Existing methods suffer from two key limitations: (i) inaccurate convergence error rate due to…

Machine Learning · Computer Science 2026-01-21 Youming Tao , Zuyuan Zhang , Dongxiao Yu , Xiuzhen Cheng , Falko Dressler , Di Wang

This paper proposes low-complexity algorithms for finding approximate second-order stationary points (SOSPs) of problems with smooth non-convex objective and linear constraints. While finding (approximate) SOSPs is computationally…

Optimization and Control · Mathematics 2019-07-11 Songtao Lu , Meisam Razaviyayn , Bo Yang , Kejun Huang , Mingyi Hong

We introduce a new algorithm to solve a regularized spatial-spectral image estimation problem. Our approach is based on the linearized alternating directions method of multipliers (LADMM), which is a variation of the popular ADMM algorithm.…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Yunsong Liu , Debdut Mandal , Congyu Liao , Kawin Setsompop , Justin P. Haldar

The next generation of Department of Energy supercomputers will be capable of exascale computation. For these machines, far more computation will be possible than that which can be saved to disk. As a result, users will be unable to rely on…

Machine Learning · Computer Science 2025-07-23 Michael Grosskopf , Kellin Rumsey , Ayan Biswas , Earl Lawrence

In this paper we study the Airspace Sectorization Problem (ASP) where the goal is to find an optimal partition (sectorization) of the airspace into a certain number of sectors, each managed by an air traffic controller. The objective of the…

Computational Geometry · Computer Science 2013-02-06 Irina Kostitsyna , Joseph Mitchell

In the number partitioning problem (NPP) one aims to partition a given set of $N$ real numbers into two subsets with approximately equal sum. The NPP is a well-studied optimization problem and is famous for possessing a…

Statistics Theory · Mathematics 2025-05-28 Rushil Mallarapu , Mark Sellke

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

We present a distributed framework of the Primal-Dual Hybrid Gradient (PDHG) algorithm for solving massive-scale linear programming (LP) problems. Although PDHG-based solvers demonstrate strong performance on single-node GPU architectures,…

Optimization and Control · Mathematics 2026-05-11 Hongpei Li , Yicheng Huang , Huikang Liu , Dongdong Ge , Yinyu Ye