English
Related papers

Related papers: optHIM: Hybrid Iterative Methods for Continuous Op…

200 papers

Oscillator Ising Machines (OIMs) and probabilistic bit (p-bit)-based computing platforms have emerged as promising paradigms for tackling complex combinatorial optimization problems. Although traditionally viewed as distinct approaches,…

Computational Physics · Physics 2026-01-26 E. M. Hasantha Ekanayake , Nikhat Khan , Nikhil Shukla

The graduated optimization approach, also known as the continuation method, is a popular heuristic to solving non-convex problems that has received renewed interest over the last decade. Despite its popularity, very little is known in terms…

Machine Learning · Computer Science 2015-07-28 Elad Hazan , Kfir Y. Levy , Shai Shalev-Shwartz

Large language models (LLMs) have exhibited their problem-solving abilities in mathematical reasoning. Solving realistic optimization (OPT) problems in application scenarios requires advanced and applied mathematics ability. However,…

Machine Learning · Computer Science 2025-06-05 Zhicheng Yang , Yiwei Wang , Yinya Huang , Zhijiang Guo , Wei Shi , Xiongwei Han , Liang Feng , Linqi Song , Xiaodan Liang , Jing Tang

Deep metric learning algorithms have a wide variety of applications, but implementing these algorithms can be tedious and time consuming. PyTorch Metric Learning is an open source library that aims to remove this barrier for both…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Kevin Musgrave , Serge Belongie , Ser-Nam Lim

Enterprise LLM deployment faces a critical scalability challenge: organizations must optimize models systematically to scale AI initiatives within constrained compute budgets, yet the specialized expertise required for manual optimization…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-29 Nicholas Santavas , Kareem Eissa , Patrycja Cieplicka , Piotr Florek , Matteo Nulli , Stefan Vasilev , Seyyed Hadi Hashemi , Antonios Gasteratos , Shahram Khadivi

High-performance GPU kernels are essential for efficient LLM deployment, yet optimizing them remains expertise-intensive. Recent LLM-based code generation makes automatic GPU operator generation promising, but operator optimization remains…

Computation and Language · Computer Science 2026-05-29 Yining Zhang , Mingyang Yi , Chen Wang , Xuwen Xiang , Tianhe Jia , Zedong Dan , Chengqing Zong , Yue Wang

This work presents PANTR, an efficient solver for nonconvex constrained optimization problems, that is well-suited as an inner solver for an augmented Lagrangian method. The proposed scheme combines forward-backward iterations with…

Optimization and Control · Mathematics 2023-06-30 Alexander Bodard , Pieter Pas , Panagiotis Patrinos

We present a hybrid algorithm for optimizing a convex, smooth function over the cone of positive semidefinite matrices. Our algorithm converges to the global optimal solution and can be used to solve general large-scale semidefinite…

Machine Learning · Computer Science 2012-06-22 Soeren Laue

We consider global non-convex optimisation problems under uncertainty. In this setting, it is not possible to implement a desired solution exactly. Instead, any other solution within some distance to the intended solution may be…

Optimization and Control · Mathematics 2020-03-24 Martin Hughes , Marc Goerigk , Trivikram Dokka

We develop an open-source, end-to-end software (named QHDOPT), which can solve nonlinear optimization problems using the quantum Hamiltonian descent (QHD) algorithm. QHDOPT offers an accessible interface and automatically maps tasks to…

Quantum Physics · Physics 2024-09-06 Samuel Kushnir , Jiaqi Leng , Yuxiang Peng , Lei Fan , Xiaodi Wu

Constrained non-convex optimization is fundamentally challenging, as global solutions are generally intractable and constraint qualifications may not hold. However, in many applications, including safe policy optimization in control and…

Optimization and Control · Mathematics 2025-11-14 Ilyas Fatkhullin , Niao He , Guanghui Lan , Florian Wolf

Linear optimization is many times algorithmically simpler than non-linear convex optimization. Linear optimization over matroid polytopes, matching polytopes and path polytopes are example of problems for which we have simple and efficient…

Machine Learning · Computer Science 2015-08-17 Dan Garber , Elad Hazan

We propose a novel, flexible algorithm for combining together metaheuristicoptimizers for non-convex optimization problems. Our approach treatsthe constituent optimizers as a team of complex agents that communicateinformation amongst each…

Neural and Evolutionary Computing · Computer Science 2019-06-06 Sujit Pramod Khanna , Alexander Ororbia

Tackling complex optimization problems often relies on expert-designed heuristics, typically crafted through extensive trial and error. Recent advances demonstrate that large language models (LLMs), when integrated into well-designed…

Neural and Evolutionary Computing · Computer Science 2025-05-20 Ziyao Huang , Weiwei Wu , Kui Wu , Jianping Wang , Wei-Bin Lee

In this paper, we present a generic framework to extend existing uniformly optimal convex programming algorithms to solve more general nonlinear, possibly nonconvex, optimization problems. The basic idea is to incorporate a local search…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan , Hongchao Zhang

SOMIM is an open-source code that implements a Search for Optimal Measurements by using an Iterative Method. For a given set of statistical operators, SOMIM finds the POVMs that maximizes the accessed information, and thus determines the…

Quantum Physics · Physics 2011-03-15 Kean Loon Lee , Jiangwei Shang , Wee Kang Chua , Shiang Yong Looi , Berthold-Georg Englert

Quantum algorithms are getting extremely popular due to their potential to significantly outperform classical algorithms. Yet, applying quantum algorithms to optimization problems meets challenges related to the efficiency of quantum…

Ptychography has become an indispensable tool for high-resolution, non-destructive imaging using coherent light sources. The processing of ptychographic data critically depends on robust, efficient, and flexible computational reconstruction…

We examine popular gradient-based algorithms for nonlinear control in the light of the modern complexity analysis of first-order optimization algorithms. The examination reveals that the complexity bounds can be clearly stated in terms of…

Optimization and Control · Mathematics 2019-08-22 Vincent Roulet , Siddhartha Srinivasa , Dmitriy Drusvyatskiy , Zaid Harchaoui

This paper introduces PolyDiM, an open-source C++ library tailored for the development and implementation of polytopal discretization methods for partial differential equations. The library provides robust and modular tools to support…

Numerical Analysis · Mathematics 2025-05-21 Stefano Berrone , Andrea Borio , Gioana Teora , Fabio Vicini