English
Related papers

Related papers: Generative-enhanced optimization for knapsack prob…

200 papers

Optimization problems are ubiquitous in our societies and are present in almost every segment of the economy. Most of these optimization problems are NP-hard and computationally demanding, often requiring approximate solutions for…

Optimization and Control · Mathematics 2021-06-23 James Kotary , Ferdinando Fioretto , Pascal Van Hentenryck

In multi-objective optimization, multiple loss terms are weighted and added together to form a single objective. These weights are chosen to properly balance the competing losses according to some meta-goal. For example, in physics-informed…

Numerical Analysis · Mathematics 2025-11-20 Max Hirsch , Federico Pichi

Convolutional neural networks (CNNs) have gained widespread usage across various fields such as weather forecasting, computer vision, autonomous driving, and medical image analysis due to its exceptional ability to extract spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Alifu Xiafukaiti , Devanshu Garg , Aruto Hosaka , Koichi Yanagisawa , Yuichiro Minato , Tsuyoshi Yoshida

In recent years, to sustain the resource-intensive computational needs for training deep neural networks (DNNs), it is widely accepted that exploiting the parallelism in large-scale computing clusters is critical for the efficient…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-31 Menglu Yu , Chuan Wu , Bo Ji , Jia Liu

We present GenusSink, a new class of approximate generalized Sinkhorn algorithms with shortest-path-distance costs for bounded genus (e.g. planar) graphs, providing near-linear time: (1) pre-processing, (2) iteration step, (3) final…

Data Structures and Algorithms · Computer Science 2026-05-19 Krzysztof Choromanski , Derek Long , Ananya Parashar , Dwaipayan Saha

Many scientific and technological problems are related to optimization. Among them, black-box optimization in high-dimensional space is particularly challenging. Recent neural network-based black-box optimization studies have shown…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Changhwi Park

Optimization problem, which is aimed at finding the global minimal value of a given cost function, is one of the central problem in science and engineering. Various numerical methods have been proposed to solve this problem, among which the…

Optimization and Control · Mathematics 2022-10-07 Shaojun Dong , Fengyu Le , Meng Zhang , Si-Jing Tao , Chao Wang , Yong-Jian Han , Guo-Ping Guo

Generative Adversarial Networks (GANs) have achieved remarkable results in the task of generating realistic natural images. In most successful applications, GAN models share two common aspects: solving a challenging saddle point…

Machine Learning · Statistics 2019-05-21 Piotr Bojanowski , Armand Joulin , David Lopez-Paz , Arthur Szlam

We propose a Randomised Subspace Gauss-Newton (R-SGN) algorithm for solving nonlinear least-squares optimization problems, that uses a sketched Jacobian of the residual in the variable domain and solves a reduced linear least-squares on…

Optimization and Control · Mathematics 2022-11-11 Coralia Cartis , Jaroslav Fowkes , Zhen Shao

Amplitude Amplification offers a provable speedup for search problems, which is leveraged in combinatorial optimization by Grover Adaptive Search (GAS). The protocol demands deep circuits that are challenging with regards to NISQ…

Quantum Physics · Physics 2026-04-08 Laurin Demmler , Maximilian Hess

In this work, we present a Gauss-Newton based quantum algorithm (GNQA) for combinatorial optimization problems that, under optimal conditions, rapidly converges towards one of the optimal solutions without being trapped in local minima or…

Quantum Physics · Physics 2022-06-20 Mitsuharu Takeori , Takahiro Yamamoto , Ryutaro Ohira , Shungo Miyabe

The paper studies the solution of stochastic optimization problems in which approximations to the gradient and Hessian are obtained through subsampling. We first consider Newton-like methods that employ these approximations and discuss how…

Optimization and Control · Mathematics 2016-09-28 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

Quantum optimization holds promise for addressing classically intractable combinatorial problems, yet a standardized framework for benchmarking its performance, particularly in terms of solution quality, computational speed, and scalability…

Quantum Physics · Physics 2025-03-20 Monit Sharma , Hoong Chuin Lau

Combinatorial optimization (CO) problems arise across a broad spectrum of domains, including medicine, logistics, and manufacturing. While exact solutions are often computationally infeasible, many practical applications require…

Machine Learning · Computer Science 2025-05-27 Arman Mielke , Uwe Bauknecht , Thilo Strauss , Mathias Niepert

Quadratic multiple knapsack problem (QMKP) is a combinatorial optimisation problem characterised by multiple weight capacity constraints and a profit function that combines linear and quadratic profits. We study a stochastic variant of this…

Neural and Evolutionary Computing · Computer Science 2025-11-05 Kokila Kasuni Perera , Aneta Neumann

We present a systematic study of Tensor Network (TN) models $\unicode{x2013}$ Matrix Product States (MPS) and Tree Tensor Networks (TTN) $\unicode{x2013}$ for real-time jet tagging in high-energy physics, with a focus on low-latency…

This work presents a novel lattice-based methodology for incorporating multidimensional constraints into continuous decision variables within a genetic algorithm (GA) framework. The proposed approach consolidates established transcription…

Neural and Evolutionary Computing · Computer Science 2024-10-17 Cameron D. Harris , Kevin B. Schroeder , Jonathan Black

The recent advancements in small-size inference models facilitated AI deployment on the edge. However, the limited resource nature of edge devices poses new challenges especially for real-time applications. Deploying multiple inference…

Machine Learning · Computer Science 2024-03-03 Abdelkarim Ben Sada , Amar Khelloufi , Abdenacer Naouri , Huansheng Ning , Sahraoui Dhelim

One of the most fundamental problems in Computer Science is the Knapsack problem. Given a set of n items with different weights and values, it asks to pick the most valuable subset whose total weight is below a capacity threshold T. Despite…

Data Structures and Algorithms · Computer Science 2018-07-16 Kyriakos Axiotis , Christos Tzamos

The Bilevel Optimization Problem is a hierarchical optimization problem with two agents, a leader and a follower. The leader make their own decisions first, and the followers make the best choices accordingly. The leader knows the…

Artificial Intelligence · Computer Science 2023-12-12 Sunhyeon Kwon , Hwayong Choi , Sungsoo Park