English
Related papers

Related papers: PolyNet: Learning Diverse Solution Strategies for …

200 papers

Machine learning has increasingly been employed to solve NP-hard combinatorial optimization problems, resulting in the emergence of neural solvers that demonstrate remarkable performance, even with minimal domain-specific knowledge. To…

Optimization and Control · Mathematics 2025-05-27 Chengrui Gao , Haopu Shang , Ke Xue , Chao Qian

Real-world applications often combine learning and optimization problems on graphs. For instance, our objective may be to cluster the graph in order to detect meaningful communities (or solve other common graph optimization problems such as…

Machine Learning · Computer Science 2020-01-09 Bryan Wilder , Eric Ewing , Bistra Dilkina , Milind Tambe

Combinatorial optimization problems are pervasive across science and industry. Modern deep learning tools are poised to solve these problems at unprecedented scales, but a unifying framework that incorporates insights from statistical…

Machine Learning · Computer Science 2022-04-26 Martin J. A. Schuetz , J. Kyle Brubaker , Helmut G. Katzgraber

Current methods for end-to-end constructive neural combinatorial optimization usually train a policy using behavior cloning from expert solutions or policy gradient methods from reinforcement learning. While behavior cloning is…

Machine Learning · Computer Science 2024-11-05 Jonathan Pirnay , Dominik G. Grimm

Existing approaches to solving combinatorial optimization problems on graphs suffer from the need to engineer each problem algorithmically, with practical problems recurring in many instances. The practical side of theoretical computer…

Machine Learning · Computer Science 2020-07-15 Natalia Vesselinova , Rebecca Steinert , Daniel F. Perez-Ramirez , Magnus Boman

Decomposition methods have been proposed to approximate solutions to large sequential decision making problems. In contexts where an agent interacts with multiple entities, utility decomposition can be used to separate the global objective…

Machine Learning · Computer Science 2019-04-24 Maxime Bouton , Kyle Julian , Alireza Nakhaei , Kikuo Fujimura , Mykel J. Kochenderfer

The design of neural network architectures is frequently either based on human expertise using trial/error and empirical feedback or tackled via large scale reinforcement learning strategies performed over distinct discrete architecture…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Yunyang Xiong , Ronak Mehta , Vikas Singh

Constrained optimization problems appear in a wide variety of challenging real-world problems, where constraints often capture the physics of the underlying system. Classic methods for solving these problems rely on iterative algorithms…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Meiyi Li , Soheil Kolouri , Javad Mohammadi

We present a learning-based approach to computing solutions for certain NP-hard problems. Our approach combines deep learning techniques with useful algorithmic elements from classic heuristics. The central component is a graph…

Machine Learning · Computer Science 2018-10-26 Zhuwen Li , Qifeng Chen , Vladlen Koltun

Combinatorial optimization (CO) problems are often NP-hard and thus out of reach for exact algorithms, making them a tempting domain to apply machine learning methods. The highly structured constraints in these problems can hinder either…

Machine Learning · Computer Science 2023-11-21 Dinghuai Zhang , Hanjun Dai , Nikolay Malkin , Aaron Courville , Yoshua Bengio , Ling Pan

While reinforcement learning (RL) holds great potential for decision making in the real world, it suffers from a number of unique difficulties which often need specific consideration. In particular: it is highly non-stationary; suffers from…

Machine Learning · Computer Science 2025-04-16 Alexander David Goldie , Chris Lu , Matthew Thomas Jackson , Shimon Whiteson , Jakob Nicolaus Foerster

Conic optimization has recently emerged as a powerful tool for designing tractable and guaranteed algorithms for non-convex polynomial optimization problems. On the one hand, tractability is crucial for efficiently solving large-scale…

We study the problem of learning a good search policy for combinatorial search spaces. We propose retrospective imitation learning, which, after initial training by an expert, improves itself by learning from \textit{retrospective…

Machine Learning · Computer Science 2019-06-25 Jialin Song , Ravi Lanka , Albert Zhao , Aadyot Bhatnagar , Yisong Yue , Masahiro Ono

Most of existing neural methods for multi-objective combinatorial optimization (MOCO) problems solely rely on decomposition, which often leads to repetitive solutions for the respective subproblems, thus a limited Pareto set. Beyond…

Machine Learning · Computer Science 2023-10-25 Jinbiao Chen , Zizhen Zhang , Zhiguang Cao , Yaoxin Wu , Yining Ma , Te Ye , Jiahai Wang

Algorithm design is a laborious process and often requires many iterations of ideation and validation. In this paper, we explore automating algorithm design and present a method to learn an optimization algorithm, which we believe to be the…

Machine Learning · Computer Science 2016-06-07 Ke Li , Jitendra Malik

Discrete optimization is a central problem in mathematical optimization with a broad range of applications, among which binary optimization and sparse optimization are two common ones. However, these problems are NP-hard and thus difficult…

Optimization and Control · Mathematics 2018-11-26 Ganzhao Yuan , Li Shen , Wei-Shi Zheng

Being able to solve a task in diverse ways makes agents more robust to task variations and less prone to local optima. In this context, constrained diversity optimization has become a useful reinforcement learning (RL) framework for…

Machine Learning · Computer Science 2026-05-13 Cornelius V. Braun , Sayantan Auddy , Marc Toussaint

Reinforcement learning algorithms are typically limited to learning a single solution for a specified task, even though diverse solutions often exist. Recent studies showed that learning a set of diverse solutions is beneficial because…

Machine Learning · Statistics 2022-04-14 Takayuki Osa , Voot Tangkaratt , Masashi Sugiyama

Discrete optimization belongs to the set of $\mathcal{NP}$-hard problems, spanning fields such as mixed-integer programming and combinatorial optimization. A current standard approach to solving convex discrete optimization problems is the…

Machine Learning · Computer Science 2024-02-28 Kyle Mana , Fernando Acero , Stephen Mak , Parisa Zehtabi , Michael Cashmore , Daniele Magazzeni , Manuela Veloso

Combinatorial optimization has found applications in numerous fields, from aerospace to transportation planning and economics. The goal is to find an optimal solution among a finite set of possibilities. The well-known challenge one faces…

Artificial Intelligence · Computer Science 2020-06-03 Quentin Cappart , Thierry Moisan , Louis-Martin Rousseau , Isabeau Prémont-Schwarz , Andre Cire