English
Related papers

Related papers: Unsupervised Learning for Combinatorial Optimizati…

200 papers

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

We consider joint optimization and learning problems arising in real-time decision systems. While most existing work focuses primarily on convex, revenue-based objectives, we extend this line of research to multi-objective formulations. In…

Optimization and Control · Mathematics 2026-04-14 Zijun Li , Aswin Kannan

Multiobjective combinatorial optimization (MOCO) problems can be found in many real-world applications. However, exactly solving these problems would be very challenging, particularly when they are NP-hard. Many handcrafted heuristic…

Machine Learning · Computer Science 2022-05-10 Xi Lin , Zhiyuan Yang , Qingfu Zhang

An increasingly popular method for solving a constrained combinatorial optimisation problem is to first convert it into a quadratic unconstrained binary optimisation (QUBO) problem, and solve it using a standard QUBO solver. However, this…

Machine Learning · Computer Science 2021-03-22 Tian Huang , Siong Thye Goh , Sabrish Gopalakrishnan , Tao Luo , Qianxiao Li , Hoong Chuin Lau

We present a general framework for designing efficient algorithms for unsupervised learning problems, such as mixtures of Gaussians and subspace clustering. Our framework is based on a meta algorithm that learns arithmetic circuits in the…

Data Structures and Algorithms · Computer Science 2023-11-14 Pritam Chandra , Ankit Garg , Neeraj Kayal , Kunal Mittal , Tanmay Sinha

We consider the problem of learning the structure of undirected graphical models with bounded treewidth, within the maximum likelihood framework. This is an NP-hard problem and most approaches consider local search techniques. In this…

Machine Learning · Computer Science 2012-12-12 K. S. Sesh Kumar , Francis Bach

Efficiently training a multi-task neural solver for various combinatorial optimization problems (COPs) has been less studied so far. Naive application of conventional multi-task learning approaches often falls short in delivering a…

Machine Learning · Computer Science 2025-05-27 Chenguang Wang , Zhang-Hua Fu , Pinyan Lu , Tianshu Yu

We focus on the continual learning problem where the tasks arrive sequentially and the aim is to perform well on the newly arrived task without performance degradation on the previously seen tasks. In contrast to the continual learning…

Machine Learning · Statistics 2023-12-06 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

We study inverse optimization (IO), where the goal is to use a parametric optimization program as the hypothesis class to infer relationships between input-decision pairs. Most of the literature focuses on learning only the objective…

Optimization and Control · Mathematics 2025-05-22 Ke Ren , Peyman Mohajerin Esfahani , Angelos Georghiou

Many real-world problems can be reduced to combinatorial optimization on a graph, where the subset or ordering of vertices that maximize some objective function must be found. With such tasks often NP-hard and analytically intractable,…

Machine Learning · Computer Science 2021-03-22 Thomas D. Barrett , William R. Clements , Jakob N. Foerster , A. I. Lvovsky

Unsupervised meta-learning aims to learn feature representations from unsupervised datasets that can transfer to downstream tasks with limited labeled data. In this paper, we propose a novel approach to unsupervised meta-learning that…

Machine Learning · Computer Science 2025-02-11 Anna Vettoruzzo , Lorenzo Braccaioli , Joaquin Vanschoren , Marlena Nowaczyk

Many real-life optimization problems frequently contain one or more constraints or objectives for which there are no explicit formulas. If data is however available, these data can be used to learn the constraints. The benefits of this…

Machine Learning · Computer Science 2022-09-23 Adejuyigbe Fajemisin , Donato Maragno , Dick den Hertog

The end-to-end neural combinatorial optimization (NCO) method shows promising performance in solving complex combinatorial optimization problems without the need for expert design. However, existing methods struggle with large-scale…

Machine Learning · Computer Science 2024-05-03 Fu Luo , Xi Lin , Zhenkun Wang , Xialiang Tong , Mingxuan Yuan , Qingfu Zhang

We consider the problem of learning a low-dimensional signal model from a collection of training samples. The mainstream approach would be to learn an overcomplete dictionary to provide good approximations of the training samples using…

Numerical Analysis · Mathematics 2015-06-05 Mehrdad Yaghoobi , Sangnam Nam , Remi Gribonval , Mike E. Davies

The success of machine learning solutions for reasoning about discrete structures has brought attention to its adoption within combinatorial optimization algorithms. Such approaches generally rely on supervised learning by leveraging…

Machine Learning · Computer Science 2022-03-17 Ismail R. Alkhouri , George K. Atia , Alvaro Velasquez

We introduce a framework to leverage knowledge acquired from a repository of (heterogeneous) supervised datasets to new unsupervised datasets. Our perspective avoids the subjectivity inherent in unsupervised learning by reducing it to…

Artificial Intelligence · Computer Science 2018-02-19 Vikas K. Garg , Adam Kalai

Combinatorial optimization assumes that all parameters of the optimization problem, e.g. the weights in the objective function is fixed. Often, these weights are mere estimates and increasingly machine learning techniques are used to for…

Machine Learning · Computer Science 2019-11-25 Jaynta Mandi , Emir Demirović , Peter. J Stuckey , Tias Guns

Coreference evaluation metrics are hard to optimize directly as they are non-differentiable functions, not easily decomposable into elementary decisions. Consequently, most approaches optimize objectives only indirectly related to the end…

Computation and Language · Computer Science 2017-06-23 Phong Le , Ivan Titov

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised…

Machine Learning · Statistics 2019-04-15 Aditya Grover , Stefano Ermon

Combinatorial optimization problems (COPs) are an important research topic in various fields. In recent times, there have been many attempts to solve COPs using deep learning-based approaches. We propose a novel neural network model that…

Computational Geometry · Computer Science 2023-04-17 Jaeseung Lee , Woojin Choi , Jibum Kim