English
Related papers

Related papers: Learning with Local Search MCMC Layers

200 papers

As we approach the physical limits predicted by Moore's law, a variety of specialized hardware is emerging to tackle specialized tasks in different domains. Within combinatorial optimization, adiabatic quantum computers, CMOS annealers, and…

Data Structures and Algorithms · Computer Science 2020-12-01 Xiaoyuan Liu , Hayato Ushijima-Mwesigwa , Avradip Mandal , Sarvagya Upadhyay , Ilya Safro , Arnab Roy

The paper presents a study of local search heuristics in general and variable neighborhood search in particular for the resolution of an assignment problem studied in the practical work of universities. Here, students have to be assigned to…

Artificial Intelligence · Computer Science 2008-09-08 Martin Josef Geiger , Wolf Wenger

Combinatorial optimization is widely applied in a number of areas nowadays. Unfortunately, many combinatorial optimization problems are NP-hard which usually means that they are unsolvable in practice. However, it is often unnecessary to…

Data Structures and Algorithms · Computer Science 2012-07-10 Daniel Karapetyan

Distributed word embeddings have shown superior performances in numerous Natural Language Processing (NLP) tasks. However, their performances vary significantly across different tasks, implying that the word embeddings learnt by those…

Computation and Language · Computer Science 2017-09-21 Danushka Bollegala , Kohei Hayashi , Ken-ichi Kawarabayashi

Combinatorial Optimization underpins many real-world applications and yet, designing performant algorithms to solve these complex, typically NP-hard, problems remains a significant research challenge. Reinforcement Learning (RL) provides a…

Learning how to automatically solve optimization problems has the potential to provide the next big leap in optimization technology. The performance of automatically learned heuristics on routing problems has been steadily improving in…

Artificial Intelligence · Computer Science 2020-12-01 André Hottung , Kevin Tierney

Effective implementations of sampling-based probabilistic inference often require manually constructed, model-specific proposals. Inspired by recent progresses in meta-learning for training learning agents that can generalize to unseen…

Artificial Intelligence · Computer Science 2019-01-03 Tongzhou Wang , Yi Wu , David A. Moore , Stuart J. Russell

We introduce Limited Rollout Beam Search (LRBS), a beam search strategy for deep reinforcement learning (DRL) based combinatorial optimization improvement heuristics. Utilizing pre-trained models on the Euclidean Traveling Salesperson…

Machine Learning · Computer Science 2024-12-16 Federico Julian Camerota Verdù , Lorenzo Castelli , Luca Bortolussi

Traditional MCMC algorithms are computationally intensive and do not scale well to large data. In particular, the Metropolis-Hastings (MH) algorithm requires passing over the entire dataset to evaluate the likelihood ratio in each…

Machine Learning · Statistics 2019-08-29 Tung-Yu Wu , Y. X. Rachel Wang , Wing H. Wong

This paper presents a novel neural network design that learns the heuristic for Large Neighborhood Search (LNS). LNS consists of a destroy operator and a repair operator that specify a way to carry out the neighborhood search to solve the…

Neural and Evolutionary Computing · Computer Science 2020-05-20 Mingxiang Chen , Lei Gao , Qichang Chen , Zhixin Liu

Learning in networks of binary synapses is known to be an NP-complete problem. A combined stochastic local search strategy in the synaptic weight space is constructed to further improve the learning performance of a single random walker. We…

Disordered Systems and Neural Networks · Physics 2011-11-18 Haiping Huang , Haijun Zhou

We propose a Large Neighborhood Search (LNS) approach utilizing a learned construction heuristic based on neural networks as repair operator to solve the vehicle routing problem with time windows (VRPTW). Our method uses graph neural…

Machine Learning · Computer Science 2022-05-11 Jonas K. Falkner , Daniela Thyssens , Lars Schmidt-Thieme

Large Neighborhood Search (LNS) is a universal approach that is broadly applicable and has proven to be highly efficient in practice for solving optimization problems. We propose to integrate machine learning (ML) into LNS to assist in…

Machine Learning · Computer Science 2024-03-15 Willem Feijen , Guido Schäfer , Koen Dekker , Seppo Pieterse

Local Optima Networks (LONs) have been recently proposed as an alternative model of combinatorial fitness landscapes. The model compresses the information given by the whole search space into a smaller mathematical object that is the graph…

Artificial Intelligence · Computer Science 2012-10-16 Fabio Daolio , Sébastien Verel , Gabriela Ochoa , Marco Tomassini

Discovering the low-energy conformations of a molecule is of great interest to computational chemists, with applications in {\em in silico} materials design and drug discovery. In this paper, we propose a variable neighbourhood search…

Quantum Physics · Physics 2019-06-25 D. J. J. Marchand , M. Noori , A. Roberts , G. Rosenberg , B. Woods , U. Yildiz , M. Coons , D. Devore , P. Margl

Applying local search algorithms to combinatorial optimization problems is not an easy feat. Typically, human intervention is required to compile the constraints to input data for some metaheuristic algorithm. In this paper, we establish a…

Artificial Intelligence · Computer Science 2026-05-20 Jo Devriendt , Patrick De Causmaecker , Marc Denecker

A key challenge in solving a combinatorial optimization problem is how to guide the agent (i.e., solver) to efficiently explore the enormous search space. Conventional approaches often rely on enumeration (e.g., exhaustive, random, or tabu…

Artificial Intelligence · Computer Science 2020-08-11 Xingwen Zhang , Shuang Yang

In recent years, combining neural networks with local search heuristics has become popular in the field of combinatorial optimization. Despite its considerable computational demands, this approach has exhibited promising outcomes with…

Artificial Intelligence · Computer Science 2023-11-01 Ankur Nath , Alan Kuhnle

This paper addresses the Restricted Longest Common Subsequence (RLCS) problem, an extension of the well-known Longest Common Subsequence (LCS) problem. This problem has significant applications in bioinformatics, particularly for…

Artificial Intelligence · Computer Science 2024-10-17 Marko Djukanović , Jaume Reixach , Ana Nikolikj , Tome Eftimov , Aleksandar Kartelj , Christian Blum

This paper presents a framework to tackle constrained combinatorial optimization problems using deep Reinforcement Learning (RL). To this end, we extend the Neural Combinatorial Optimization (NCO) theory in order to deal with constraints in…

Machine Learning · Computer Science 2020-06-23 Ruben Solozabal , Josu Ceberio , Martin Takáč