English
Related papers

Related papers: Learning with Local Search MCMC Layers

200 papers

We study combinatorial problems with real world applications such as machine scheduling, routing, and assignment. We propose a method that combines Reinforcement Learning (RL) and planning. This method can equally be applied to both the…

Machine Learning · Computer Science 2021-05-19 Joel Oren , Chana Ross , Maksym Lefarov , Felix Richter , Ayal Taitler , Zohar Feldman , Christian Daniel , Dotan Di Castro

This paper presents a methodology for integrating machine learning techniques into metaheuristics for solving combinatorial optimization problems. Namely, we propose a general machine learning framework for neighbor generation in…

Optimization and Control · Mathematics 2022-12-23 Defeng Liu , Vincent Perreault , Alain Hertz , Andrea Lodi

The integration of Large Language Models (LLMs) into evolutionary frameworks has established a new paradigm for automated heuristic discovery. Despite their promise, these methods typically search in the discrete space of program syntax,…

Artificial Intelligence · Computer Science 2026-05-19 Cheikh Ahmed , Mahdi Mostajabdaveh , Zirui Zhou

The contribution of this paper is a framework for training and evaluation of Model Predictive Control (MPC) implemented using constrained neural networks. Recent studies have proposed to use neural networks with differentiable convex…

Machine Learning · Statistics 2020-05-11 Rebecka Winqvist , Arun Venkitaraman , Bo Wahlberg

Branch-and-bound is a systematic enumerative method for combinatorial optimization, where the performance highly relies on the variable selection strategy. State-of-the-art handcrafted heuristic strategies suffer from relatively slow…

Machine Learning · Computer Science 2022-06-15 Tianyu Zhang , Amin Banitalebi-Dehkordi , Yong Zhang

Large Neighborhood Search (LNS) is a common heuristic in combinatorial optimization that iteratively searches over a large neighborhood of the current solution for a better one. Recently, neural network-based LNS solvers have achieved great…

Machine Learning · Computer Science 2025-08-25 Shengyu Feng , Zhiqing Sun , Yiming Yang

Among sub-optimal MAPF solvers, rule-based algorithms are particularly appealing since they are complete. Even in crowded scenarios, they allow finding a feasible solution that brings each agent to its target, preventing deadlock…

Optimization and Control · Mathematics 2024-04-10 S. Ardizzoni , I. Saccani , L. Consolini , M. Locatelli

Finding high-quality solutions to mixed-integer linear programming problems (MILPs) is of great importance for many practical applications. In this respect, the refinement heuristic local branching (LB) has been proposed to produce…

Optimization and Control · Mathematics 2022-08-04 Defeng Liu , Matteo Fischetti , Andrea Lodi

Tasks such as record linkage and multi-target tracking, which involve reconstructing the set of objects that underlie some observed data, are particularly challenging for probabilistic inference. Recent work has achieved efficient and…

Artificial Intelligence · Computer Science 2012-07-02 Brian Milch , Stuart Russell

Local search has recently been applied to SMT problems over various arithmetic theories. Among these, nonlinear real arithmetic poses special challenges due to its uncountable solution space and potential need to solve higher-degree…

Symbolic Computation · Computer Science 2023-11-27 Zhonghan Wang , Bohua Zhan , Bohan Li , Shaowei Cai

Deep Metric Learning (DML) models often require strong local and global representations, however, effective integration of local and global features in DML model training is a challenge. DML models are often trained with specific loss…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Mohammad K. Ebrahimpour , Gang Qian , Allison Beach

We present a learning-based approach to computing solutions for certain NP-hard problems. Our approach combines deep learning techniques with useful algorithmic elements from classic heuristics. The central component is a graph…

Machine Learning · Computer Science 2018-10-26 Zhuwen Li , Qifeng Chen , Vladlen Koltun

Deep learning approaches have shown promising results in solving routing problems. However, there is still a substantial gap in solution quality between machine learning and operations research algorithms. Recently, another line of research…

Artificial Intelligence · Computer Science 2021-09-20 Nasrin Sultana , Jeffrey Chan , Tabinda Sarwar , Babak Abbasi , A. K. Qin

Recently, neural heuristics based on deep reinforcement learning have exhibited promise in solving multi-objective combinatorial optimization problems (MOCOPs). However, they are still struggling to achieve high learning efficiency and…

Machine Learning · Computer Science 2023-10-25 Jinbiao Chen , Jiahai Wang , Zizhen Zhang , Zhiguang Cao , Te Ye , Siyuan Chen

Reinforcement learning-based methods for constructing solutions to combinatorial optimization problems are rapidly approaching the performance of human-designed algorithms. To further narrow the gap, learning-based approaches must…

Machine Learning · Computer Science 2025-10-07 André Hottung , Mridul Mahajan , Kevin Tierney

We study the problem of learning differentiable functions expressed as programs in a domain-specific language. Such programmatic models can offer benefits such as composability and interpretability; however, learning them requires…

Machine Learning · Computer Science 2021-03-30 Ameesh Shah , Eric Zhan , Jennifer J. Sun , Abhinav Verma , Yisong Yue , Swarat Chaudhuri

One notable weakness of current machine learning algorithms is the poor ability of models to solve new problems without forgetting previously acquired knowledge. The Continual Learning paradigm has emerged as a protocol to systematically…

Machine Learning · Computer Science 2022-11-16 Heinke Hihn , Daniel A. Braun

Local search metaheuristics like tabu search or simulated annealing are popular heuristic optimization algorithms for finding near-optimal solutions for combinatorial optimization problems. However, it is still challenging for researchers…

Neural and Evolutionary Computing · Computer Science 2024-07-30 Rubén Ruiz-Torrubiano

Large Neighborhood Search (LNS) is a popular heuristic algorithm for solving combinatorial optimization problems (COP). It starts with an initial solution to the problem and iteratively improves it by searching a large neighborhood around…

Artificial Intelligence · Computer Science 2023-06-02 Taoan Huang , Aaron Ferber , Yuandong Tian , Bistra Dilkina , Benoit Steiner

Multi-Agent Path Finding (MAPF) aims to arrange collision-free goal-reaching paths for a group of agents. Anytime MAPF solvers based on large neighborhood search (LNS) have gained prominence recently due to their flexibility and…

Robotics · Computer Science 2025-05-30 Jiaqi Tan , Yudong Luo , Jiaoyang Li , Hang Ma