English
Related papers

Related papers: Generalization and Completeness of Stochastic Loca…

200 papers

Algorithms for learning decision trees often include heuristic local-search operations such as (1) adjusting the threshold of a cut or (2) also exchanging the feature of that cut. We study minimizing the number of classification errors by…

Machine Learning · Computer Science 2025-10-15 Juha Harviainen , Frank Sommer , Manuel Sorge

A great deal of research has been conducted in the consideration of meta-heuristic optimisation methods that are able to find global optima in settings that gradient based optimisers have traditionally struggled. Of these, so-called…

Neural and Evolutionary Computing · Computer Science 2023-05-01 Max D. Champneys , Timothy J. Rogers

Learning a Bayesian network structure from data is an NP-hard problem and thus exact algorithms are feasible only for small data sets. Therefore, network structures for larger networks are usually learned with various heuristics. Another…

Machine Learning · Computer Science 2012-10-19 Teppo Niinimaki , Pekka Parviainen

This paper proposes a novel population-based meta-heuristic optimization algorithm, called Perfectionism Search Algorithm (PSA), which is based on the psychological aspects of perfectionism. The PSA algorithm takes inspiration from one of…

Optimization and Control · Mathematics 2023-10-16 A. Ghodousian , M. Mollakazemiha , N. Karimian

Neural Combinatorial Optimization approaches have recently leveraged the expressiveness and flexibility of deep neural networks to learn efficient heuristics for hard Combinatorial Optimization (CO) problems. However, most of the current…

Machine Learning · Computer Science 2022-10-04 Sahil Manchanda , Sofia Michel , Darko Drakulic , Jean-Marc Andreoli

When combined properly, search techniques can reveal the full potential of sophisticated branching heuristics. We demonstrate this observation on the well-known class of random 3-SAT formulae. First, a new branching heuristic is presented,…

Data Structures and Algorithms · Computer Science 2014-02-19 Sid Mijnders , Boris de Wilde , Marijn Heule

Designing a fast and efficient optimization method with local optima avoidance capability on a variety of optimization problems is still an open problem for many researchers. In this work, the concept of a new global optimization method…

Neural and Evolutionary Computing · Computer Science 2012-08-13 Fereydoun Farrahi Moghaddam , Reza Farrahi Moghaddam , Mohamed Cheriet

Among the most important properties of algorithms investigated in computer science are soundness, completeness, and complexity. These properties, however, are rarely analyzed for the vast collection of recently proposed methods for planning…

Artificial Intelligence · Computer Science 2026-01-23 Michael Katz , Harsha Kokel , Kavitha Srinivas , Shirin Sohrabi

This paper addresses the Restricted Longest Common Subsequence (RLCS) problem, an extension of the well-known Longest Common Subsequence (LCS) problem. This problem has significant applications in bioinformatics, particularly for…

Artificial Intelligence · Computer Science 2024-10-17 Marko Djukanović , Jaume Reixach , Ana Nikolikj , Tome Eftimov , Aleksandar Kartelj , Christian Blum

Training Artificial Neural Networks (ANNs) with Stochastic Gradient Descent (SGD) frequently encounters difficulties, including substantial computing expense and the risk of converging to local optima, attributable to its dependence on…

Neural and Evolutionary Computing · Computer Science 2025-06-23 Gautam Siddharth Kashyap , Md Tabrez Nafis , Samar Wazir

The goal of this paper is twofold. First, it explores hybrid evolutionary-swarm metaheuristics that combine the features of PSO and GA in a sequential, parallel and consecutive manner in comparison with their standard basic form: Genetic…

Neural and Evolutionary Computing · Computer Science 2025-08-04 Piotr Urbańczyk , Aleksandra Urbańczyk , Magdalena Król , Leszek Rutkowski , Marek Kisiel-Dorohinicki

Learning-to-optimize leverages machine learning to accelerate optimization algorithms. While empirical results show tremendous improvements compared to classical optimization algorithms, theoretical guarantees are mostly lacking, such that…

Machine Learning · Computer Science 2025-06-02 Michael Sucker , Peter Ochs

The solution-space structure of the 3-Satisfiability Problem (3-SAT) is studied as a function of the control parameter alpha (ratio of number of clauses to the number of variables) using numerical simulations. For this purpose, one has to…

Disordered Systems and Neural Networks · Physics 2015-05-18 Alexander Mann , A. K. Hartmann

This research introduces a novel heuristic algorithm known as the Snake Locomotion Learning Search algorithm (SLLS) designed to address optimization problems. The SLLS draws inspiration from the locomotion patterns observed in snakes,…

Optimization and Control · Mathematics 2025-04-29 Sheng-Xue He

Local consistencies stronger than arc consistency have received a lot of attention since the early days of CSP research. %because of the strong pruning they can achieve. However, they have not been widely adopted by CSP solvers. This is…

Artificial Intelligence · Computer Science 2017-05-16 Minas Dasygenis , Kostas Stergiou

As we approach the physical limits predicted by Moore's law, a variety of specialized hardware is emerging to tackle specialized tasks in different domains. Within combinatorial optimization, adiabatic quantum computers, CMOS annealers, and…

Data Structures and Algorithms · Computer Science 2020-12-01 Xiaoyuan Liu , Hayato Ushijima-Mwesigwa , Avradip Mandal , Sarvagya Upadhyay , Ilya Safro , Arnab Roy

Large Neighborhood Search (LNS) is a common heuristic in combinatorial optimization that iteratively searches over a large neighborhood of the current solution for a better one. Recently, neural network-based LNS solvers have achieved great…

Machine Learning · Computer Science 2025-08-25 Shengyu Feng , Zhiqing Sun , Yiming Yang

This work focuses on improving state-of-the-art in stochastic local search (SLS) for solving Boolean satisfiability (SAT) instances arising from real-world industrial SAT application domains. The recently introduced SLS method CRSat has…

Artificial Intelligence · Computer Science 2011-09-12 Anton Belov , Matti Järvisalo

Neural network models have a number of hyperparameters that must be chosen along with their architecture. This can be a heavy burden on a novice user, choosing which architecture and what values to assign to parameters. In most cases,…

Neural and Evolutionary Computing · Computer Science 2024-03-07 Séamus Lankford , Diarmuid Grimes

The arrival of AI techniques in computations, with the potential for hallucinations and non-robustness, has made trustworthiness of algorithms a focal point. However, trustworthiness of the many classical approaches are not well understood.…

Optimization and Control · Mathematics 2023-12-19 Alexander Bastounis , Felipe Cucker , Anders C. Hansen