English
Related papers

Related papers: Customized Exploration of Landscape Features Drivi…

200 papers

Neural Combinatorial Optimization attempts to learn good heuristics for solving a set of problems using Neural Network models and Reinforcement Learning. Recently, its good performance has encouraged many practitioners to develop neural…

Artificial Intelligence · Computer Science 2022-05-04 Andoni I. Garmendia , Josu Ceberio , Alexander Mendiburu

Land use and land cover (LULC) classification using remote sensing imagery plays a vital role in many environment modeling and land use inventories. In this study, a hybrid feature optimization algorithm along with a deep learning…

Image and Video Processing · Electrical Eng. & Systems 2020-11-10 R. Ganesh Babu , K. Uma Maheswari , C. Zarro , B. D. Parameshachari , S. L. Ullo

Combinatorial Optimization problems are widespread in domains such as logistics, manufacturing, and drug discovery, yet their NP-hard nature makes them computationally challenging. Recent Neural Combinatorial Optimization methods leverage…

Machine Learning · Statistics 2025-06-05 Sobihan Surendran , Adeline Fermanian , Sylvain Le Corff

This thesis designs a prediction system based on matrix factorization to predict the classification accuracy of a specific model on a particular dataset. In this thesis, we conduct comprehensive empirical research on more than fifty…

Machine Learning · Computer Science 2023-05-02 Yunbo Dong

Choosing the best-performing optimizer(s) out of a portfolio of optimization algorithms is usually a difficult and complex task. It gets even worse, if the underlying functions are unknown, i.e., so-called Black-Box problems, and function…

Machine Learning · Statistics 2017-08-18 Pascal Kerschke

Autonomous navigation often requires the simultaneous optimization of multiple objectives. The most common approach scalarizes these into a single cost function using a weighted sum, but this method is unable to find all possible trade-offs…

Robotics · Computer Science 2026-04-07 Krishna Kalavadia , Shamak Dutta , Yash Vardhan Pant , Stephen L. Smith

Characterizing the loss of a neural network with respect to model parameters, i.e., the loss landscape, can provide valuable insights into properties of that model. Various methods for visualizing loss landscapes have been proposed, but…

In this paper we enhance Generalized Self-Adapting Particle Swarm Optimization algorithm (GAPSO), initially introduced at the Parallel Problem Solving from Nature 2018 conference, and to investigate its properties. The research on GAPSO is…

Neural and Evolutionary Computing · Computer Science 2020-03-02 Michał Okulewicz , Mateusz Zaborski , Jacek Mańdziuk

Machine-learning algorithms have gained popularity in recent years in the field of ecological modeling due to their promising results in predictive performance of classification problems. While the application of such algorithms has been…

Machine Learning · Statistics 2019-10-07 Patrick Schratz , Jannes Muenchow , Eugenia Iturritxa , Jakob Richter , Alexander Brenning

Molecular optimization, which aims to discover improved molecules from a vast chemical search space, is a critical step in chemical development. Various artificial intelligence technologies have demonstrated high effectiveness and…

Chemical Physics · Physics 2024-11-26 Xin Xia , Yajie Zhang , Xiangxiang Zeng , Xingyi Zhang , Chunhou Zheng , Yansen Su

Bayesian optimization (BO) is an efficient framework for solving black-box optimization problems with expensive function evaluations. This paper addresses the BO problem setting for combinatorial spaces (e.g., sequences and graphs) that…

Machine Learning · Computer Science 2022-02-07 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa

There are many surprising and perhaps counter-intuitive properties of optimization of deep neural networks. We propose and experimentally verify a unified phenomenological model of the loss landscape that incorporates many of them. High…

Machine Learning · Computer Science 2019-06-12 Stanislav Fort , Stanislaw Jastrzebski

The main feature of the Dynamic Multi-objective Optimization Problems (DMOPs) is that optimization objective functions will change with times or environments. One of the promising approaches for solving the DMOPs is reusing the obtained…

Neural and Evolutionary Computing · Computer Science 2019-10-22 Weizhen Hu , Min Jiang , Xing Gao , Kay Chen Tan , Yiu-ming Cheung

Scalability of evolutionary algorithms refers to assessing how their performance changes as problem size increases. In the area of multi-objective optimisation, research on the scalability of multi-objective evolutionary algorithms (MOEAs)…

Neural and Evolutionary Computing · Computer Science 2026-04-21 Menghao Tang , Zimin Liang , Miqing Li

Feature selection is a crucial step in machine learning, especially for high-dimensional datasets, where irrelevant and redundant features can degrade model performance and increase computational costs. This paper proposes a novel…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Azam Asilian Bidgoli , Shahryar Rahnamayan

We analyze statistical features of the ``optimization landscape'' in a random version of one of the simplest constrained optimization problems of the least-square type: finding the best approximation for the solution of an overcomplete…

Mathematical Physics · Physics 2022-06-08 Yan V. Fyodorov , Rashel Tublin

Hyperparameter optimization (HPO) is important to leverage the full potential of machine learning (ML). In practice, users are often interested in multi-objective (MO) problems, i.e., optimizing potentially conflicting objectives, like…

Machine Learning · Computer Science 2024-01-12 Joseph Giovanelli , Alexander Tornede , Tanja Tornede , Marius Lindauer

Parametric multi-objective optimization (PMO) addresses the challenge of solving an infinite family of multi-objective optimization problems, where optimal solutions must adapt to varying parameters. Traditional methods require re-execution…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Ji Cheng , Bo Xue , Qingfu Zhang

Local search is a fundamental optimization technique that is both widely used in practice and deeply studied in theory, yet its computational complexity remains poorly understood. The traditional frameworks, PLS and the standard algorithm…

Computational Complexity · Computer Science 2026-01-05 Robert Ganian , Hung P. Hoang , Christian Komusiewicz , Nils Morawietz

The knapsack problem (KP) and its multidimensional version (MKP) are basic problems in combinatorial optimization. In this paper we consider their multiobjective extension (MOKP and MOMKP), for which the aim is to obtain or to approximate…

Discrete Mathematics · Computer Science 2010-07-26 Thibaut Lust , Jacques Teghem