English
Related papers

Related papers: Improving Pareto Set Learning for Expensive Multi-…

200 papers

Many real-world applications require solving families of expensive multi-objective optimization problems~(EMOPs) under varying operational conditions. This can be formulated as parametric expensive multi-objective optimization problems…

Machine Learning · Computer Science 2026-05-11 Tingyang Wei , Jiao Liu , Abhishek Gupta , Chin Chun Ooi , Puay Siew Tan , Yew-Soon Ong

In many real-world applications, the Pareto Set (PS) of a continuous multiobjective optimization problem can be a piecewise continuous manifold. A decision maker may want to find a solution set that approximates a small part of the PS and…

Neural and Evolutionary Computing · Computer Science 2024-04-02 Ping Guo , Qingfu Zhang , Xi Lin

Multiobjective combinatorial optimization (MOCO) problems can be found in many real-world applications. However, exactly solving these problems would be very challenging, particularly when they are NP-hard. Many handcrafted heuristic…

Machine Learning · Computer Science 2022-05-10 Xi Lin , Zhiyuan Yang , Qingfu Zhang

Asynchronous distributed algorithms are a popular way to reduce synchronization costs in large-scale optimization, and in particular for neural network training. However, for nonsmooth and nonconvex objectives, few convergence guarantees…

Optimization and Control · Mathematics 2020-07-14 Vyacheslav Kungurtsev , Malcolm Egan , Bapi Chatterjee , Dan Alistarh

Despite the recent progress in hyperparameter optimization (HPO), available benchmarks that resemble real-world scenarios consist of a few and very large problem instances that are expensive to solve. This blocks researchers and…

Machine Learning · Computer Science 2019-11-26 Aaron Klein , Zhenwen Dai , Frank Hutter , Neil Lawrence , Javier Gonzalez

The paper describes the proposition and application of a local search metaheuristic for multi-objective optimization problems. It is based on two main principles of heuristic search, intensification through variable neighborhoods, and…

Artificial Intelligence · Computer Science 2008-09-03 Martin Josef Geiger

In neural networks, continual learning results in gradient interference among sequential tasks, leading to catastrophic forgetting of old tasks while learning new ones. This issue is addressed in recent methods by storing the important…

Machine Learning · Computer Science 2023-02-06 Gobinda Saha , Kaushik Roy

Echo State Network (ESN) presents a distinguished kind of recurrent neural networks. It is built upon a sparse, random and large hidden infrastructure called reservoir. ESNs have succeeded in dealing with several non-linear problems such as…

Neural and Evolutionary Computing · Computer Science 2018-06-12 Naima Chouikhi , Boudour Ammar , Adel M. Alimi

In multi-goal Reinforcement Learning, an agent can share experience between related training tasks, resulting in better generalization for new tasks at test time. However, when the goal space has discontinuities and the reward is sparse, a…

Machine Learning · Computer Science 2023-05-03 Nicolas Castanet , Sylvain Lamprier , Olivier Sigaud

Identifying the most representative subset for a close-to-submodular objective while satisfying the predefined partition constraint is a fundamental task with numerous applications in machine learning. However, the existing distorted…

Machine Learning · Computer Science 2026-03-24 Qixin Zhang , Wei Huang , Yan Sun , Yao Shu , Yi Yu , Dacheng Tao

Many-objective optimisation, a subset of multi-objective optimisation, involves optimisation problems with more than three objectives. As the number of objectives increases, the number of solutions needed to adequately represent the entire…

Artificial Intelligence · Computer Science 2026-04-13 Chao Jiang , Jingyu Huang , Miqing Li

Zero-shot hyperparameter optimization (HPO) is a simple yet effective use of transfer learning for constructing a small list of hyperparameter (HP) configurations that complement each other. That is to say, for any given dataset, at least…

Machine Learning · Statistics 2020-07-28 Fela Winkelmolen , Nikita Ivkin , H. Furkan Bozkurt , Zohar Karnin

While many Particle Swarm Optimization (PSO) algorithms only use fitness to assess the performance of particles, in this work, we adopt Surprisingly Popular Algorithm (SPA) as a complementary metric in addition to fitness. Consequently,…

Neural and Evolutionary Computing · Computer Science 2023-09-14 Xuan Wu , Jizong Han , Di Wang , Pengyue Gao , Quanlong Cui , Liang Chen , Yanchun Liang , Han Huang , Heow Pueh Lee , Chunyan Miao , You Zhou , Chunguo Wu

In the domain of multi-objective optimization, evolutionary algorithms are distinguished by their capability to generate a diverse population of solutions that navigate the trade-offs inherent among competing objectives. This has catalyzed…

Neural and Evolutionary Computing · Computer Science 2025-01-07 Yuxin Ma , Zherui Zhang , Ran Cheng , Yaochu Jin , Kay Chen Tan

Coverage optimization generally involves deploying a set of facilities to best satisfy the demands of specified points, with broad applications in fields such as location science and sensor networks. Recent applications reveal that the…

Neural and Evolutionary Computing · Computer Science 2025-02-28 Tongyu Wu , Changhao Miao , Yuntian Zhang , Fang Deng , Chen Chen

The multi-objective optimization is to optimize several objective functions over a common feasible set. Since the objectives usually do not share a common optimizer, people often consider (weakly) Pareto points. This paper studies…

Optimization and Control · Mathematics 2023-12-05 Jiawang Nie , Zi Yang

The combination of exponentially large action spaces, stochastic dynamics, and long-horizon decision-making under limited resources makes Sequential Stochastic Combinatorial Optimization (SSCO) particularly challenging for reinforcement…

Machine Learning · Computer Science 2026-05-19 Vivienne Huiling Wang , Tinghuai Wang , Joni Pajarinen

Pareto Local Search (PLS) is a basic building block in many metaheuristics for Multiobjective Combinatorial Optimization Problem (MCOP). In this paper, an enhanced PLS variant called Parallel Pareto Local Search based on Decomposition…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-12 Jialong Shi , Qingfu Zhang , Jianyong Sun

High-dimensional Bayesian optimization (BO) tasks such as molecular design often require 10,000 function evaluations before obtaining meaningful results. While methods like sparse variational Gaussian processes (SVGPs) reduce computational…

Machine Learning · Computer Science 2025-06-11 Natalie Maus , Kyurae Kim , Geoff Pleiss , David Eriksson , John P. Cunningham , Jacob R. Gardner

We introduce a new "subpixel-smoothed projection" (SSP) formulation for differentiable binarization in topology optimization (TopOpt) as a drop-in replacement for previous projection schemes, which suffer from near-non-differentiability and…

‹ Prev 1 3 4 5 6 7 10 Next ›