English
Related papers

Related papers: Parameter Tuning Strategies for Metaheuristic Meth…

200 papers

Algorithm configuration methods optimize the performance of a parameterized heuristic algorithm on a given distribution of problem instances. Recent work introduced an algorithm configuration procedure ("Structured Procrastination") that…

Artificial Intelligence · Computer Science 2019-11-11 Robert Kleinberg , Kevin Leyton-Brown , Brendan Lucier , Devon Graham

Symbolic regression is a machine learning technique, and it has seen many advancements in recent years, especially in genetic programming approaches (GPSR). Furthermore, it has been known for many years that constant optimization of…

Machine Learning · Computer Science 2024-12-04 L. G. A dos Reis , V. L. P. S. Caminha , T. J. P. Penna

Fine-tuning pre-trained models with custom data leads to numerous expert models on specific tasks. Merging models into one universal model to empower multi-task ability refraining from data leakage has gained popularity. With the expansion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Fanhu Zeng , Haiyang Guo , Fei Zhu , Li Shen , Hao Tang

This paper presents a hybrid optimization methodology for parameter estimation of reactive transport systems. Using reduced-order advection-diffusion-reaction (ADR) models, the computational requirements of global optimization with dynamic…

Optimization and Control · Mathematics 2025-12-16 Marcus Johan Schytt , Halldór Gauti Pétursson , John Bagterp Jørgensen

Weather forecasting plays a vital role in numerous sectors, but accurately capturing the complex dynamics of weather systems remains a challenge for traditional statistical models. Apart from Auto Regressive time forecasting models like…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Anuvab Sen , Arul Rhik Mazumder , Dibyarup Dutta , Udayon Sen , Pathikrit Syam , Sandipan Dhar

Efficient structural reanalysis for high-rank modification plays an important role in engineering computations which require repeated evaluations of structural responses, such as structural optimization and probabilistic analysis. To…

Computational Engineering, Finance, and Science · Computer Science 2025-05-20 Wenxiong Li , Suiyin Chen , Huan Huang

The tuning parameter selection strategy for penalized estimation is crucial to identify a model that is both interpretable and predictive. However, popular strategies (e.g., minimizing average squared prediction error via cross-validation)…

Methodology · Statistics 2022-11-10 Julia Holter , Jonathan Stallrich

We propose and analyse a variant of the recently introduced kinetic based optimization method that incorporates ideas like survival-of-the-fittest and mutation strategies well-known from genetic algorithms. Thus, we provide a first attempt…

Optimization and Control · Mathematics 2024-07-18 Giacomo Albi , Federica Ferrarese , Claudia Totzeck

In this paper, gradient-based optimization methods are combined with finite-element modeling for improving electric devices. Geometric design parameters are considered by affine decomposition of the geometry or by the design element…

Parameter selection is one of the most important parts for nearly all the control strategies. Traditionally, controller parameters are chosen by utilizing trial and error, which is always tedious and time consuming. Moreover, such method is…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Yujia Wang , Tong Wang , Jiae Yang , Xuebo Yang

Structural optimization is a popular method for designing objects such as bridge trusses, airplane wings, and optical devices. Unfortunately, the quality of solutions depends heavily on how the problem is parameterized. In this paper, we…

Machine Learning · Computer Science 2019-09-17 Stephan Hoyer , Jascha Sohl-Dickstein , Sam Greydanus

A number of image-processing problems can be formulated as optimization problems. The objective function typically contains several terms specifically designed for different purposes. Parameters in front of these terms are used to control…

Medical Physics · Physics 2017-11-02 Chenyang Shen , Yesenia Gonzalez , Liyuan Chen , Steve B. Jiang , Xun Jia

Machine learning (ML) methods are used in most technical areas such as image recognition, product recommendation, financial analysis, medical diagnosis, and predictive maintenance. An important aspect of implementing ML methods involves…

Machine Learning · Computer Science 2023-06-21 Varun Ramamohan , Shobhit Singhal , Aditya Raj Gupta , Nomesh Bhojkumar Bolia

Automatically tuning software configuration for optimizing a single performance attribute (e.g., minimizing latency) is not trivial, due to the nature of the configuration systems (e.g., complex landscape and expensive measurement). To deal…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-03 Tao Chen , Miqing Li

This study proposes a new constraint handling technique for assisting metaheuristic optimization algorithms to solve constrained optimization problems more effectively and efficiently. Given any two solutions of any constrained optimization…

Optimization and Control · Mathematics 2023-10-23 Ting Huang , Qiang Zhang , Witold Pedrycz , Shanlin Yang

Many high-dimensional optimisation problems exhibit rich geometric structures in their set of minimisers, often forming smooth manifolds due to over-parametrisation or symmetries. When this structure is known, at least locally, it can be…

Optimization and Control · Mathematics 2025-10-27 Evan Markou , Thalaiyasingam Ajanthan , Stephen Gould

Mechanical metamaterials represent an innovative class of artificial structures, distinguished by their extraordinary mechanical characteristics, which are beyond the scope of traditional natural materials. The use of deep generative models…

Signal Processing · Electrical Eng. & Systems 2024-07-31 Zihan Wang , Anindya Bhaduri , Hongyi Xu , Liping Wang

Due to the high computational demands executing a rigorous comparison between hyperparameter optimization (HPO) methods is often cumbersome. The goal of this paper is to facilitate a better empirical evaluation of HPO methods by providing…

Machine Learning · Computer Science 2019-05-14 Aaron Klein , Frank Hutter

The rapidly developing robotics industry demands structures with novel mechanical functions. Traditional approaches, developing new materials and designing new structures, face two challenges. Highly complex force-displacement functions can…

Applied Physics · Physics 2022-11-02 Fan Liu , Xihang Jiang , Zian Jia , Lifeng Wang

Control algorithms such as model predictive control (MPC) and state estimators rely on a number of different parameters. The performance of the closed loop usually depends on the correct setting of these parameters. Tuning is often done…

Systems and Control · Electrical Eng. & Systems 2020-10-15 David Stenger , Muzaffer Ay , Dirk Abel