English
Related papers

Related papers: ZEUS: An Efficient GPU Optimization Method Integra…

200 papers

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

Machine Learning · Statistics 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

Metaheuristic algorithms are powerful tools for global optimization, particularly for non-convex and non-differentiable problems where exact methods are often impractical. Particle-based optimization methods, inspired by swarm intelligence…

Optimization and Control · Mathematics 2026-03-23 Giacomo Borghi , Hyesung Im , Lorenzo Pareschi

We consider parallel global optimization of derivative-free expensive-to-evaluate functions, and propose an efficient method based on stochastic approximation for implementing a conceptual Bayesian optimization algorithm proposed by…

Machine Learning · Statistics 2019-05-07 Jialei Wang , Scott C. Clark , Eric Liu , Peter I. Frazier

In this work we survey some recent results on the global minimization of a non-convex and possibly non-smooth high dimensional objective function by means of particle based gradient-free methods. Such problems arise in many situations of…

Optimization and Control · Mathematics 2021-08-21 Sara Grassi , Hui Huang , Lorenzo Pareschi , Jinniao Qiu

First Order Bayesian Optimization (FOBO) is a sample efficient sequential approach to find the global maxima of an expensive-to-evaluate black-box objective function by suitably querying for the function and its gradient evaluations. Such…

Machine Learning · Computer Science 2023-06-21 Utkarsh Prakash , Aryan Chollera , Kushagra Khatwani , Prabuchandran K. J. , Tejas Bodas

Unstructured-mesh based numerical algorithms such as finite volume and finite element algorithms form an important class of applications for many scientific and engineering domains. The key difficulty in achieving higher performance from…

Mathematical Software · Computer Science 2019-07-30 András Attila Sulyok , Gábor Dániel Balogh , István Zoltán Reguly , Gihan R. Mudalige

This paper discusses how particle swarm optimization (PSO) can be used to generate quantum circuits to solve an instance of the MaxOne problem. It then analyzes previous studies on evolutionary algorithms for circuit synthesis. With a brief…

Neural and Evolutionary Computing · Computer Science 2025-07-08 Mirza Hizriyan Nubli Hidayat , Tan Chye Cheah

Bayesian optimization has been successful at global optimization of expensive-to-evaluate multimodal objective functions. However, unlike most optimization methods, Bayesian optimization typically does not use derivative information. In…

Machine Learning · Statistics 2018-02-08 Jian Wu , Matthias Poloczek , Andrew Gordon Wilson , Peter I. Frazier

This article presents a comparative analysis of GPU-parallelized implementations of the quantum-inspired evolutionary optimization (QIEO) approach and one of the well-known classical metaheuristic techniques, the genetic algorithm (GA). The…

Computational Engineering, Finance, and Science · Computer Science 2024-12-13 Kandula Eswara Sai Kumar , Supreeth B S , Rajas Dalvi , Aman Mittal , Aakif Akhtar , Ferdin Don Bosco , Rut Lineswala , Abhishek Chopra

Electrostatic interactions play crucial roles in biophysical processes such as protein folding and molecular recognition. Poisson-Boltzmann equation (PBE)-based models have emerged as widely used in modeling these important processes.…

Computational Physics · Physics 2017-04-11 Ruxi Qi , Wesley M. Botello-Smith , Ray Luo

Zeroth-order optimization (ZO) has been a powerful framework for solving black-box problems, which estimates gradients using zeroth-order data to update variables iteratively. The practical applicability of ZO critically depends on the…

Optimization and Control · Mathematics 2026-03-03 Ruiyang Jin , Yuke Zhou , Yujie Tang , Jie Song , Siyang Gao

In this paper, we present a flow-based method for global optimization of continuous Sobolev functions, called Stein Boltzmann Sampling (SBS). SBS initializes uniformly a number of particles representing candidate solutions, then uses the…

Optimization and Control · Mathematics 2025-02-21 Gaëtan Serré , Argyris Kalogeratos , Nicolas Vayatis

Constrained optimization problems arise frequently in classical machine learning. There exist frameworks addressing constrained optimization, for instance, CVXPY and GENO. However, in contrast to deep learning frameworks, GPU support is…

Machine Learning · Computer Science 2022-03-31 Sören Laue , Mark Blacher , Joachim Giesen

There is a growing interest in leveraging GPUs for tasks beyond ML, especially in database systems. Despite the existing extensive work on GPU-based database operators, several questions are still open. For instance, the performance of…

Databases · Computer Science 2025-02-13 Bowen Wu , Dimitrios Koutsoukos , Gustavo Alonso

Sparse tensors appear in many large-scale applications with multidimensional and sparse data. While multidimensional sparse data often need to be processed on manycore processors, attempts to develop highly-optimized GPU-based…

Mathematical Software · Computer Science 2017-12-18 Bangtian Liu , Chengyao Wen , Anand D. Sarwate , Maryam Mehri Dehnavi

Graph convolutional networks (GCNs) are fundamental in various scientific applications, ranging from biomedical protein-protein interactions (PPI) to large-scale recommendation systems. An essential component for modeling graph structures…

Machine Learning · Computer Science 2026-01-07 Shakya Jayakody , Youpeng Zhao , Jun Wang

Process mapping asks to assign vertices of a task graph to processing elements of a supercomputer such that the computational workload is balanced while the communication cost is minimized. Motivated by the recent success of GPU-based graph…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-16 Petr Samoldekin , Christian Schulz , Henning Woydt

This paper proposes the application of particle swarm optimization (PSO) to the problem of finite element model (FEM) selection. This problem arises when a choice of the best model for a system has to be made from set of competing models,…

Artificial Intelligence · Computer Science 2009-10-13 Linda Mthembu , Tshilidzi Marwala , Michael I. Friswell , Sondipon Adhikari

In this investigation, we propose several algorithms to recover the location and intensity of a radiation source located in a simulated 250 m x 180 m block in an urban center based on synthetic measurements. Radioactive decay and detection…

Applications · Statistics 2016-07-05 Razvan Stefanescu , Kathleen Schmidt , Jason Hite , Ralph Smith , John Mattingly

We consider differential Lyapunov and Riccati equations, and generalized versions thereof. Such equations arise in many different areas and are especially important within the field of optimal control. In order to approximate their…

Numerical Analysis · Mathematics 2018-10-23 Hermann Mena , Lena-Maria Pfurtscheller , Tony Stillfjord