English
Related papers

Related papers: A new derivative-free optimization method: Gaussia…

200 papers

Although freeform devices with complex internal structures promise drastic increases in performance, the discreteness of the set of available materials presents challenges for gradient-based optimization necessary for the efficient…

Optimization and Control · Mathematics 2025-11-10 Seokhwan Min , Junhyung Park , Jonghwa Shin

In this work, we propose an efficient method for solving box constrained derivative free optimization problems involving high dimensions. The proposed method relies on exploring the feasible region using a direct search approach based on…

Optimization and Control · Mathematics 2019-01-17 Gannavarapu Chandramouli , Vishnu Narayanan

Gaussian mixtures are widely used for approximating density functions in various applications such as density estimation, belief propagation, and Bayesian filtering. These applications often utilize Gaussian mixtures as initial…

Machine Learning · Statistics 2023-10-18 Qiong Zhang , Archer Gong Zhang , Jiahua Chen

Optimization problems aim to find the optimal solution, which is becoming increasingly complex and difficult to solve. Traditional evolutionary optimization methods always overlook the granular characteristics of solution space. In the real…

Machine Learning · Computer Science 2025-02-19 Shuyin Xia , Xinyu Lin , Guan Wang , De-Gang Chen , Sen Zhao , Guoyin Wang , Jing Liang

3D Gaussian Splatting (3D-GS) has emerged as a significant advancement in the field of Computer Graphics, offering explicit scene representation and novel view synthesis without the reliance on neural networks, such as Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ben Fei , Jingyi Xu , Rui Zhang , Qingyuan Zhou , Weidong Yang , Ying He

Bayesian optimization is a powerful global optimization technique for expensive black-box functions. One of its shortcomings is that it requires auxiliary optimization of an acquisition function at each iteration. This auxiliary…

Machine Learning · Statistics 2014-02-28 Ziyu Wang , Babak Shakibi , Lin Jin , Nando de Freitas

Gradient Descent (GD) and Conjugate Gradient (CG) methods are among the most effective iterative algorithms for solving unconstrained optimization problems, particularly in machine learning and statistical modeling, where they are employed…

Optimization and Control · Mathematics 2024-12-19 Xianqi Jiao , Jia Liu , Zhiping Chen

High-fidelity simulations and physical experiments are essential for engineering analysis and design, yet their high cost often makes two critical tasks--global sensitivity analysis (GSA) and optimization--prohibitively expensive. This…

Machine Learning · Computer Science 2026-01-01 Bach Do , Nafeezat A. Ajenifuja , Taiwo A. Adebiyi , Ruda Zhang

Gaussian elimination (GE) is the archetypal direct algorithm for solving linear systems of equations and this has been its primary application for thousands of years. In the last decade, GE has found another major use as an iterative…

Numerical Analysis · Mathematics 2016-02-23 Alex Townsend

3D Gaussian Splatting (3DGS) has emerged as a leading neural rendering technique for high-fidelity view synthesis, prompting the development of dedicated 3DGS accelerators for resource-constrained platforms. The conventional decoupled…

Hardware Architecture · Computer Science 2025-07-28 Minnan Pei , Gang Li , Junwen Si , Zeyu Zhu , Zitao Mo , Peisong Wang , Zhuoran Song , Xiaoyao Liang , Jian Cheng

Building upon our earlier work of a martingale approach to global optimization, a powerful stochastic search scheme for the global optimum of cost functions is proposed on the basis of change of measures on the states that evolve as…

Methodology · Statistics 2015-12-23 Mamatha Venugopal , Ram Mohan Vasu , Debasish Roy

The search for continuous gravitational waves in a wide parameter space at fixed computing cost is most efficiently done with semicoherent methods, e.g. StackSlide, due to the prohibitive computing cost of the fully coherent search…

General Relativity and Quantum Cosmology · Physics 2016-04-05 Miroslav Shaltev

This work presents Quantum Adaptive Search (QAGS), a hybrid quantum-classical algorithm for the global optimization of multivariate functions. The method employs an adaptive mechanism that dynamically narrows the search space based on a…

Quantum Physics · Physics 2025-06-27 G. Intoccia , U. Chirico , V. Schiano Di Cola , G. Pepe , S. Cuomo

We introduce Bayesian optimization, a technique developed for optimizing time-consuming engineering simulations and for fitting machine learning models on large datasets. Bayesian optimization guides the choice of experiments during…

Machine Learning · Statistics 2017-11-22 Peter I. Frazier , Jialei Wang

Complex computer codes are often too time expensive to be directly used to perform uncertainty propagation studies, global sensitivity analysis or to solve optimization problems. A well known and widely used method to circumvent this…

Applications · Statistics 2008-04-06 Amandine Marrel , Bertrand Iooss , Francois Van Dorpe , Elena Volkova

In this paper, we study a generic direct-search algorithm in which the polling directions are defined using random subspaces. Complexity guarantees for such an approach are derived thanks to probabilistic properties related to both the…

Optimization and Control · Mathematics 2023-01-18 Lindon Roberts , Clément W. Royer

Recent implementations of local approximate Gaussian process models have pushed computational boundaries for non-linear, non-parametric prediction problems, particularly when deployed as emulators for computer experiments. Their flavor of…

Computation · Statistics 2015-01-06 Robert B. Gramacy , Benjamin Haaland

We deal with the efficient parallelization of Bayesian global optimization algorithms, and more specifically of those based on the expected improvement criterion and its variants. A closed form formula relying on multivariate Gaussian…

Machine Learning · Statistics 2016-09-12 Sébastien Marmin , Clément Chevalier , David Ginsbourger

3D Gaussian Splatting (3DGS) achieves impressive rendering fidelity and speed for novel view synthesis. However, its substantial data size poses a significant challenge for practical applications. While many compression techniques have been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yihang Chen , Mengyao Li , Qianyi Wu , Weiyao Lin , Mehrtash Harandi , Jianfei Cai

Code search is to search reusable code snippets from source code corpus based on natural languages queries. Deep learning-based methods of code search have shown promising results. However, previous methods focus on retrieval accuracy but…

Software Engineering · Computer Science 2022-04-01 Wenchao Gu , Yanlin Wang , Lun Du , Hongyu Zhang , Shi Han , Dongmei Zhang , Michael R. Lyu