English
Related papers

Related papers: Local Optimization of Black-Box Function with High…

200 papers

This paper analyzes the performance of the Fractal Decomposition Algorithm (FDA) metaheuristic applied to low-dimensional continuous optimization problems. This algorithm was originally developed specifically to deal efficiently with…

Neural and Evolutionary Computing · Computer Science 2022-10-28 Arcadi Llanza , Nadiya Shvai , Amir Nakib

This work introduces a reduced order modeling (ROM) framework for the solution of parameterized second-order linear elliptic partial differential equations formulated on unfitted geometries. The goal is to construct efficient…

Numerical Analysis · Mathematics 2025-10-14 Margarita Chasapi , Pablo Antolin , Annalisa Buffa

In this paper, we propose a Dimension-Reduced Second-Order Method (DRSOM) for convex and nonconvex (unconstrained) optimization. Under a trust-region-like framework, our method preserves the convergence of the second-order method while…

Optimization and Control · Mathematics 2023-07-04 Chuwen Zhang , Dongdong Ge , Chang He , Bo Jiang , Yuntian Jiang , Yinyu Ye

Direct discretization of continuum kinetic equations, like the Vlasov equation, are under-utilized because the distribution function generally exists in a high-dimensional (>3D) space and computational cost increases geometrically with…

Mathematical Software · Computer Science 2015-06-04 J. A. F. Hittinger , J. W. Banks

In this paper, we propose a model reduction method for solving multiscale elliptic PDEs with random coefficients in the multiquery setting using an optimization approach. The optimization approach enables us to construct a set of localized…

Numerical Analysis · Mathematics 2018-07-09 Thomas Y. Hou , Dingjiong Ma , Zhiwen Zhang

Representing images and videos with Symmetric Positive Definite (SPD) matrices, and considering the Riemannian geometry of the resulting space, has been shown to yield high discriminative power in many visual recognition tasks.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-23 Mehrtash Harandi , Mathieu Salzmann , Richard Hartley

We develop a set of algorithms to solve a broad class of Design of Experiment (DoE) problems efficiently. Specifically, we consider problems in which one must choose a subset of polymers to test in experiments such that the learning of the…

Quantitative Methods · Quantitative Biology 2024-08-06 Swagatam Mukhopadhyay

Existing methods for explaining black box learning models often focus on building local explanations of model behaviour for a particular data item. It is possible to create global explanations for all data items, but these explanations…

Machine Learning · Computer Science 2023-10-16 Anton Björklund , Jarmo Mäkelä , Kai Puolamäki

This work considers the infinite-time discounted optimal control problem for continuous time input-affine polynomial dynamical systems subject to polynomial state and box input constraints. We propose a sequence of sum-of-squares (SOS)…

Optimization and Control · Mathematics 2017-03-22 Milan Korda , Didier Henrion , Colin N. Jones

This paper presents a novel numerical optimisation method for infinite dimensional optimisation. The functional optimisation makes minimal assumptions about the functional and without any specific knowledge on the derivative of the…

Optimization and Control · Mathematics 2016-11-18 Muhammad F. Kasim , Peter A. Norreys

This work extends our previous study from S. Shrestha et al. (2024) by introducing a new abstract framework for Variational Multiscale (VMS) methods at the discrete level. We introduce the concept of what we define as the optimal projector…

Numerical Analysis · Mathematics 2025-03-04 Suyash Shrestha , Marc Gerritsma , Gonzalo Rubio , Steven Hulshoff , Esteban Ferrer

We give a dimensionality reduction procedure to approximate the sum of distances of a given set of $n$ points in $R^d$ to any "shape" that lies in a $k$-dimensional subspace. Here, by "shape" we mean any set of points in $R^d$. Our…

Data Structures and Algorithms · Computer Science 2021-06-25 Zhili Feng , Praneeth Kacham , David P. Woodruff

We present a review of methods for optimal experimental design (OED) for Bayesian inverse problems governed by partial differential equations with infinite-dimensional parameters. The focus is on problems where one seeks to optimize the…

Optimization and Control · Mathematics 2021-02-01 Alen Alexanderian

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

Based on the theory of reproducing kernel Hilbert space (RKHS) and semiparametric method, we propose a new approach to nonlinear dimension reduction. The method extends the semiparametric method into a more generalized domain where both the…

Methodology · Statistics 2021-01-06 Wenquan Cui , Haoyang Cheng

Many multivariate functions in engineering models vary primarily along a few directions in the space of input parameters. When these directions correspond to coordinate directions, one may apply global sensitivity measures to determine the…

Numerical Analysis · Mathematics 2014-07-28 Paul G. Constantine , Eric Dow , Qiqi Wang

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

Machine Learning · Computer Science 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

Sufficient dimension reduction reduces the dimensionality of data while preserving relevant regression information. In this article, we develop Minimum Average Deviance Estimation (MADE) methodology for sufficient dimension reduction. It…

Methodology · Statistics 2024-01-19 Kofi P. Adragni , Andrew M. Raim , Elias Al-Najjar

In this paper we develop an adaptive transform-domain technique based on rational function systems. It is of general importance in several areas of signal theory, including filter design, transfer function approximation, system…

Signal Processing · Electrical Eng. & Systems 2020-03-03 Péter Kovács , Sándor Fridli , Ferenc Schipp

The task of approximating a function of d variables from its evaluations at a given number of points is ubiquitous in numerical analysis and engineering applications. When d is large, this task is challenged by the so-called curse of…

Numerical Analysis · Mathematics 2016-12-21 Albert Cohen , Giovanni Migliorati