English
Related papers

Related papers: A trust-region framework for optimization using He…

200 papers

Stochastic minimax optimization has drawn much attention over the past decade due to its broad applications in machine learning, signal processing and game theory. In some applications, the probability distribution of uncertainty depends on…

Optimization and Control · Mathematics 2025-09-17 Yan Gao , Yongchao Liu , Zili Luo

This paper proposes a Hermite-kernel realization of the conjugate filter oscillation reduction (CFOR) scheme for the simulation of fluid flows. The Hermite kernel is constructed by using the discrete singular convolution (DSC) algorithm,…

Numerical Analysis · Mathematics 2025-10-20 Y. C. Zhou , G. W. Wei

We give the first mathematically rigorous analysis of an emerging approach to finite element analysis (see, e.g., Bauer et al. [Appl. Numer. Math., 2017]), which we hereby refer to as the surrogate matrix methodology. This methodology is…

Numerical Analysis · Mathematics 2020-08-11 Daniel Drzisga , Brendan Keith , Barbara Wohlmuth

We propose a method for interpolating divergence-free continuous magnetic fields via vector potential reconstruction using Hermite interpolation, which ensures high-order continuity for applications requiring adaptive, high-order ordinary…

Numerical Analysis · Mathematics 2025-01-06 Oleksii Beznosov , Jesus Bonilla , Xianzhu Tang , Golo Wimmer

Solving stochastic optimal control problems with quadratic control costs can be viewed as approximating a target path space measure, e.g. via gradient-based optimization. In practice, however, this optimization is challenging in particular…

Machine Learning · Computer Science 2026-03-17 Denis Blessing , Julius Berner , Lorenz Richter , Carles Domingo-Enrich , Yuanqi Du , Arash Vahdat , Gerhard Neumann

Surrogates have been proposed as classical simulations of the pretrained quantum learning models, which are capable of mimicking the input-output relation inherent in the quantum model. Quantum hardware within this framework is used for…

Quantum Physics · Physics 2025-06-12 Sreeraj Rajindran Nair , Christopher Ferrie

When evaluating quantities of interest that depend on the solutions to differential equations, we inevitably face the trade-off between accuracy and efficiency. Especially for parametrized, time dependent problems in engineering…

Numerical Analysis · Mathematics 2022-12-21 Paolo Conti , Mengwu Guo , Andrea Manzoni , Jan S. Hesthaven

This paper presents new fast algorithms for Hermite interpolation and evaluation over finite fields of characteristic two. The algorithms reduce the Hermite problems to instances of the standard multipoint interpolation and evaluation…

Symbolic Computation · Computer Science 2018-07-03 Nicholas Coxon

We present a reusable, open-source software implementation of the second-order trust region algorithm in the new OpenTrustRegion library. We apply the implementation to the general-purpose optimization of molecular orbitals in various…

Chemical Physics · Physics 2025-12-10 Jonas Greiner , Ida-Marie Høyvik , Susi Lehtola , Janus J. Eriksen

The interpretability of machine learning, particularly for deep neural networks, is crucial for decision making in real-world applications. One approach is replacing the un-interpretable machine learning model with a surrogate model, which…

Machine Learning · Statistics 2020-07-22 Keiichi Kisamori , Keisuke Yamazaki , Yuto Komori , Hiroshi Tokieda

Motivated by TRACE algorithm [Curtis et al. 2017], we propose a trust region algorithm for finding second order stationary points of a linearly constrained non-convex optimization problem. We show the convergence of the proposed algorithm…

Optimization and Control · Mathematics 2019-04-16 Maher Nouiehed , Meisam Razaviyayn

High-fidelity numerical simulations of partial differential equations (PDEs) given a restricted computational budget can significantly limit the number of parameter configurations considered and/or time window evaluated for modeling a given…

Machine Learning · Computer Science 2023-09-04 Paolo Conti , Mengwu Guo , Andrea Manzoni , Attilio Frangi , Steven L. Brunton , J. Nathan Kutz

Historically speaking, it is hard to balance the global and local efficiency of second-order optimization algorithms. For instance, the classical Newton's method possesses excellent local convergence but lacks global guarantees, often…

Optimization and Control · Mathematics 2025-11-11 Yuntian Jiang , Chuwen Zhang , Bo Jiang , Yinyu Ye

Surrogate models for computational simulations are input-output approximations that allow computationally intensive analyses, such as uncertainty propagation and inference, to be performed efficiently. When a simulation output does not…

Computational Engineering, Finance, and Science · Computer Science 2014-08-05 Alex A. Gorodetsky , Youssef M. Marzouk

In the present paper non-convex multi-objective parameter optimization problems are considered which are governed by elliptic parametrized partial differential equations (PDEs). To solve these problems numerically the Pascoletti-Serafini…

Numerical Analysis · Mathematics 2022-01-20 Stefan Banholzer , Luca Mechelli , Stefan Volkwein

Bringing together nonlinear optimization with polyhedral and integrality constraints enables versatile modeling, but poses significant computational challenges. We investigate a method to address these problems based on sequential…

Optimization and Control · Mathematics 2024-10-08 Alberto De Marchi

Derivative-free optimization problems are optimization problems where derivative information is unavailable. The least Frobenius norm updating quadratic interpolation model function is one of the essential under-determined model functions…

Optimization and Control · Mathematics 2023-11-21 Pengcheng Xie , Ya-xiang Yuan

Recent developments in surrogate construction predominantly focused on two strategies to improve surrogate accuracy. Firstly, component-wise domain scaling informed by cross-validation. Secondly, regression to construct response surfaces…

Optimization and Control · Mathematics 2023-04-03 Johann Bouwer , Daniel N. Wilke , Schalk Kok

Model merging techniques aim to integrate the abilities of multiple models into a single model. Most model merging techniques have hyperparameters, and their setting affects the performance of the merged model. Because several existing…

Machine Learning · Computer Science 2025-09-03 Rio Akizuki , Yuya Kudo , Nozomu Yoshinari , Yoichi Hirose , Toshiyuki Nishimoto , Kento Uchida , Shinichi Shirakawa

This paper introduces new perspectives on analog design space search. To minimize the time-to-market, this endeavor better cast as constraint satisfaction problem than global optimization defined in prior arts. We incorporate model-based…