English
Related papers

Related papers: A trust-region framework for optimization using He…

200 papers

In this contribution, a new framework for H2-optimal reduction of multiple-input, multiple- output linear dynamical systems by tangential interpolation is presented. The framework is motivated by the local nature of both tangential…

Numerical Analysis · Mathematics 2017-09-22 Alessandro Castagnotto , Boris Lohmann

The main contribution of this paper is twofold: On the one hand, a general framework for performing Hermite interpolation on Riemannian manifolds is presented. The method is applicable, if algorithms for the associated Riemannian…

Numerical Analysis · Mathematics 2021-12-20 Ralf Zimmermann

We are interested in assessing the use of neural networks as surrogate models to approximate and minimize objective functions in optimization problems. While neural networks are widely used for machine learning tasks such as classification…

Machine Learning · Computer Science 2023-11-22 Tommaso Giovannelli , Oumaima Sohab , Luis Nunes Vicente

This article introduces an algorithm for implicit High Dimensional Model Representation (HDMR) of the Bellman equation. This approximation technique reduces memory demands of the algorithm considerably. Moreover, we show that HDMR enables…

Optimization and Control · Mathematics 2012-10-03 Miroslav Pištěk

One of the major challenges for low-rank multi-fidelity (MF) approaches is the assumption that low-fidelity (LF) and high-fidelity (HF) models admit "similar" low-rank kernel representations. Low-rank MF methods have traditionally attempted…

Numerical Analysis · Mathematics 2021-01-07 Mani Razi , Robert M. Kirby , Akil Narayan

The energy transition entails a rapid uptake of renewable energy sources. Besides physical changes within the grid infrastructure, energy storage devices and their smart operation are key measures to master the resulting challenges like,…

Optimization and Control · Mathematics 2019-11-13 Manuel Baumann , Sara Grundel , Philipp Sauerteig , Karl Worthmann

We develop a non-parametric, data-driven, tractable approach for solving multistage stochastic optimization problems in which decisions do not affect the uncertainty. The proposed framework represents the decision variables as elements of a…

Optimization and Control · Mathematics 2023-03-14 Dimitris Bertsimas , Kimberly Villalobos Carballo

In this contribution, we develop an efficient surrogate modeling framework for simulation-based optimization of enhanced oil recovery, where we particularly focus on polymer flooding. The computational approach is based on an adaptive…

Numerical Analysis · Mathematics 2022-03-04 Tim Keil , Hendrik Kleikamp , Rolf J Lorentzen , Micheal B Oguntola , Mario Ohlberger

In this contribution, we are concerned with parameter optimization problems that are constrained by multiscale PDE state equations. As an efficient numerical solution approach for such problems, we introduce and analyze a new relaxed and…

Numerical Analysis · Mathematics 2023-04-13 Tim Keil , Mario Ohlberger

Bayesian optimization is a powerful tool for solving real-world optimization tasks under tight evaluation budgets, making it well-suited for applications involving costly simulations or experiments. However, many of these tasks are also…

Machine Learning · Computer Science 2025-06-18 Paolo Ascia , Elena Raponi , Thomas Bäck , Fabian Duddeck

We consider optimal control problems that have binary-valued control input functions and a perimeter regularization. We develop and analyze a trust-region algorithm that solves a sequence of subproblems in which the regularization term and…

Optimization and Control · Mathematics 2025-01-15 Paul Manns , Vanja Nikolić

Data-driven surrogate models are widely used for applications such as design optimization and uncertainty quantification, where repeated evaluations of an expensive simulator are required. For most partial differential equation (PDE)…

Computational Physics · Physics 2019-10-18 Wei Xing , Robert M. Kirby , Shandian Zhe

Although widely adopted, existing approaches for fine-tuning pre-trained language models have been shown to be unstable across hyper-parameter settings, motivating recent work on trust region methods. In this paper, we present a simplified…

Machine Learning · Computer Science 2020-08-10 Armen Aghajanyan , Akshat Shrivastava , Anchit Gupta , Naman Goyal , Luke Zettlemoyer , Sonal Gupta

Surrogate-assistance approaches have long been used in computationally expensive domains to improve the data-efficiency of optimization algorithms. Neuroevolution, however, has so far resisted the application of these techniques because it…

Neural and Evolutionary Computing · Computer Science 2018-04-18 Adam Gaier , Alexander Asteroth , Jean-Baptiste Mouret

Variational quantum algorithms are a class of techniques intended to be used on near-term quantum computers. The goal of these algorithms is to perform large quantum computations by breaking the problem down into a large number of shallow…

Quantum Physics · Physics 2023-03-24 Ryan Shaffer , Lucas Kocia , Mohan Sarovar

Transmission expansion planning (TEP) plays a critical role in ensuring power system reliability and facilitating the integration of renewable energy resources. However, this process requires planners to constantly deal with significant…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Victor Schmitt , Farzaneh Pourahmadi , Angela Flores-Quiroz , Pablo Apablaza , Pierluigi Mancarella

Machine learning methods are increasingly used to build computationally inexpensive surrogates for complex physical models. The predictive capability of these surrogates suffers when data are noisy, sparse, or time-dependent. As we are…

Machine Learning · Computer Science 2024-05-20 A. Diaw , M. McKerns , I. Sagert , L. G. Stanton , M. S. Murillo

Stochastic inverse problems are generally solved by some form of finite sampling of a space of uncertain parameters. For computationally expensive models, surrogate response surfaces are often employed to increase the number of samples used…

Numerical Analysis · Mathematics 2018-07-04 Steven Mattis , Barbara Wohlmuth

Despite the fact that offline methods for Large Language Models (LLMs) alignment do not require a direct reward model, they remain susceptible to overoptimization. This issue arises when the trained model deviates excessively from the…

In most of mesh-free methods, the calculation of interactions between sample points or particles is the most time consuming. When we use mesh-free methods with high spatial orders, the order of the time integration should also be high. If…

Computational Physics · Physics 2018-12-26 Satoko Yamamoto , Junichiro Makino