English
Related papers

Related papers: Convergence analysis for a tree-based nonlinear re…

200 papers

We propose a tree-based algorithm for classification and regression problems in the context of functional data analysis, which allows to leverage representation learning and multiple splitting rules at the node level, reducing…

Machine Learning · Statistics 2020-11-03 Edoardo Belli , Simone Vantini

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

We study how the degree of nonlinearity in the input data affects the optimal design of reservoir computers, focusing on how closely the model's nonlinearity should align with that of the data. By reducing minimal RCs to a single tunable…

Machine Learning · Computer Science 2025-04-25 Davide Prosperino , Haochun Ma , Christoph Räth

The offline time of the reduced basis method can be very long given a large training set of parameter samples. This usually happens when the system has more than two independent parameters. On the other hand, if the training set includes…

Numerical Analysis · Mathematics 2023-04-04 Sridhar Chellappa , Lihong Feng , Peter Benner

This work introduces a new approach to reduce the computational cost of solving partial differential equations (PDEs) with convection-dominated solutions: model reduction with implicit feature tracking. Traditional model reduction…

Numerical Analysis · Mathematics 2021-10-01 Marzieh Alireza Mirhoseini , Matthew J. Zahr

Tree search algorithms, such as branch-and-bound, are the most widely used tools for solving combinatorial and nonconvex problems. For example, they are the foremost method for solving (mixed) integer programs and constraint satisfaction…

Artificial Intelligence · Computer Science 2018-05-18 Maria-Florina Balcan , Travis Dick , Tuomas Sandholm , Ellen Vitercik

Current state-of-the-art methods for solving discrete optimization problems are usually restricted to convex settings. In this paper, we propose a general approach based on cutting planes for solving nonlinear, possibly nonconvex, binary…

Optimization and Control · Mathematics 2022-03-21 Hoa T. Bui , Qun Lin , Ryan Loxton

In this paper, we propose a reduced order approach for 3D variational data assimilation governed by parametrized partial differential equations. In contrast to the classical 3D-VAR formulation that penalizes the measurement error directly,…

Numerical Analysis · Mathematics 2019-05-16 Nicole Aretz-Nellesen , Martin A. Grepl , Karen Veroy

This paper presents a piecewise convexification method for solving non-convex multi-objective optimization problems with box constraints. Based on the ideas of the $\alpha$-based Branch and Bound (${\rm \alpha BB}$) method of global…

Optimization and Control · Mathematics 2022-06-28 Q. Zhu , L. P. Tang , X. M. Yang

We introduce and investigate matrix approximation by decomposition into a sum of radial basis function (RBF) components. An RBF component is a generalization of the outer product between a pair of vectors, where an RBF function replaces the…

Machine Learning · Computer Science 2021-06-25 Elizaveta Rebrova , Yu-Hang Tang

It is shown that the computational efficiency of the discrete least-squares (DLS) approximation of solutions of stochastic elliptic PDEs is improved by incorporating a reduced-basis method into the DLS framework. The goal is to recover the…

Numerical Analysis · Mathematics 2017-11-09 Max Gunzburger , Michael Schneier , Clayton Webster , Guannan Zhang

This thesis presents recent advances in model order reduction methods with the primary aim to construct online-efficient reduced surrogate models for parameterized multiscale phenomena and accelerate large-scale PDE-constrained parameter…

Numerical Analysis · Mathematics 2022-11-18 Tim Keil

We study first-order optimization algorithms under the constraint that the descent direction is quantized using a pre-specified budget of $R$-bits per dimension, where $R \in (0 ,\infty)$. We propose computationally efficient optimization…

Machine Learning · Computer Science 2022-08-17 Rajarshi Saha , Mert Pilanci , Andrea J. Goldsmith

A classic approach for solving differential equations with neural networks builds upon neural forms, which employ the differential equation with a discretisation of the solution domain. Making use of neural forms for time-dependent…

Neural and Evolutionary Computing · Computer Science 2022-09-02 Toni Schneidereit , Michael Breuß

In many remote sensing applications one wants to estimate variables or parameters of interest from observations. When the target variable is available at a resolution that matches the remote sensing observations, standard algorithms such as…

Numerical simulations are a valuable research and layout tool for fluid flow problems, yet repeated evaluations of parametrized problems, necessary to solve optimization problems, can be very costly. One option to speed up this process is…

Fluid Dynamics · Physics 2025-02-28 Marian Staggl , Wolfgang Sanz , Paul Pieringer

In this paper we present a methodology that allows the efficient computation of the topological derivative for semilinear elliptic problems within the averaged adjoint Lagrangian framework. The generality of our approach should also allow…

Optimization and Control · Mathematics 2018-03-16 Kevin Sturm

In this paper, we investigate a class of non-convex sum-of-ratios programs relevant to decision-making in key areas such as product assortment and pricing, and facility location and cost planning. These optimization problems, characterized…

Optimization and Control · Mathematics 2026-01-13 Hoang Giang Pham , Ngan Ha Duong , Tien Mai , Thuy Anh Ta , Minh Hoang Ha

Approximation of scattered data is often a task in many engineering problems. The Radial Basis Function (RBF) approximation is appropriate for large scattered (unordered) datasets in d-dimensional space. This approach is useful for a higher…

Numerical Analysis · Computer Science 2018-06-21 Zuzana Majdisova , Vaclav Skala

A key observation underlying this paper is the fact that the range invariance condition for convergence of regularization methods for nonlinear ill-posed operator equations -- such as coefficient identification in partial differential…

Numerical Analysis · Mathematics 2023-07-26 Barbara Kaltenbacher