English
Related papers

Related papers: Layerwise goal-oriented adaptivity for neural ODEs…

200 papers

This paper is concerned with the numerical approximation of quantities of interest associated with solutions to parametric elliptic partial differential equations (PDEs). The key novelty of this work is in its focus on the quantities of…

Numerical Analysis · Mathematics 2025-10-09 Alex Bespalov , Dirk Praetorius , Michele Ruggeri

First order optimization algorithms play a major role in large scale machine learning. A new class of methods, called adaptive algorithms, were recently introduced to adjust iteratively the learning rate for each coordinate. Despite great…

Machine Learning · Computer Science 2019-10-01 André Belotto da Silva , Maxime Gazeau

In this paper we investigate a priori error estimates for the space-time Galerkin finite element discretization of an optimal control problem governed by a simplified linear gradient enhanced damage model. The model equations are of a…

Numerical Analysis · Mathematics 2020-04-10 Marita Holtmannspötter , Arnd Rösch , Boris Vexler

An adaptive algorithm, based on residual type a posteriori indicators of errors measured in $L^{\infty}(L^2)$ and $L^2(L^2)$ norms, for a numerical scheme consisting of implicit Euler method in time and discontinuous Galerkin method in…

Numerical Analysis · Mathematics 2013-03-12 Emmanuil H. Georgoulis , Juha M. Virtanen

Training dynamic models, such as neural ODEs, on long trajectories is a hard problem that requires using various tricks, such as trajectory splitting, to make model training work in practice. These methods are often heuristics with poor…

Machine Learning · Computer Science 2023-02-09 Valerii Iakovlev , Cagatay Yildiz , Markus Heinonen , Harri Lähdesmäki

We study deterministic optimal control problems for differential games with finite horizon. We propose new approximations of the strategies in feedback form, and show error estimates and a convergence result of the value in some weak sense…

Optimization and Control · Mathematics 2024-09-04 Olivier Bokanowski , Xavier Warin

Although there is a substantial body of literature on control and optimization problems for parabolic and hyperbolic systems, the specific problem of controlling and optimizing the coefficients of the associated operators within such…

Optimization and Control · Mathematics 2026-05-21 Alain Bensoussan , Minh-Binh Tran , Bangjie Wang

Conventional research attributes the improvements of generalization ability of deep neural networks either to powerful optimizers or the new network design. Different from them, in this paper, we aim to link the generalization ability of a…

Machine Learning · Computer Science 2018-11-06 Hui-Ling Zhen , Xi Lin , Alan Z. Tang , Zhenhua Li , Qingfu Zhang , Sam Kwong

Neuroscientists fit morphologically and biophysically detailed neuron simulations to physiological data, often using evolutionary algorithms. However, such gradient-free approaches are computationally expensive, making convergence slow when…

Neurons and Cognition · Quantitative Biology 2024-07-23 Ilenna Simone Jones , Konrad Paul Kording

In this paper, we present and analyze an interior penalty discontinuous Galerkin method for the distributed elliptic optimal control problems. It is based on a reconstructed discontinuous approximation which admits arbitrarily high-order…

Numerical Analysis · Mathematics 2026-01-05 Ruo Li , Haoyang Liu , Jun Yin

In this work, we further develop multigoal-oriented a posteriori error estimation with two objectives in mind. First, we formulate goal-oriented mesh adaptivity for multiple functionals of interest for nonlinear problems in which both the…

Numerical Analysis · Mathematics 2018-04-05 B. Endtmayer , U. Langer , T. Wick

In this paper we consider utilizing a residual neural network (ResNet) to solve ordinary differential equations. Stochastic gradient descent method is applied to obtain the optimal parameter set of weights and biases of the network. We…

Numerical Analysis · Mathematics 2021-01-12 Changxin Qiu , Aaron Bendickson , Joshua Kalyanapu , Jue Yan

There is tremendous potential in using neural networks to optimize numerical methods. In this paper, we introduce and analyse a framework for the neural optimization of discrete weak formulations, suitable for finite element methods. The…

Numerical Analysis · Mathematics 2022-11-15 Ignacio Brevis , Ignacio Muga , Kristoffer G. van der Zee

The goal of decentralized optimization over a network is to optimize a global objective formed by a sum of local (possibly nonsmooth) convex functions using only local computation and communication. It arises in various application domains,…

Optimization and Control · Mathematics 2015-03-17 John Duchi , Alekh Agarwal , Martin Wainwright

We deal with the numerical solution of linear partial differential equations (PDEs) with focus on the goal-oriented error estimates including algebraic errors arising by an inaccurate solution of the corresponding algebraic systems. The…

Numerical Analysis · Mathematics 2020-01-08 Vít Dolejší , Petr Tichý

We improve the accuracy of Guidance & Control Networks (G&CNETs), trained to represent the optimal control policies of a time-optimal transfer and a mass-optimal landing, respectively. In both cases we leverage the dynamics of the…

Machine Learning · Computer Science 2024-04-29 Sebastien Origer , Dario Izzo

It has been observed that residual networks can be viewed as the explicit Euler discretization of an Ordinary Differential Equation (ODE). This observation motivated the introduction of so-called Neural ODEs, which allow more general…

Machine Learning · Computer Science 2021-04-21 Tianjun Zhang , Zhewei Yao , Amir Gholami , Kurt Keutzer , Joseph Gonzalez , George Biros , Michael Mahoney

In this paper, we address the adversarial training of neural ODEs from a robust control perspective. This is an alternative to the classical training via empirical risk minimization, and it is widely used to enforce reliable outcomes for…

Optimization and Control · Mathematics 2024-04-02 Cristina Cipriani , Alessandro Scagliotti , Tobias Wöhrer

This paper studies reduced-order modeling of dynamic networks with strongly connected topology. Given a graph clustering of an original complex network, we construct a quotient graph with less number of vertices, where the edge weights are…

Optimization and Control · Mathematics 2020-03-10 Xiaodong Cheng , Lanlin Yu , Dingchao Ren , Jacquelien M. A. Scherpen

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

Machine Learning · Computer Science 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause