English
Related papers

Related papers: Fast operator learning for mapping correlations

200 papers

The inductive biases of trained neural networks are difficult to understand and, consequently, to adapt to new settings. We study the inductive biases of linearizations of neural networks, which we show to be surprisingly good summaries of…

Machine Learning · Statistics 2021-04-29 Wesley J. Maddox , Shuai Tang , Pablo Garcia Moreno , Andrew Gordon Wilson , Andreas Damianou

In this paper, we apply the self-attention from the state-of-the-art Transformer in Attention Is All You Need for the first time to a data-driven operator learning problem related to partial differential equations. An effort is put together…

Machine Learning · Computer Science 2021-11-02 Shuhao Cao

This work studies reduced order modeling (ROM) approaches to speed up the solution of variational data assimilation problems with large scale nonlinear dynamical models. It is shown that a key requirement for a successful reduced order…

Systems and Control · Computer Science 2015-05-20 Răzvan Ştefănescu , Adrian Sandu , Ionel Michael Navon

We employ the framework of the Koopman operator and dynamic mode decomposition to devise a computationally cheap and easily implementable method to detect transient dynamics and regime changes in time series. We argue that typically…

Atmospheric and Oceanic Physics · Physics 2019-10-23 Georg A. Gottwald , Federica Gugole

We investigate reduced-order models for acoustic and electromagnetic wave problems in parametrically defined domains. The parameter-to-solution maps are approximated following the so-called Galerkin POD-NN method, which combines the…

Numerical Analysis · Mathematics 2024-06-21 Philipp Weder , Mariella Kast , Fernando Henríquez , Jan S. Hesthaven

A classical reduced order model (ROM) for dynamical problems typically involves only the spatial reduction of a given problem. Recently, a novel space-time ROM for linear dynamical problems has been developed, which further reduces the…

Numerical Analysis · Mathematics 2025-11-06 Youngkyu Kim , Karen May Wang , Youngsoo Choi

We propose a finite-dimensional control-based method to approximate solution operators for evolutional partial differential equations (PDEs), particularly in high-dimensions. By employing a general reduced-order model, such as a deep neural…

Numerical Analysis · Mathematics 2024-01-22 Nathan Gaby , Xiaojing Ye

This paper presents fast non-sampling based methods to assess the risk of trajectories for autonomous vehicles when probabilistic predictions of other agents' futures are generated by deep neural networks (DNNs). The presented methods…

Robotics · Computer Science 2020-06-05 Allen Wang , Xin Huang , Ashkan Jasour , Brian Williams

This paper presents a distributed Koopman operator learning framework for modeling unknown nonlinear dynamics using sequential observations from multiple agents. Each agent estimates a local Koopman approximation based on lifted data and…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Ali Azarbahram , Shenyu Liu , Gian Paolo Incremona

In this paper we will consider distributed Linear-Quadratic Optimal Control Problems dealing with Advection-Diffusion PDEs for high values of the P\'eclet number. In this situation, computational instabilities occur, both for steady and…

Numerical Analysis · Mathematics 2024-05-03 Fabio Zoccolan , Maria Strazzullo , Gianluigi Rozza

Koopman Operator Theory has opened the doors to data-driven learning of globally linear representations of complex nonlinear systems. However, current methodologies for Koopman Operator discovery struggle with uncertainty quantification and…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Abhigyan Majumdar , Navid Mojahed , Shima Nazari

Petrov-Galerkin formulations with optimal test functions allow for the stabilization of finite element simulations. In particular, given a discrete trial space, the optimal test space induces a numerical scheme delivering the best…

Numerical Analysis · Mathematics 2023-05-17 Tomasz Sluzalec , Mateusz Dobija , Anna Paszynska , Ignacio Muga , Maciej Paszynski

We propose a simple and efficient algorithm for learning sparse invariant representations from unlabeled data with fast inference. When trained on short movies sequences, the learned features are selective to a range of orientations and…

Computer Vision and Pattern Recognition · Computer Science 2011-05-27 Karol Gregor , Yann LeCun

Neural networks transform data through learned representations whose geometry affects separation, contraction, and generalization. Recent work studies this geometry using discrete curvature on neighborhood graphs, suggesting Ricci-flow-like…

Machine Learning · Computer Science 2026-05-05 Kanishka Reddy

Over the last few years, several works have proposed deep learning architectures to learn dynamical systems from observation data with no or little knowledge of the underlying physics. A line of work relies on learning representations where…

Machine Learning · Computer Science 2023-03-14 Anthony Frion , Lucas Drumetz , Mauro Dalla Mura , Guillaume Tochon , Abdeldjalil Aissa El Bey

This work introduces a kernel-independent, multilevel, adaptive algorithm for efficiently evaluating a discrete convolution kernel with a given source distribution. The method is based on linear algebraic tools such as low rank…

Numerical Analysis · Mathematics 2025-07-11 Anna Yesypenko , Chao Chen , Per-Gunnar Martinsson

This paper proposes an adaptive hyper-reduction method to reduce the computational cost associated with the simulation of parametric particle-based kinetic plasma models, specifically focusing on the Vlasov-Poisson equation. Conventional…

Numerical Analysis · Mathematics 2026-02-05 Cecilia Pagliantini , Federico Vismara

We present a higher-order boundary condition for atomistic simulations of dislocations that address the slow convergence of standard supercell methods. The method is based on a multipole expansion of the equilibrium displacement, combining…

Numerical Analysis · Mathematics 2025-10-07 Xinyi Wei , Julian Braun , Yangshuai Wang , Lei Zhang

This letter presents a non-parametric modeling approach for forecasting stochastic dynamical systems on low-dimensional manifolds. The key idea is to represent the discrete shift maps on a smooth basis which can be obtained by the diffusion…

Dynamical Systems · Mathematics 2015-03-25 Tyrus Berry , Dimitrios Giannakis , John Harlim

This paper establishes optimal convergence rates for estimation of structured covariance operators of Gaussian processes. We study banded operators with kernels that decay rapidly off-the-diagonal and $L^q$-sparse operators with an…

Statistics Theory · Mathematics 2025-07-01 Omar Al-Ghattas , Jiaheng Chen , Daniel Sanz-Alonso , Nathan Waniorek