English
Related papers

Related papers: Hyper-Reduced Autoencoders for Efficient and Accur…

200 papers

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

Machine Learning · Computer Science 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

Hard visual attention is a promising approach to reduce the computational burden of modern computer vision methodologies. Hard attention mechanisms are typically non-differentiable. They can be trained with reinforcement learning but the…

Machine Learning · Computer Science 2020-06-16 William Harvey , Michael Teng , Frank Wood

Many engineering processes can be accurately modelled using partial differential equations (PDEs), but high dimensionality and non-convexity of the resulting systems pose limitations on their efficient optimisation. In this work, a model…

Optimization and Control · Mathematics 2024-10-17 Min Tao , Panagiotis Petsagkourakis , Jie Li , Constantinos Theodoropoulos

We propose a non-intrusive Deep Learning-based Reduced Order Model (DL-ROM) capable of capturing the complex dynamics of mechanical systems showing inertia and geometric nonlinearities. In the first phase, a limited number of high fidelity…

Numerical Analysis · Mathematics 2021-11-25 Stefania Fresca , Giorgio Gobat , Patrick Fedeli , Attilio Frangi , Andrea Manzoni

Quadratic manifolds for nonintrusive reduced modeling are typically trained to minimize the reconstruction error on snapshot data, which means that the error of models fitted to the embedded data in downstream learning steps is ignored. In…

Dynamical Systems · Mathematics 2025-07-29 Paul Schwerdtner , Prakash Mohan , Julie Bessac , Marc T. Henry de Frahan , Benjamin Peherstorfer

A nonlinear-manifold reduced order model (NM-ROM) is a great way of incorporating underlying physics principles into a neural network-based data-driven approach. We combine NM-ROMs with domain decomposition (DD) for efficient computation.…

Numerical Analysis · Mathematics 2023-12-04 Alejandro N. Diaz , Youngsoo Choi , Matthias Heinkenschloss

High-fidelity simulations, such as computational fluid dynamics and finite element analysis, are essential for modeling complex engineering systems but are often prohibitively expensive for tasks including parametric studies, optimization,…

Machine Learning · Computer Science 2026-05-07 Melika Baghi , Xiao Liu , Kamran Paynabar

An adaptive approach to using reduced-order models as surrogates in PDE-constrained optimization is introduced that breaks the traditional offline-online framework of model order reduction. A sequence of optimization problems constrained by…

Optimization and Control · Mathematics 2014-07-30 Matthew J. Zahr , Charbel Farhat

A methodology for non-intrusive, projection-based non-linear model reduction originally presented by Renganathan et. al. (2018)~\cite{renganathan2018koopman} is further extended towards parametric systems with focus on application to…

Optimization and Control · Mathematics 2020-08-05 S. Ashwin Renganathan

Projection-based model reduction is among the most widely adopted methods for constructing parametric Reduced-Order Models (ROM). Utilizing the snapshot data from solving full-order governing equations, the Proper Orthogonal Decomposition…

Machine Learning · Statistics 2025-09-16 Xiao Liu , Jingyi Feng , Xinchao Liu

In this paper we study the problem of model reduction of linear network systems. We aim at computing a reduced order stable approximation of the network with the same topology and optimal w.r.t. H2 norm error approximation. Our approach is…

Optimization and Control · Mathematics 2019-05-21 I. Necoara , T. C. Ionescu

This work proposes a model-reduction approach for the material point method on nonlinear manifolds. Our technique approximates the $\textit{kinematics}$ by approximating the deformation map using an implicit neural representation that…

Machine Learning · Computer Science 2023-02-13 Peter Yichen Chen , Maurizio M. Chiaramonte , Eitan Grinspun , Kevin Carlberg

This study proposes an intrusive projection-based model-order reduction framework for nonlinear problems with a polynomial structure, solved iteratively using a Newton solver in the reduced space. It is demonstrated that for the targeted…

Computational Engineering, Finance, and Science · Computer Science 2026-03-05 Liam K. Magargal , Parisa Khodabakhshi , Steven N. Rodriguez

Autoencoding is a popular method in representation learning. Conventional autoencoders employ symmetric encoding-decoding procedures and a simple Euclidean latent space to detect hidden low-dimensional structures in an unsupervised way.…

Machine Learning · Computer Science 2024-10-07 Stefan C. Schonsheck , Scott Mahan , Timo Klock , Alexander Cloninger , Rongjie Lai

The evaluation of robustness and reliability of realistic structures in the presence of uncertainty involves costly numerical simulations with a very high number of evaluations. This motivates model order reduction techniques like the…

Numerical Analysis · Mathematics 2024-12-20 Steffen Kastian , Dieter Moser , Stefanie Reese , Lars Grasedyck

We propose a probabilistic way for reducing the cost of classical projection-based model order reduction methods for parameter-dependent linear equations. A reduced order model is here approximated from its random sketch, which is a set of…

Numerical Analysis · Mathematics 2020-05-19 Oleg Balabanov , Anthony Nouy

Geometric representation learning has recently shown great promise in several machine learning settings, ranging from relational learning to language processing and generative models. In this work, we consider the problem of performing…

Machine Learning · Statistics 2020-05-29 Gian Maria Marconi , Lorenzo Rosasco , Carlo Ciliberto

We present a method to construct reduced-order models for duct flows of Bingham media. Our method is based on proper orthogonal decomposition (POD) to find a low-dimensional approximation to the velocity and artificial neural network to…

Numerical Analysis · Mathematics 2018-11-14 E. Muravleva , I. Oseledets , D. Koroteev

In this work, we aim at efficiently solving a parametrized family of optimal transport problems by using model order reduction methods. We propose a reduced-order model by adding to the primal (respectively dual) version of the…

Numerical Analysis · Mathematics 2026-04-13 Elise Bonnet-Weill , Virginie Ehrlacher , Luca Nenna

Low-rank decomposition (LRD) is a state-of-the-art method for visual data reconstruction and modelling. However, it is a very challenging problem when the image data contains significant occlusion, noise, illumination variation, and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chen Chen , Baochang Zhang , Alessio Del Bue , Vittorio Murino