English
Related papers

Related papers: Renormalized Reduced Order Models with Memory for …

200 papers

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

This paper develops a control scheme, based on the use of Long Short-Term Memory neural network models and Nonlinear Model Predictive Control, which guarantees recursive feasibility with slow time variant set-points and disturbances, input…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Irene Schimperna , Lalo Magni

Projection methods provide an appealing way to construct reduced-order models of large-scale linear dynamical systems: they are intuitively motivated and fairly easy to compute. Unfortunately, the resulting reduced models need not inherit…

Numerical Analysis · Mathematics 2018-11-26 Mark Embree

Stability of recurrent models is closely linked with trainability, generalizability and in some applications, safety. Methods that train stable recurrent neural networks, however, do so at a significant cost to expressibility. We propose an…

Machine Learning · Computer Science 2019-12-24 Max Revay , Ian R. Manchester

The Dynamic Mode Decomposition has proved to be a very efficient technique to study dynamic data. This is entirely a data-driven approach that extracts all necessary information from data snapshots which are commonly supposed to be sampled…

Numerical Analysis · Mathematics 2023-02-01 Aleksandr Katrutsa , Sergey Utyuzhnikov , Ivan Oseledets

Methods for the reduction of the complexity of computational problems are presented, as well as their connections to renormalization, scaling, and irreversible statistical mechanics. Several statistically stationary cases are analyzed; for…

Numerical Analysis · Mathematics 2007-05-23 Alexandre J. Chorin , Panagiotis Stinis

A classical reduced order model for dynamical problems involves spatial reduction of the problem size. However, temporal reduction accompanied by the spatial reduction can further reduce the problem size without losing accuracy much, which…

Numerical Analysis · Mathematics 2019-10-04 Youngsoo Choi , Peter Brown , Bill Arrighi , Robert Anderson

Deep neural networks are an attractive alternative for simulating complex dynamical systems, as in comparison to traditional scientific computing methods, they offer reduced computational costs during inference and can be trained directly…

Machine Learning · Computer Science 2024-05-01 Katarzyna Michałowska , Somdatta Goswami , George Em Karniadakis , Signe Riemer-Sørensen

We consider the problem of retraining machine learning (ML) models when new batches of data become available. Existing approaches greedily optimize for predictive power independently at each batch, without considering the stability of the…

Machine Learning · Computer Science 2025-02-05 Dimitris Bertsimas , Vassilis Digalakis , Yu Ma , Phevos Paschalidis

Operator inference learns low-dimensional dynamical-system models with polynomial nonlinear terms from trajectories of high-dimensional physical systems (non-intrusive model reduction). This work focuses on the large class of physical…

Numerical Analysis · Mathematics 2021-07-07 Nihar Sawant , Boris Kramer , Benjamin Peherstorfer

Turbulent dynamical systems characterized by both a high-dimensional phase space and a large number of instabilities are ubiquitous among many complex systems in science and engineering. The existence of a strange attractor in the turbulent…

Fluid Dynamics · Physics 2018-02-23 Andrew J. Majda , Di Qi

Reduced order models are computationally inexpensive approximations that capture the important dynamical characteristics of large, high-fidelity computer models of physical systems. This paper applies machine learning techniques to improve…

Machine Learning · Computer Science 2015-11-11 Azam Moosavi , Razvan Stefanescu , Adrian Sandu

Modern datasets are becoming heterogeneous. To this end, we present in this paper Mixed-Variate Restricted Boltzmann Machines for simultaneously modelling variables of multiple types and modalities, including binary and continuous…

Machine Learning · Statistics 2014-08-07 Truyen Tran , Dinh Phung , Svetha Venkatesh

In this contribution we develop an efficient reduced order model for solving parametrized linear-quadratic optimal control problems with linear time-varying state system. The fully reduced model combines reduced basis approximations of the…

Numerical Analysis · Mathematics 2024-08-29 Hendrik Kleikamp , Lukas Renelt

In many machine learning problems the output should not depend on the order of the input. Such "permutation invariant" functions have been studied extensively recently. Here we argue that temporal architectures such as RNNs are highly…

Machine Learning · Computer Science 2020-10-27 Edo Cohen-Karlik , Avichai Ben David , Amir Globerson

Many chemical processes exhibit diverse timescale dynamics with a strong coupling between timescale sensitive variables. Model predictive control with a non-uniformly spaced optimisation horizon is an effective approach to multi-timescale…

Systems and Control · Electrical Eng. & Systems 2022-05-11 Ryan McCloy , Lai Wei , Jie Bao

We study the phenomenon of composite operator renormalization and mixing in systems where time-translational invariance is broken and the evolution is out-of-equilibrium. We show that composite operators mix also through non-local memory…

High Energy Physics - Phenomenology · Physics 2013-07-16 Simone Dresti , Antonio Riotto

In this paper the problems of the retrospective analysis of models with time-varying structure are considered. These models include contamination models with randomly switching parameters and multivariate classification models with an…

Statistics Theory · Mathematics 2017-10-31 Boris Brodsky , Boris Darkhovsky

We consider the general problem of modeling temporal data with long-range dependencies, wherein new observations are fully or partially predictable based on temporally-distant, past observations. A sufficiently powerful temporal model…

The objective of this paper is to design novel multi-layer neural network architectures for multiscale simulations of flows taking into account the observed data and physical modeling concepts. Our approaches use deep learning concepts…

Numerical Analysis · Mathematics 2018-06-14 Yating Wang , Siu Wun Cheung , Eric T. Chung , Yalchin Efendiev , Min Wang