English
Related papers

Related papers: Linearized Learning Methods with Multiscale Deep N…

200 papers

The vast majority of systems of practical interest are characterised by nonlinear dynamics. This renders the control and optimization of such systems a complex task due to their nonlinear behaviour. Additionally, standard methods such as…

Systems and Control · Electrical Eng. & Systems 2022-04-05 Akhil Ahmed , Ehecatl Antonio del Rio-Chanona , Mehmet Mercangoz

We extend the One-Way Navier Stokes (OWNS) approach to support nonlinear interactions between waves of different frequencies, which will enable nonlinear analysis of instability and transition. In OWNS, the linearized Navier-Stokes…

Fluid Dynamics · Physics 2025-02-10 Michael K. Sleeman , Matthew T. Lakebrink , Tim Colonius

This paper introduces and evaluates a novel training method for neural networks: Dual Variable Learning Rates (DVLR). Building on insights from behavioral psychology, the dual learning rates are used to emphasize correct and incorrect…

Machine Learning · Computer Science 2021-02-11 Elizabeth Liner , Risto Miikkulainen

We study a pointwise tracking optimal control problem for the stationary Navier--Stokes equations; control constraints are also considered. The problem entails the minimization of a cost functional involving point evaluations of the state…

Numerical Analysis · Mathematics 2023-09-27 Francisco Fuica , Enrique Otárola

In this work, we propose a new training method for finding minimum weight norm solutions in over-parameterized neural networks (NNs). This method seeks to improve training speed and generalization performance by framing NN training as a…

Machine Learning · Statistics 2018-06-22 Yamini Bansal , Madhu Advani , David D Cox , Andrew M Saxe

Accurate simulation of turbulent flows remains a challenge due to the high computational cost of direct numerical simulations (DNS) and the limitations of traditional turbulence models. This paper explores a novel approach to augmenting…

Fluid Dynamics · Physics 2025-02-17 Jonas Luther , Patrick Jenny

This paper is concerned with temporal convergence analysis of the recently introduced Dynamically Regularized Lagrange Multiplier (DRLM) method for the incompressible Navier-Stokes equations. A key feature of the DRLM approach is the…

Numerical Analysis · Mathematics 2025-08-20 Cao-Kha Doan , Thi-Thao-Phuong Hoang , Lili Ju , Rihui Lan

We describe tests validating progress made toward acceleration and automation of hydrodynamic codes in the regime of developed turbulence by three Deep Learning (DL) Neural Network (NN) schemes trained on Direct Numerical Simulations of…

Fluid Dynamics · Physics 2018-12-06 Ryan King , Oliver Hennigh , Arvind Mohan , Michael Chertkov

As the dimension of a system increases, traditional methods for control and differential games rapidly become intractable, making the design of safe autonomous agents challenging in complex or team settings. Deep-learning approaches avoid…

Optimization and Control · Mathematics 2025-04-29 William Sharpless , Zeyuan Feng , Somil Bansal , Sylvia Herbert

We present efficient deep learning techniques for approximating flow and transport equations for both single phase and two-phase flow problems. The proposed methods take advantages of the sparsity structures in the underlying discrete…

Numerical Analysis · Mathematics 2020-01-08 Yating Wang , Guang Lin

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

Numerical Analysis · Mathematics 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

Efficient algorithms for solving high-dimensional partial differential equations (PDEs) has been an exceedingly difficult task for a long time, due to the curse of dimensionality. We extend the forward-backward stochastic neural networks…

Numerical Analysis · Mathematics 2024-06-21 Yangtao Deng , Qiaolin He

We propose a method for the data-driven inference of temporal evolutions of physical functions with deep learning. More specifically, we target fluid flows, i.e. Navier-Stokes problems, and we propose a novel LSTM-based approach to predict…

Machine Learning · Computer Science 2019-03-06 Steffen Wiewel , Moritz Becher , Nils Thuerey

Computational fluid dynamics lies at the heart of many issues in science and engineering, but solving the associated partial differential equations remains computationally demanding. With the rise of quantum computing, new approaches have…

We propose a novel type of nonlinear solver acceleration for systems of nonlinear partial differential equations (PDEs) that is based on online/adaptive learning. It is applied in the context of multiphase flow in porous media. The proposed…

Machine Learning · Computer Science 2025-04-28 Vinicius L S Silva , Pablo Salinas , Claire E Heaney , Matthew Jackson , Christopher C Pain

We propose first-order pressure-correction scheme for the incompressible Navier-Stokes equations, incorporating the recently developed the Dynamically Regularized Lagrange Multiplier (DRLM) methods. The resulting algorithms are fully…

Numerical Analysis · Mathematics 2026-03-18 Yi Shen , Rihui Lan , Hua Wang

Multiscale is a hallmark feature of complex nonlinear systems. While the simulation using the classical numerical methods is restricted by the local \textit{Taylor} series constraints, the multiscale techniques are often limited by finding…

Dynamical Systems · Mathematics 2024-05-07 Asif Hamid , Danish Rafiq , Shahkar Ahmad Nahvi , Mohammad Abid Bazaz

We propose and study a number of layer methods for stochastic Navier-Stokes equations (SNSE) with spatial periodic boundary conditions and additive noise. The methods are constructed using conditional probabilistic representations of…

Numerical Analysis · Mathematics 2013-12-23 G. N. Milstein , M. V. Tretyakov

In this paper, we study a multi-scale deep neural network (MscaleDNN) as a meshless numerical method for computing oscillatory Stokes flows in complex domains. The MscaleDNN employs a multi-scale structure in the design of its DNN using…

Numerical Analysis · Mathematics 2020-12-30 Bo Wang , Wenzhong Zhang , Wei Cai

The solution of nonlinear electromagnetic (EM) inverse scattering problems is typically hindered by several challenges such as ill-posedness, strong nonlinearity, and high computational costs. Recently, deep learning has been demonstrated…

Computational Physics · Physics 2020-01-08 Lianlin Li , Long Gang Wang , Fernando L. Teixeira