Related papers: Numerically Consistent Non-Boussinesq Subgrid-scal…
Many practical combustion systems such as those in rockets, gas turbines, and internal combustion engines operate under high pressures that surpass the thermodynamic critical limit of fuel-oxidizer mixtures. These conditions require the…
Large Eddy Simulations of turbulent flows are powerful tools used in many engineering and geophysical settings. Choosing the right value of the free parameters for their subgrid scale models is a crucial task for which the current methods…
When using large-batch training to speed up stochastic gradient descent, learning rates must adapt to new batch sizes in order to maximize speed-ups and preserve model quality. Re-tuning learning rates is resource intensive, while fixed…
Stochastic Gradient Descent (SGD) is widely used in machine learning research. Previous convergence analyses of SGD under the vanishing step-size setting typically require Robbins-Monro conditions. However, in practice, a wider variety of…
In this work, we make two improvements on the staggered grid hydrodynamics (SGH) Lagrangian scheme for modeling 2-dimensional compressible multi-material flows on triangular mesh. The first improvement is the construction of a dynamic local…
We present a theoretical analysis of some popular adaptive Stochastic Gradient Descent (SGD) methods in the small learning rate regime. Using the stochastic modified equations framework introduced by Li et al., we derive effective…
Fluid turbulence is an important problem for physics and engineering. Turbulence modeling deals with the development of simplified models that can act as surrogates for representing the effects of turbulence on flow evolution. Such models…
We propose a supervised-machine-learning-based wall model for coarse-grid wall-resolved large-eddy simulation (LES). Our consideration is made on LES of turbulent channel flows with a first grid point set relatively far from the wall…
In this paper, we propose a novel optimization algorithm for training machine learning models called Input Normalized Stochastic Gradient Descent (INSGD), inspired by the Normalized Least Mean Squares (NLMS) algorithm used in adaptive…
The Large Eddy Simulation (LES) approach - solving numerically the large scales of a turbulent system and accounting for the small-scale influence through a model - is applied to nonlinear gyrokinetic systems that are driven by a number of…
We present a framework based on the generalized lattice-Boltzmann equation using multiple relaxation times with forcing term for eddy capturing simulation of wall bounded turbulent flows. Due to its flexibility in using disparate relaxation…
The recently proposed stochastic Polyak stepsize (SPS) and stochastic line-search (SLS) for SGD have shown remarkable effectiveness when training over-parameterized models. However, in non-interpolation settings, both algorithms only…
We study the problem of how to distribute the training of large-scale deep learning models in the parallel computing environment. We propose a new distributed stochastic optimization method called Elastic Averaging SGD (EASGD). We analyze…
In this study, we have identified certain fundamental limitations of a mixing length parameterization used in a popular turbulent kinetic energy-based subgrid-scale model. Replacing this parameterization with a more physically realistic one…
The simulation of turbulent flows remains a central challenge, as even our most powerful computers cannot resolve the finest scales of motion in many flows of practical interest. As a result, the effects of unresolved scales on large eddies…
The present work is concerned with a study of large eddy simulations (LES) of unsteady turbulent jet flows. In particular, the present analysis is focused on the effects of the subgrid-scale modeling used when a second-order spatial…
Grid adaptation for implicit Large Eddy Simulation (LES) is a non-trivial challenge due to the inherent coupling of the modeling and numerical errors. An attempt to address the challenge first requires a comprehensive assessment and then…
Various gradient compression schemes have been proposed to mitigate the communication cost in distributed training of large scale machine learning models. Sign-based methods, such as signSGD, have recently been gaining popularity because of…
The classical line search for learning rate (LR) tuning in the stochastic gradient descent (SGD) algorithm can tame the convergence slowdown due to data-sampling noise. In a federated setting, wherein the client heterogeneity introduces a…
In this article, we consider convergence of stochastic gradient descent schemes (SGD), including momentum stochastic gradient descent (MSGD), under weak assumptions on the underlying landscape. More explicitly, we show that on the event…