Related papers: Hidden mechanism of dynamic large-eddy simulation …
Stochastic geometric mechanics (SGM) is known for its potential utility in quantifying uncertainty in global climate modelling of the Earth's ocean and atmosphere while also preserving the fundamental advective transport properties of ideal…
We present a one-equation subgrid scale model that evolves the turbulence energy corresponding to unresolved velocity fluctuations in large eddy simulations. The model is derived in the context of the Germano consistent decomposition of the…
Recent research has observed that in machine learning optimization, gradient descent (GD) often operates at the edge of stability (EoS) [Cohen, et al., 2021], where the stepsizes are set to be large, resulting in non-monotonic losses…
This paper studies the large-eddy simulation (LES) of isothermal turbulent channel flows. We investigate zero-equation algebraic models without wall function or wall model: functional models, structural models and mixed models. In addition…
Multiscale stochastic dynamical systems have been widely adopted to a variety of scientific and engineering problems due to their capability of depicting complex phenomena in many real world applications. This work is devoted to…
Learning identifiable representations in deep generative models remains a fundamental challenge, particularly for sequential data with regime-switching dynamics. Existing approaches establish identifiability under restrictive assumptions,…
We evaluate the robustness of a probabilistic formulation of system identification (ID) to sparse, noisy, and indirect data. Specifically, we compare estimators of future system behavior derived from the Bayesian posterior of a learning…
Glauber dynamics of a bond-diluted Ising model on a Bethe lattice (a random graph with fixed connectivity) is investigated by an approximate theory which provides exact results for equilibrium properties. The time-dependent solutions of the…
A new scale-dependent dynamic subgrid-scale (SGS) model based on Kolmogorov's scaling hypothesis is presented. This SGS model is utilized in large-eddy simulation of a well-known case study on shear-driven neutral atmospheric boundary layer…
Stochastic gradient descent (SGD) is central to deep learning, yet the dynamical origin of its preference for flatter, more generalizable solutions remains unclear. Here, by analyzing SGD learning dynamics, we identify a nonequilibrium…
Classical machine learning models such as deep neural networks are usually trained by using Stochastic Gradient Descent-based (SGD) algorithms. The classical SGD can be interpreted as a discretization of the stochastic gradient flow. In…
We study the scaling limits of stochastic gradient descent (SGD) with constant step-size in the high-dimensional regime. We prove limit theorems for the trajectories of summary statistics (i.e., finite-dimensional functions) of SGD as the…
The use of machine learning to represent subgrid-scale (SGS) dynamics is now well established in weather forecasting and climate modelling. Recent advances have demonstrated that SGS models trained via ``online'' end-to-end learning --…
Stochastic descent methods (of the gradient and mirror varieties) have become increasingly popular in optimization. In fact, it is now widely recognized that the success of deep learning is not only due to the special deep architecture of…
Modeling continuous-time dynamics constitutes a foundational challenge, and uncovering inter-component correlations within complex systems holds promise for enhancing the efficacy of dynamic modeling. The prevailing approach of integrating…
Stochastic Gradient Descent (SGD) is an out-of-equilibrium algorithm used extensively to train artificial neural networks. However very little is known on to what extent SGD is crucial for to the success of this technology and, in…
In this study, we conduct a parametric analysis to evaluate the sensitivities of wall-modeled large-eddy simulation (LES) with respect to subgrid-scale (SGS) models, mesh resolution, wall boundary conditions and mesh anisotropy. While such…
Reliably predictive simulation of complex flows requires a level of model sophistication and robustness exceeding the capabilities of current Reynolds-averaged Navier-Stokes (RANS) models. The necessary capability can often be provided by…
We analyze the dynamics of streaming stochastic gradient descent (SGD) in the high-dimensional limit when applied to generalized linear models and multi-index models (e.g. logistic regression, phase retrieval) with general data-covariance.…
Recent applications (e.g. active gels and self-assembly of elastic sheets) motivate the need to efficiently simulate the dynamics of thin elastic sheets. We present semi-implicit time stepping algorithms to improve the time step constraints…