Related papers: Supervised parallel-in-time algorithm for long-tim…

Stochastic gradient methods have been a popular and powerful choice of optimization methods, aimed at minimizing functions. Their advantage lies in the fact that that one approximates the gradient as opposed to using the full Jacobian…

Lagrangian particle-based methods have opened new perspectives for the investigation of complex problems with large free-surface deformation. Some well-known particle-based methods adopted to solve non-linear hydrodynamics problems are the…

There is an increased interest in building data analytics frameworks with advanced algebraic capabilities both in industry and academia. Many of these frameworks, e.g., TensorFlow and BIDMach, implement their compute-intensive primitives in…

A variety of simulation methodologies have been used for modeling reaction-diffusion dynamics -- including approaches based on Differential Equations (DE), the Stochastic Simulation Algorithm (SSA), Brownian Dynamics (BD), Green's Function…

Dissipative particle dynamics (DPD) belongs to a class of models and computational algorithms developed to address mesoscale problems in complex fluids and soft matter in general. It is based on the notion of particles that represent…

In this study we investigated the capabilities of the mesh-free, Lagrangian particle method (Smoothed Particle Hydrodynamics, SPH) to simulate the detailed hydrodynamic processes generated by both spilling and plunging breaking waves within…

Solving partial differential equations (PDEs) by numerical methods meet computational cost challenge for getting the accurate solution since fine grids and small time steps are required. Machine learning can accelerate this process, but…

In this article we expand and develop the authors' recent proposed methodology for efficient stochastic superparameterization (SP) algorithms for geophysical turbulence. Geophysical turbulence is characterized by significant intermittent…

One of the most widely used methods for solving large-scale stochastic optimization problems is distributed asynchronous stochastic gradient descent (DASGD), a family of algorithms that result from parallelizing stochastic gradient descent…

This paper proposes a novel consistent {\delta}+- Updated Lagrangian Particle Hydrodynamics (ULPH) model. Although the Smoothed Particle Hydrodynamics (SPH) model has gained recognized achievements, it is afflicted by excessive numerical…

The implementation of a vast majority of machine learning (ML) algorithms boils down to solving a numerical optimization problem. In this context, Stochastic Gradient Descent (SGD) methods have long proven to provide good results, both in…

Scalable surrogate models enable efficient emulation of computer models (or simulators), particularly when dealing with large ensembles of runs. While Gaussian process (GP) models are commonly employed for emulation, they face limitations…

Stochastic Gradient Langevin Dynamics (SGLD) is a powerful algorithm for optimizing a non-convex objective, where a controlled and properly scaled Gaussian noise is added to the stochastic gradients to steer the iterates towards a global…

Recent work has established an empirically successful framework for adapting learning rates for stochastic gradient descent (SGD). This effectively removes all needs for tuning, while automatically reducing learning rates over time on…

Metastability is a common obstacle to performing long molecular dynamics simulations. Many numerical methods have been proposed to overcome it. One method is parallel replica dynamics, which relies on the rapid convergence of the underlying…

Inspired by spatiotemporal observations from satellites of the trajectories of objects drifting near the surface of the ocean in the National Oceanic and Atmospheric Administration's `Global Drifter Program', this paper develops data-driven…

Dissipative particle dynamics (DPD) and multi-particle collision (MPC) dynamics are powerful tools to study mesoscale hydrodynamic phenomena accompanied by thermal fluctuations. To understand the advantages of these types of mesoscale…

Following AI scaling trends, frontier models continue to grow in size and continue to be trained on larger datasets. Training these models requires huge investments in exascale computational resources, which has in turn driven developtment…

In this work, we present a high-fidelity and efficient point-particle direct numerical simulation framework based on a multi-block overset curvilinear grid system, enabling large-scale Lagrangian particle tracking in complex geometries with…

In this paper we combine the Parareal parallel-in-time method together with spatial parallelization and investigate this space-time parallel scheme by means of solving the three-dimensional incompressible Navier-Stokes equations.…