English
Related papers

Related papers: An attention-based neural ordinary differential eq…

200 papers

We study adaptive estimation and inference in ill-posed linear inverse problems defined by conditional moment restrictions. Existing regularized estimators such as Regularized DeepIV (RDIV) require prior knowledge of the smoothness of the…

Machine Learning · Statistics 2026-03-03 Jiyuan Tan , Vasilis Syrgkanis

A Skeleton-stabilized ImmersoGeometric Analysis technique is proposed for incompressible viscous flow problems with moderate Reynolds number. The proposed formulation fits within the framework of the finite cell method, where essential…

The translation and shape deformations of a passive viscous Newtonian droplet immersed in an active nematic liquid crystal under circular confinement are analyzed using a linear stability analysis. We focus on the case of a sharply aligned…

Soft Condensed Matter · Physics 2025-07-29 Tanumoy Dhar , Michael J. Shelley , David Saintillan

In deep latent Gaussian models, the latent variable is generated by a time-inhomogeneous Markov chain, where at each time step we pass the current state through a parametric nonlinear map, such as a feedforward neural net, and add a small…

Machine Learning · Computer Science 2019-10-29 Belinda Tzen , Maxim Raginsky

In this paper, we provide sufficient conditions for dissipativity and local asymptotic stability of discrete-time dynamical systems parametrized by deep neural networks. We leverage the representation of neural networks as pointwise affine…

Machine Learning · Computer Science 2022-06-09 Jan Drgona , Soumya Vasisht , Aaron Tuor , Draguna Vrabie

A suitable notion of weak solution to infinite-dimensional rate-independent systems, called Inertial Balanced Viscosity (IBV) solution, is introduced. The key feature of such notion is that the energy dissipated at jump discontinuities…

Analysis of PDEs · Mathematics 2023-06-22 Filippo Riva , Giovanni Scilla , Francesco Solombrino

The safety monitoring for nonlinear dynamical systems with embedded neural network components is addressed in this paper. The interval-observer-based safety monitor is developed consisting of two auxiliary neural networks derived from the…

Systems and Control · Electrical Eng. & Systems 2024-11-18 Tao Wang , Yapeng Li , Zihao Mo , Wesley Cooke , Weiming Xiang

Accurately, efficiently, and stably computing complex fluid flows and their evolution near solid boundaries over long horizons remains challenging. Conventional numerical solvers require fine grids and small time steps to resolve near-wall…

Machine Learning · Computer Science 2026-03-18 Chenglin Li , Hang Xu , Jianting Chen , Yanfei Zhang

Recent advances in neural variational inference have spawned a renaissance in deep latent variable models. In this paper we introduce a generic variational inference framework for generative and conditional models of text. While traditional…

Computation and Language · Computer Science 2016-06-07 Yishu Miao , Lei Yu , Phil Blunsom

Given a particle system obeying overdamped Langevin dynamics, we demonstrate that it is always possible to construct a thermodynamically consistent macroscopic model which obeys a gradient flow with respect to its non-equilibrium free…

Statistical Mechanics · Physics 2025-06-11 Travis Leadbetter , Prashant K. Purohit , Celia Reina

Reynolds-averaged Navier-Stokes (RANS) equations are presently one of the most popular models for simulating turbulence. Performing RANS simulation requires additional modeling for the anisotropic Reynolds stress tensor, but traditional…

Fluid Dynamics · Physics 2020-12-02 Rui Fang , David Sondak , Pavlos Protopapas , Sauro Succi

We present a new data-driven reduced-order modeling approach to efficiently solve parametrized partial differential equations (PDEs) for many-query problems. This work is inspired by the concept of implicit neural representation (INR),…

Numerical Analysis · Mathematics 2023-11-30 Tianshu Wen , Kookjin Lee , Youngsoo Choi

In fluid physics, data-driven models to enhance or accelerate solution methods are becoming increasingly popular for many application domains, such as alternatives to turbulence closures, system surrogates, or for new physics discovery. In…

Neural ordinary differential equations (NODEs), one of the most influential works of the differential equation-based deep learning, are to continuously generalize residual networks and opened a new field. They are currently utilized for…

Machine Learning · Computer Science 2023-12-19 Woojin Cho , Seunghyeon Cho , Hyundong Jin , Jinsung Jeon , Kookjin Lee , Sanghyun Hong , Dongeun Lee , Jonghyun Choi , Noseong Park

The purpose of the current work is the development of a so-called physics-encoded Fourier neural operator (PeFNO) for surrogate modeling of the quasi-static equilibrium stress field in solids. Rather than accounting for constraints from…

Computational Engineering, Finance, and Science · Computer Science 2025-02-06 Mohammad S. Khorrami , Pawan Goyal , Jaber R. Mianroodi , Bob Svendsen , Peter Benner , Dierk Raabe

Despite the Transformer's dominance across machine learning, its architecture remains largely heuristic and lacks a unified theoretical foundation. We introduce Score-based Variational Flow (SVFlow), a continuous-time dynamical system for…

Machine Learning · Computer Science 2026-04-28 Huadong Liao

One of the main theoretical issues in developing a theory of anisotropic viscoelastic media at finite strains lies in the proper definition of the material symmetry group and its evolution with time. In this paper the matter is discussed…

Soft Condensed Matter · Physics 2021-02-03 Jacopo Ciambella , Paola Nardinocchi

Stochastic differential equations (SDEs) are used to describe a wide variety of complex stochastic dynamical systems. Learning the hidden physics within SDEs is crucial for unraveling fundamental understanding of these systems' stochastic…

Machine Learning · Computer Science 2022-07-26 Jared O'Leary , Joel A. Paulson , Ali Mesbah

In this thesis, we develop methods to enhance the interpretability of recent representation learning techniques in natural language processing (NLP) while accounting for the unavailability of annotated data. We choose to leverage…

Computation and Language · Computer Science 2023-05-05 Ghazi Felhi

In recent years, deep learning has proven to be a viable methodology for surrogate modeling and uncertainty quantification for a vast number of physical systems. However, in their traditional form, such models can require a large amount of…

Computational Physics · Physics 2019-12-04 Nicholas Geneva , Nicholas Zabaras