Related papers: Flowing Through Layers: A Continuous Dynamical Sys…
Though Transformers have achieved promising results in many computer vision tasks, they tend to be over-confident in predictions, as the standard Dot Product Self-Attention (DPSA) can barely preserve distance for the unbounded input domain.…
We propose a new class of finite element approximations to ideal compressible magnetohydrodynamic equations in smooth regime. Following variational approximations developed for fluid models in the last decade, our discretizations are built…
In the study of oceanic flows at the geophysical scale, the phenomenon of density stratification plays a central role in the dynamics of the system. Two categories of mathematical models are commonly used to describe the role played by the…
Mathematical models of biological populations commonly use discrete structure classes to capture trait variation among individuals (e.g. age, size, phenotype, intracellular state). Upscaling these discrete models into continuum descriptions…
Decoder-only transformers compute the conditional probability of the next token from a sequence of past observations. This paper derives, from first principles, inference architectures that solve the same prediction problem - and in doing…
The Euler scheme is one of the standard schemes to obtain numerical approximations of stochastic differential equations (SDEs). Its convergence properties are well-known in the case of globally Lipschitz continuous coefficients. However, in…
In this paper, we study the two-dimensional steady compactly supported incompressible Euler equations with free boundaries. We consider flows with constant vorticity that are perturbations of annular equilibria, in contrast to the laminar…
We present a systematic approach to deriving normal forms and related amplitude equations for flows and discrete dynamics on the center manifold of a dynamical system at local bifurcations and unfoldings of these. We derive a general,…
The widespread 'deeper is better' philosophy has driven the creation of architectures like ResNet and Transformer, which achieve high performance by stacking numerous layers. However, increasing model depth comes with challenges such as…
Lattice-Boltzmann methods are established mesoscopic numerical schemes for fluid flow, that recover the evolution of macroscopic quantities (viz., velocity and pressure fields) evolving under macroscopic target equations. The approximated…
In the present paper, a continuum model is introduced for fluid flow in a deformable porous medium, where the fluid may undergo phase transitions. Typically, such problems arise in modeling liquid-solid phase transformations in groundwater…
We report the study of sudden transitions or tipping in a collection of systems induced due to multiplexing with another network of systems. The emergent dynamics of oscillators on one layer can undergo a sudden transition to steady state…
The paper investigates the throughput behavior of single-commodity dynamical flow networks governed by monotone distributed routing policies. The networks are modeled as systems of ODEs based on mass conversation laws on directed graphs…
We develop a quantitative statistical theory of transformers in the large-context regime by adopting the abstraction of contextual flow maps (CFMs): dynamical systems that evolve a distinguished token in the presence of a contextual measure…
We use a novel parameterization of the flowing Hamiltonian to show that the flow equations based on continuous unitary transformations, as proposed by Wegner, can be implemented through a nonlinear partial differential equation involving…
Discontinuous transitions into absorbing states require an effective mechanism that prevents the stabilization of low density states. They can be found in different systems, such as lattice models or stochastic differential equations (e.g.…
A coupled system composed of a Newtonian fluid located on a sinusoidally-forced elastic solid is studied analytically and numerically. The focus is on the transient evolution from the beginning of the forced oscillations and on the periodic…
Incompressible Euler flows in narrow domains, in which the horizontal length scale is much larger than other scales, play an important role in applications, and their leading-order behavior can be described by the hydrostatic Euler…
We consider the problem of determining the class of continuous-time dynamical systems that can be globally linearized in the sense of admitting an embedding into a linear system on a higher-dimensional Euclidean space. We solve this problem…
In this paper we study a certain regularity property of Axiom A flows over basic sets related to diameters of balls in Bowen's metric, which we call regular distortion along unstable manifolds. The motivation to investigate the latter comes…