English
Related papers

Related papers: Reclaiming First Principles: A Differentiable Fram…

200 papers

Many problems in engineering and sciences require the solution of large scale optimization constrained by partial differential equations (PDEs). Though PDE-constrained optimization is itself challenging, most applications pose additional…

Optimization and Control · Mathematics 2020-01-06 Joseph Hart , Bart van Bloemen Waanders , Roland Herzog

This paper develops a generative model by minimizing the second-order Wasserstein loss (the $W_2$ loss) through a distribution-dependent ordinary differential equation (ODE), whose dynamics involves the Kantorovich potential associated with…

Machine Learning · Statistics 2026-05-14 Yu-Jui Huang , Zachariah Malik

Neural networks are discrete entities: subdivided into discrete layers and parametrized by weights which are iteratively optimized via difference equations. Recent work proposes networks with layer outputs which are no longer quantized but…

Neural and Evolutionary Computing · Computer Science 2019-09-09 Stefano Massaroli , Michael Poli , Federico Califano , Angela Faragasso , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

There is a wave of interest in using unsupervised neural networks for solving differential equations. The existing methods are based on feed-forward networks, {while} recurrent neural network differential equation solvers have not yet been…

Machine Learning · Computer Science 2021-09-07 Marios Mattheakis , Hayden Joy , Pavlos Protopapas

Reconstructing ocean dynamics from observational data is fundamentally limited by the sparse, irregular, and Lagrangian nature of spatial sampling, particularly in subsurface and remote regions. This sparsity poses significant challenges…

Atmospheric and Oceanic Physics · Physics 2025-07-10 Niloofar Asefi , Leonard Lupin-Jimenez , Tianning Wu , Ruoying He , Ashesh Chattopadhyay

To increase the predictive power of a model, one needs to estimate its unknown parameters. Almost all parameter estimation techniques in ordinary differential equation models suffer from either a small convergence region or enormous…

Optimization and Control · Mathematics 2020-06-30 Ozgur Aydogmus , Ali Hakan Tor

In recent years, various watermarking methods were suggested to detect computer vision models obtained illegitimately from their owners, however they fail to demonstrate satisfactory robustness against model extraction attacks. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Jacob Shams , Ben Nassi , Ikuya Morikawa , Toshiya Shimizu , Asaf Shabtai , Yuval Elovici

The heavy-tailed nature of precipitation intensity impedes precise precipitation nowcasting. Standard models that optimize pixel-wise losses are prone to regression-to-the-mean bias, which blurs extreme values. Existing Fourier-based…

Atmospheric and Oceanic Physics · Physics 2026-02-03 Baitian Liu , Haiping Zhang , Huiling Yuan , Dongjing Wang , Ying Li , Feng Chen , Hao Wu

Computing reduced-order models using non-intrusive methods is particularly attractive for systems that are simulated using black-box solvers. However, obtaining accurate data-driven models can be challenging, especially if the underlying…

Mathematical Physics · Physics 2024-01-03 Alberto Padovan , Blaine Vollmer , Daniel J. Bodony

The emergence of hydrodynamics is one of the deepest phenomena in many-body systems. Arguably, the hydrodynamic equations are also the most important tools for predicting large-scale behaviour. Understanding how such equations emerge from…

Statistical Mechanics · Physics 2025-03-13 Sun Woo P. Kim , Friedrich Hübner , Juan P. Garrahan , Benjamin Doyon

The hillslope hydrological processes are very important in watershed hydrology research. In this paper we focus on the water flow over the soil surface with vegetation in a hydrographic basin. We introduce a PDE model based on general…

Analysis of PDEs · Mathematics 2020-09-03 Stelian Ion , Dorin Marinescu , Stefan-Gicu Cruceanu

Artificial neural networks, widely recognised for their role in machine learning, are now transforming the study of ordinary differential equations (ODEs), bridging data-driven modelling with classical dynamical systems and enabling the…

Optimization and Control · Mathematics 2025-04-15 Dario Izzo , Sebastien Origer , Giacomo Acciarini , Francesco Biscani

A general, variational approach to derive low-order reduced systems is presented. The approach is based on the concept of optimal parameterizing manifold (OPM) that substitutes the more classical notions of invariant or slow manifold when…

Dynamical Systems · Mathematics 2023-09-18 Mickaël D. Chekroun , Honghu Liu , James C. McWilliams

The distinctive architectural features of normalizing flows (NFs), notably bijectivity and tractable Jacobians, make them well-suited for generative modeling. Invertible neural networks (INNs) build on these principles to address supervised…

Machine Learning · Computer Science 2026-02-25 Shubhanshu Shekhar , Mohammad Javad Khojasteh , Ananya Acharya , Tony Tohme , Kamal Youcef-Toumi

In this work, we introduce a novel framework for privately optimizing objectives that rely on Wasserstein distances between data-dependent empirical measures. Our main theoretical contribution is, based on an explicit formulation of the…

Machine Learning · Computer Science 2025-05-22 David Rodríguez-Vítores , Clément Lalanne , Jean-Michel Loubes

Several widely-used first-order saddle-point optimization methods yield an identical continuous-time ordinary differential equation (ODE) that is identical to that of the Gradient Descent Ascent (GDA) method when derived naively. However,…

Optimization and Control · Mathematics 2023-08-01 Tatjana Chavdarova , Michael I. Jordan , Manolis Zampetakis

The differentiable programming paradigm is a cornerstone of modern scientific computing. It refers to numerical methods for computing the gradient of a numerical model's output. Many scientific models are based on differential equations,…

Multidimensional shock-capturing numerical schemes for special relativistic hydrodynamics (RHD) are computationally more expensive than their correspondent Euler versions, due to the nonlinear relations between conservative and primitive…

Astrophysics · Physics 2009-11-07 L. Del Zanna , N. Bucciantini

We formulate the predicted-updates dynamic model, one of the first beyond-worst-case models for dynamic algorithms, which generalizes a large set of well-studied dynamic models including the offline dynamic, incremental, and decremental…

Data Structures and Algorithms · Computer Science 2023-11-29 Quanquan C. Liu , Vaidehi Srinivas

This paper proposes a novel paradigm for machine learning that moves beyond traditional parameter optimization. Unlike conventional approaches that search for optimal parameters within a fixed geometric space, our core idea is to treat the…

Machine Learning · Computer Science 2025-10-31 Di Zhang