English
Related papers

Related papers: Transported Memory Networks accelerating Computati…

200 papers

Simulating infiltration in porous media using Richards' equation remains computationally challenging due to its parabolic structure and nonlinear coefficients. While a wide range of numerical methods for differential equations have been…

Numerical Analysis · Mathematics 2026-04-16 Arnob Barua , Christopher E. Kees , Dmitri Kuzmin

Recently, computational modeling has shifted towards the use of deep learning, and other data-driven modeling frameworks. Although this shift in modeling holds promise in many applications like design optimization and real-time control by…

Fluid Dynamics · Physics 2021-10-11 Suraj Pawar , Omer San , Prakash Vedula , Adil Rasheed , Trond Kvamsdal

Continuous normalizing flows (CNFs) construct invertible mappings between an arbitrary complex distribution and an isotropic Gaussian distribution using Neural Ordinary Differential Equations (neural ODEs). It has not been tractable on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shian Du , Yihong Luo , Wei Chen , Jian Xu , Delu Zeng

Porous media is widely distributed in nature, found in environments such as soil, rock formations, and plant tissues, and is crucial in applications like subsurface oil and gas extraction, medical drug delivery, and filtration systems.…

Geophysics · Physics 2025-01-03 Qingqi Zhao , Xiaoxue Han , Ruichang Guo , Cheng Chen

Neural ordinary differential equations describe how values change in time. This is the reason why they gained importance in modeling sequential data, especially when the observations are made at irregular intervals. In this paper we propose…

Machine Learning · Computer Science 2021-10-26 Marin Biloš , Johanna Sommer , Syama Sundar Rangapuram , Tim Januschowski , Stephan Günnemann

It is increasingly common to encounter data from dynamic processes captured by static cross-sectional measurements over time, particularly in biomedical settings. Recent attempts to model individual trajectories from this data use optimal…

Machine Learning · Statistics 2020-07-28 Alexander Tong , Jessie Huang , Guy Wolf , David van Dijk , Smita Krishnaswamy

Retentive Network (RetNet) represents a significant advancement in neural network architecture, offering an efficient alternative to the Transformer. While Transformers rely on self-attention to model dependencies, they suffer from high…

Computation and Language · Computer Science 2025-06-10 Haiqi Yang , Zhiyuan Li , Yi Chang , Yuan Wu

We present Unified PDE Solvers (UPS), a data- and compute-efficient approach to developing unified neural operators for diverse families of spatiotemporal PDEs from various domains, dimensions, and resolutions. UPS embeds different PDEs…

Machine Learning · Computer Science 2024-11-26 Junhong Shen , Tanya Marwah , Ameet Talwalkar

Numerical simulations including magnetic fields have become important in many fields of astrophysics. Evolution of magnetic fields by the constrained transport algorithm preserves magnetic divergence to machine precision, and thus…

Astrophysics · Physics 2009-11-13 Jason Maron , Mordecai-Mark Mac Low , Jeffrey Oishi

We present a computational technique for modeling the evolution of dynamical systems in a reduced basis, with a focus on the challenging problem of modeling partially-observed partial differential equations (PDEs) on high-dimensional…

Machine Learning · Statistics 2024-12-25 Victor Churchill

Efficient management of traffic flow in urban environments presents a significant challenge, exacerbated by dynamic changes and the sheer volume of data generated by modern transportation networks. Traditional centralized traffic management…

Machine Learning · Computer Science 2025-01-29 Bob Johnson , Michael Geller

Sediment transport over an erodible sediment bed is studied by particle resolved simulations with a hybrid parallel approach. To overcome the challenges of load imbalance in the traditional domain decomposition method when encountering…

Fluid Dynamics · Physics 2022-07-27 Zhengping Zhu , Ruifeng Hu , Yinghaonan Lei , Lian Shen , Xiaojing Zheng

In this paper, we propose neural networks that tackle the problems of stability and field-of-view of a Convolutional Neural Network (CNN). As an alternative to increasing the network's depth or width to improve performance, we propose…

Machine Learning · Computer Science 2021-11-03 Bastian Bohn , Michael Griebel , Dinesh Kannan

Real world networks are often subject to severe uncertainties which need to be addressed by any reliable prescriptive model. In the context of the maximum flow problem subject to arc failure, robust models have gained particular attention.…

Discrete Mathematics · Computer Science 2017-05-24 Fabian Mies , Britta Peis , Andreas Wierz

Optimal transport has been used extensively in resource matching to promote the efficiency of resources usages by matching sources to targets. However, it requires a significant amount of computations and storage spaces for large-scale…

Optimization and Control · Mathematics 2019-04-10 Rui Zhang , Quanyan Zhu

This paper studies a constrained optimization problem over networked systems with an undirected and connected communication topology. The algorithm proposed in this work utilizes singular perturbation, dynamic average consensus, and saddle…

Optimization and Control · Mathematics 2017-10-24 Phuong Huu Hoang , Hyo-Sung Ahn

The conjoining of dynamical systems and deep learning has become a topic of great interest. In particular, neural differential equations (NDEs) demonstrate that neural networks and differential equation are two sides of the same coin.…

Machine Learning · Computer Science 2022-02-08 Patrick Kidger

Three recent breakthroughs due to AI in arts and science serve as motivation: An award winning digital image, protein folding, fast matrix multiplication. Many recent developments in artificial neural networks, particularly deep learning…

Machine Learning · Computer Science 2026-05-21 Loc Vu-Quoc , Alexander Humer

We develop efficient algorithms for a fundamental network design problem arising in potential-based flow models, which are central to many energy transport networks (e.g., hydrogen and electricity). In contrast to classical network flow…

Discrete Mathematics · Computer Science 2026-04-30 Max Klimm , Marc E. Pfetsch , Martin Skutella , Lea Strubberg

Modern sensing and metrology systems now stream terabytes of heterogeneous, high-dimensional (HD) data profiles, images, and dense point clouds, whose natural representation is multi-way tensors. Understanding such data requires regression…

Machine Learning · Computer Science 2025-10-08 Qian Wang , Mohammad N. Bisheh , Kamran Paynabar