English
Related papers

Related papers: An approach to discrete operator learning based on…

200 papers

We demonstrate an application of the spectral method as a numerical approximation for solving Hyperbolic PDEs. In this method a finite basis is used for approximating the solutions. In particular, we demonstrate a set of such solutions for…

Mathematical Physics · Physics 2008-11-26 P. Pedram , M. Mirzaei , S. S. Gousheh

Ordinary differential equations (ODE) have been widely used for modeling dynamical complex systems. For high-dimensional ODE models where the number of differential equations is large, it remains challenging to estimate the ODE parameters…

Methodology · Statistics 2022-06-20 Muye Nanshan , Nan Zhang , Xiaolei Xun , Jiguo Cao

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

Machine Learning · Statistics 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

Many applications require minimizing a family of optimization problems indexed by some hyperparameter $\lambda \in \Lambda$ to obtain an entire solution path. Traditional approaches proceed by discretizing $\Lambda$ and solving a series of…

Optimization and Control · Mathematics 2025-03-12 Qiran Dong , Paul Grigas , Vishal Gupta

A fast algorithm (linear in the degrees of freedom) for the solution of linear variable-coefficient rational-order fractional integral and differential equations is described. The approach is related to the ultraspherical method for…

Numerical Analysis · Mathematics 2017-12-04 Nicholas Hale , Sheehan Olver

We focus on the problem of estimating the change in the dependency structures of two $p$-dimensional Gaussian Graphical models (GGMs). Previous studies for sparse change estimation in GGMs involve expensive and difficult non-smooth…

Machine Learning · Computer Science 2018-05-24 Beilun Wang , Arshdeep Sekhon , Yanjun Qi

We develop a new and general encode-approximate-reconstruct operator learning model that leverages learned neural representations of bases for input and output function distributions. We introduce the concepts of \textit{numerical operator…

Machine Learning · Computer Science 2025-07-11 Jacob Hauck , Yanzhi Zhang

The deep operator networks (DeepONet), a class of neural operators that learn mappings between function spaces, have recently been developed as surrogate models for parametric partial differential equations (PDEs). In this work we propose a…

Machine Learning · Computer Science 2024-10-31 Yuan Qiu , Nolan Bridges , Peng Chen

In this work we study convergence properties of sparse polynomial approximations for a class of affine parametric saddle point problems. Such problems can be found in many computational science and engineering fields, including the Stokes…

Numerical Analysis · Mathematics 2018-09-28 Peng Chen , Omar Ghattas

Spectral Barron spaces, constituting a specialized class of function spaces that serve as an interdisciplinary bridge between mathematical analysis, partial differential equations (PDEs), and machine learning, are distinguished by the decay…

Functional Analysis · Mathematics 2026-05-19 Mourad Choulli , Shuai Lu , Hiroshi Takase

Optimization-based problems have become of great interest for signal approximation purposes, as they achieved good accuracy results while being extremely flexible and versatile. In this work, we put our focus on the context of periodic…

Optimization and Control · Mathematics 2021-11-30 Adrian Jarret

We study the problem of estimating high dimensional models with underlying sparse structures while preserving the privacy of each training example. We develop a differentially private high-dimensional sparse learning framework using the…

Machine Learning · Statistics 2019-09-16 Lingxiao Wang , Quanquan Gu

The accurate approximation of high-dimensional functions is an essential task in uncertainty quantification and many other fields. We propose a new function approximation scheme based on a spectral extension of the tensor-train (TT)…

Numerical Analysis · Mathematics 2016-09-20 Daniele Bigoni , Allan P. Engsig-Karup , Youssef M. Marzouk

In this paper, we propose some algorithms for analytical solution construction to nonlinear polynomial partial differential equations with constant function coefficients. These schemes are based on one-(single), two- (double) or three-…

Mathematical Physics · Physics 2011-10-04 Mahouton Norbert Hounkonnou , Pascal Alain Dkengne Sielenou

Stochastic differential equation (SDE in short) solvers find numerous applications across various fields. However, in practical simulations, we usually resort to using Ito-Taylor series-based methods like the Euler-Maruyama method. These…

Statistics Theory · Mathematics 2023-12-14 Jingyuan Li , Wei Liu

In this article, we present an orthogonal basis expansion method for solving stochastic differential equations with a path-independent solution of the form $X_{t}=\phi(t,W_{t})$. For this purpose, we define a Hilbert space and construct an…

Computation · Statistics 2017-11-13 Rahman Farnoosh , Amirhossein Sobhani , Hamidreza Rezazadeh

In this paper we introduce a numerical method for nonlinear parabolic PDEs that combines operator splitting with deep learning. It divides the PDE approximation problem into a sequence of separate learning problems. Since the computational…

Numerical Analysis · Mathematics 2021-10-12 Christian Beck , Sebastian Becker , Patrick Cheridito , Arnulf Jentzen , Ariel Neufeld

We consider a nonlinear state-space model with the state transition and observation functions expressed as basis function expansions. The coefficients in the basis function expansions are learned from data. Using a connection to Gaussian…

Computation · Statistics 2017-03-29 Andreas Svensson , Thomas B. Schön

The paradigm of differentiable programming has significantly enhanced the scope of machine learning via the judicious use of gradient-based optimization. However, standard differentiable programming methods (such as autodiff) typically…

Foundation models, such as large language models, have demonstrated success in addressing various language and image processing tasks. In this work, we introduce a multi-modal foundation model for scientific problems, named PROSE-PDE. Our…

Machine Learning · Computer Science 2025-02-04 Jingmin Sun , Yuxuan Liu , Zecheng Zhang , Hayden Schaeffer