English
Related papers

Related papers: Debiased neural operators for estimating functiona…

200 papers

We consider the problem of discrete-time signal denoising, focusing on a specific family of non-linear convolution-type estimators. Each such estimator is associated with a time-invariant filter which is obtained adaptively, by solving a…

Statistics Theory · Mathematics 2018-06-13 Dmitrii Ostrovskii , Zaid Harchaoui

We present a novel framework combining Deep Operator Networks (DeepONets) with Physics-Informed Neural Networks (PINNs) to solve partial differential equations (PDEs) and estimate their unknown parameters. By integrating data-driven…

Machine Learning · Computer Science 2025-08-05 Amogh Raj , Carol Eunice Gudumotou , Sakol Bun , Keerthana Srinivasa , Arash Sarshar

Massive multiple input multiple output(MIMO)-based fully-digital receive antenna arrays bring huge amount of complexity to both traditional direction of arrival(DOA) estimation algorithms and neural network training, which is difficult to…

Signal Processing · Electrical Eng. & Systems 2023-01-18 Yiwen Chen , Xichao Zhan , Feng Shu

We introduce a new paradigm for solving regularized variational problems. These are typically formulated to address ill-posed inverse problems encountered in signal and image processing. The objective function is traditionally defined by…

Optimization and Control · Mathematics 2021-04-22 Jean-Christophe Pesquet , Audrey Repetti , Matthieu Terris , Yves Wiaux

Neural operators have shown great potential in surrogate modeling. However, training a well-performing neural operator typically requires a substantial amount of data, which can pose a major challenge in complex applications. In such…

Machine Learning · Computer Science 2026-02-05 Keyan Chen , Yile Li , Da Long , Zhitong Xu , Wei Xing , Jacob Hochhalter , Shandian Zhe

We present a framework that leverages the Discrete Empirical Interpolation Method (DEIM) for interpretable deep learning and dynamical system analysis. Although DEIM efficiently approximates nonlinear terms in projection-based reduced-order…

Machine Learning · Computer Science 2026-04-03 Hojin Kim , Romit Maulik

Neural operators have emerged as a powerful, data-driven paradigm for learning solution operators of partial differential equations (PDEs). State-of-the-art architectures, such as the Fourier Neural Operator (FNO), have achieved remarkable…

Machine Learning · Computer Science 2025-08-08 Saman Pordanesh , Pejman Shahsavari , Hossein Ghadjari

The data-driven discovery of interpretable models approximating the underlying dynamics of a physical system has gained attraction in the past decade. Current approaches employ pre-specified functional forms or basis functions and often…

Machine Learning · Computer Science 2025-07-30 Rahul Golder , M. M. Faruque Hasan

This paper studies distributed estimation and inference for a general statistical problem with a convex loss that could be non-differentiable. For the purpose of efficient computation, we restrict ourselves to stochastic first-order…

Machine Learning · Statistics 2022-07-19 Xi Chen , Weidong Liu , Yichen Zhang

Neural operators have been explored as surrogate models for simulating physical systems to overcome the limitations of traditional partial differential equation (PDE) solvers. However, most existing operator learning methods assume that the…

Machine Learning · Computer Science 2024-02-13 Rui Zhang , Qi Meng , Zhi-Ming Ma

Neural operators can learn nonlinear mappings between function spaces and offer a new simulation paradigm for real-time prediction of complex dynamics for realistic diverse applications as well as for system identification in science and…

Computational Physics · Physics 2022-03-23 Lu Lu , Xuhui Meng , Shengze Cai , Zhiping Mao , Somdatta Goswami , Zhongqiang Zhang , George Em Karniadakis

Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We…

Machine Learning · Computer Science 2022-05-20 Pawan Goyal , Peter Benner

Enabled by large-scale text corpora with huge parameters, pre-trained language models operate as multi-task experts using a single model architecture. However, recent studies have revealed that certain neurons play disproportionately…

Computation and Language · Computer Science 2025-08-22 Nakyeong Yang , Jiwon Moon , Junseok Kim , Yunah Jang , Kyomin Jung

Numerical approximations of partial differential equations (PDEs) are routinely employed to formulate the solution of physics, engineering, and mathematical problems involving functions of several variables, such as the propagation of heat…

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

Neural operator surrogates for time-dependent partial differential equations (PDEs) conventionally employ autoregressive prediction schemes, which accumulate error over long rollouts and require uniform temporal discretization. We introduce…

Machine Learning · Computer Science 2025-12-08 Xianglong Hou , Xinquan Huang , Paris Perdikaris

This paper provides lower bounds on the convergence rate of Derivative Free Optimization (DFO) with noisy function evaluations, exposing a fundamental and unavoidable gap between the performance of algorithms with access to gradients and…

Machine Learning · Statistics 2012-09-13 Kevin G. Jamieson , Robert D. Nowak , Benjamin Recht

Continuous-depth neural networks, such as Neural ODEs, have refashioned the understanding of residual neural networks in terms of non-linear vector-valued optimal control problems. The common solution is to use the adjoint sensitivity…

Machine Learning · Computer Science 2022-02-16 Andrew Corbett , Dmitry Kangin

Operator learning offers a robust framework for approximating mappings between infinite-dimensional function spaces. It has also become a powerful tool for solving inverse problems in the computational sciences. This chapter surveys…

Numerical Analysis · Mathematics 2025-12-08 Nicholas H. Nelsen , Yunan Yang

We introduce a method that combines neural operators, physics-informed machine learning, and standard numerical methods for solving PDEs. The proposed approach extends each of the aforementioned methods and unifies them within a single…

Computational Engineering, Finance, and Science · Computer Science 2025-12-02 Shahed Rezaei , Reza Najian Asl , Kianoosh Taghikhani , Ahmad Moeineddin , Michael Kaliske , Markus Apel