English
Related papers

Related papers: IKNO: Infinite-order Kernel Neural Operators

200 papers

Interpretability for machine learning models is becoming more and more important as machine learning models become more complex. The functional ANOVA model, which decomposes a high-dimensional function into a sum of lower dimensional…

Machine Learning · Statistics 2025-08-01 Seokhun Park , Insung Kong , Yongchan Choi , Chanmoo Park , Yongdai Kim

We propose a tensor neural network ($t$-NN) framework that offers an exciting new paradigm for designing neural networks with multidimensional (tensor) data. Our network architecture is based on the $t$-product (Kilmer and Martin, 2011), an…

Machine Learning · Computer Science 2018-11-19 Elizabeth Newman , Lior Horesh , Haim Avron , Misha Kilmer

The neural operator has emerged as a powerful tool in learning mappings between function spaces in PDEs. However, when faced with real-world physical data, which are often highly non-uniformly distributed, it is challenging to use…

Machine Learning · Computer Science 2023-06-01 Songming Liu , Zhongkai Hao , Chengyang Ying , Hang Su , Ze Cheng , Jun Zhu

We introduce a novel Multimodal Neural Operator (MNO) architecture designed to learn solution operators for multi-parameter nonlinear boundary value problems (BVPs). Traditional neural operators primarily map either the PDE coefficients or…

Computational Engineering, Finance, and Science · Computer Science 2025-07-17 Vamshi C. Madala , Nithin Govindarajan , Shivkumar Chandrasekaran

Shape-morphing soft materials can enable diverse target morphologies through voxel-level material distribution design, offering significant potential for various applications. Despite progress in basic shape-morphing design with simple…

Machine Learning · Computer Science 2026-02-03 Lu Chen , Gengxiang Chen , Xu Liu , Jingyan Su , Xuhao Lyu , Lihui Wang , Yingguang Li

Neural operators have emerged as a powerful tool for solving partial differential equations (PDEs) and other complex scientific computing tasks. However, the performance of single operator block is often limited, thus often requiring…

Numerical Analysis · Mathematics 2025-07-18 Yichen Wang , Wenlian Lu

Accurate sensing of spatially distributed physical fields typically requires dense instrumentation, which is often infeasible in real-world systems due to cost, accessibility, and environmental constraints. Physics-based solvers address…

Machine Learning · Computer Science 2026-04-03 William Howes , Jason Yoo , Kazuma Kobayashi , Subhankar Sarkar , Farid Ahmed , Souvik Chakraborty , Syed Bahauddin Alam

In this work, we introduce a planning neural operator (PNO) for predicting the value function of a motion planning problem. We recast value function approximation as learning a single operator from the cost function space to the value…

Robotics · Computer Science 2025-05-28 Sharath Matada , Luke Bhan , Yuanyuan Shi , Nikolay Atanasov

Neural operators have emerged as a powerful, data-driven paradigm for learning solution operators of partial differential equations (PDEs). State-of-the-art architectures, such as the Fourier Neural Operator (FNO), have achieved remarkable…

Machine Learning · Computer Science 2025-08-08 Saman Pordanesh , Pejman Shahsavari , Hossein Ghadjari

Kernel-based approach to operator approximation for partial differential equations has been shown to be unconditionally stable for linear PDEs and numerically exhibit unconditional stability for non-linear PDEs. These methods have the same…

Numerical Analysis · Mathematics 2025-11-25 Andrew Christlieb , Sining Gong , Hyoseon Yang

Solving parametric partial differential equations (PDEs) and associated PDE-based, inverse problems is a central task in engineering and physics, yet existing neural operator methods struggle with high-dimensional, discontinuous inputs and…

Machine Learning · Computer Science 2025-07-03 Yaohua Zang , Phaedon-Stelios Koutsourelakis

Solving ill-posed inverse problems necessitates effective regularization strategies to stabilize the inversion process against measurement noise. While classical methods like Tikhonov regularization require heuristic parameter tuning, and…

Machine Learning · Statistics 2026-03-24 Hang-Cheng Dong , Pengcheng Cheng , Shuhuan Li

Despite their immense promise in performing a variety of learning tasks, a theoretical understanding of the limitations of Deep Neural Networks (DNNs) has so far eluded practitioners. This is partly due to the inability to determine the…

Machine Learning · Computer Science 2024-01-25 Saad Qadeer , Andrew Engel , Amanda Howard , Adam Tsou , Max Vargas , Panos Stinis , Tony Chiang

Recently, the use of neural networks to accelerate the solving of partial differential equations (PDEs) has gained significant traction in both academia and industry. However, employing neural networks as standalone surrogate models raises…

Kernel methods form a theoretically-grounded, powerful and versatile framework to solve nonlinear problems in signal processing and machine learning. The standard approach relies on the \emph{kernel trick} to perform pairwise evaluations of…

Machine Learning · Computer Science 2020-01-03 Kan Li , Jose C. Principe

We introduce the Z-Domain Neural Operator (ZNO), a causal neural operator whose layers are stable low-rank multiple-input multiple-output (MIMO) rational filters parameterized directly in the $z$-plane. ZNO addresses a limitation of…

Machine Learning · Computer Science 2026-05-07 Xianli Zhu , Jia Yin

We introduce a neural network architecture to solve inverse problems linked to a one-dimensional integral operator. This architecture is built by unfolding a forward-backward algorithm derived from the minimization of an objective function…

Optimization and Control · Mathematics 2021-06-01 Emilie Chouzenoux , Cecile Della Valle , Jean-Christophe Pesquet

Computationally efficient surrogates for parametrized physical models play a crucial role in science and engineering. Operator learning provides data-driven surrogates that map between function spaces. However, instead of full-field…

Machine Learning · Computer Science 2024-12-31 Daniel Zhengyu Huang , Nicholas H. Nelsen , Margaret Trautner

The rapid growth of microcontroller-based IoT devices has opened up numerous applications, from smart manufacturing to personalized healthcare. Despite the widespread adoption of energy-efficient microcontroller units (MCUs) in the Tiny…

Machine Learning · Computer Science 2024-09-26 Giorgos Armeniakos , Georgios Mentzos , Dimitrios Soudris

Complex design problems are common in the scientific and industrial fields. In practice, objective functions or constraints of these problems often do not have explicit formulas, and can be estimated only at a set of sampling points through…

Optimization and Control · Mathematics 2022-10-12 Lulu Zhang , Zhi-Qin John Xu , Yaoyu Zhang