English
Related papers

Related papers: Kernel Neural Operators (KNOs) for Scalable, Memor…

200 papers

In this paper we introduce the deep kernelized autoencoder, a neural network model that allows an explicit approximation of (i) the mapping from an input space to an arbitrary, user-specified kernel space and (ii) the back-projection from…

Machine Learning · Statistics 2017-02-09 Michael Kampffmeyer , Sigurd Løkse , Filippo Maria Bianchi , Robert Jenssen , Lorenzo Livi

The design of neural architectures for structured objects is typically guided by experimental insights rather than a formal process. In this work, we appeal to kernels over combinatorial structures, such as sequences and graphs, to derive…

Neural and Evolutionary Computing · Computer Science 2017-10-31 Tao Lei , Wengong Jin , Regina Barzilay , Tommi Jaakkola

This work introduces a neural operator based surrogate modeling framework for neutron transport computation. Two architectures, the Deep Operator Network (DeepONet) and the Fourier Neural Operator (FNO), were trained for fixed source…

Computational Physics · Physics 2026-02-19 Md Hossain Sahadath , Qiyun Cheng , Shaowu Pan , Wei Ji

Accurate prediction of machining deformation in structural components is essential for ensuring dimensional precision and reliability. Such deformation often originates from residual stress fields, whose distribution and influence vary…

Machine Learning · Computer Science 2025-09-17 Changqing Liu , Kaining Dai , Zhiwei Zhao , Tianyi Wu , Yingguang Li

The K-means algorithm is among the most commonly used data clustering methods. However, the regular K-means can only be applied in the input space and it is applicable when clusters are linearly separable. The kernel K-means, which extends…

Machine Learning · Computer Science 2020-12-08 Amir Aradnia , Maryam Amir Haeri , Mohammad Mehdi Ebadzadeh

Neural operator learning methods have garnered significant attention in scientific computing for their ability to approximate infinite-dimensional operators. However, increasing their complexity often fails to substantially improve their…

Operator learning refers to the application of ideas from machine learning to approximate (typically nonlinear) operators mapping between Banach spaces of functions. Such operators often arise from physical models expressed in terms of…

Machine Learning · Computer Science 2024-02-27 Nikola B. Kovachki , Samuel Lanthaler , Andrew M. Stuart

Deep learning surrogate models have shown promise in solving partial differential equations (PDEs). Among them, the Fourier neural operator (FNO) achieves good accuracy, and is significantly faster compared to numerical solvers, on a…

Machine Learning · Computer Science 2024-05-03 Zongyi Li , Daniel Zhengyu Huang , Burigede Liu , Anima Anandkumar

Recently, Nystr\"{o}m method has proved its prominence empirically and theoretically in speeding up the training of kernel machines while retaining satisfactory performances and accuracy. So far, there are several different approaches…

Machine Learning · Computer Science 2021-09-21 Weida Li , Mingxia Liu , Daoqiang Zhang

The effectiveness of deep neural architectures has been widely supported in terms of both experimental and foundational principles. There is also clear evidence that the activation function (e.g. the rectifier and the LSTM units) plays a…

Machine Learning · Computer Science 2018-10-08 Giuseppe Marra , Dario Zanca , Alessandro Betti , Marco Gori

Designing universal artificial intelligence (AI) solver for partial differential equations (PDEs) is an open-ended problem and a significant challenge in science and engineering. Currently, data-driven solvers have achieved great success,…

Machine Learning · Computer Science 2025-02-24 Qinglong Ma , Peizhi Zhao , Sen Wang , Tao Song

Solving Singularly Perturbed Differential Equations (SPDEs) poses computational challenges arising from the rapid transitions in their solutions within thin regions. The effectiveness of deep learning in addressing differential equations…

Machine Learning · Computer Science 2024-09-10 Ye Li , Ting Du , Yiwen Pang , Zhongyi Huang

In scientific and engineering applications, solving partial differential equations (PDEs) across various parameters and domains normally relies on resource-intensive numerical methods. Neural operators based on deep learning offered a…

Numerical Analysis · Mathematics 2024-06-21 Zhiwei Zhao , Changqing Liu , Yingguang Li , Zhibin Chen , Xu Liu

Classical neural networks are known for their ability to approximate mappings between finite-dimensional spaces, but they fall short in capturing complex operator dynamics across infinite-dimensional function spaces. Neural operators, in…

Neural and Evolutionary Computing · Computer Science 2025-12-11 Bo Zhang

This paper proposes a physics-informed neural operator (PINO) framework for solving inverse scattering problems, enabling rapid and accurate reconstructions under diverse measurement conditions. In the proposed approach, the dielectric…

Computational Physics · Physics 2026-03-27 Q. C. Dong , Zi-Xuan Su , Qing Huo Liu , Wen Chen , Zhizhang , Chen

The computational complexity of kernel methods has often been a major barrier for applying them to large-scale learning problems. We argue that this barrier can be effectively overcome. In particular, we develop methods to scale up kernel…

We introduce the Z-Domain Neural Operator (ZNO), a causal neural operator whose layers are stable low-rank multiple-input multiple-output (MIMO) rational filters parameterized directly in the $z$-plane. ZNO addresses a limitation of…

Machine Learning · Computer Science 2026-05-07 Xianli Zhu , Jia Yin

Many physical systems exhibit nonlocal spatiotemporal behaviors described by integro-differential equations (IDEs). Classical methods for solving IDEs require repeatedly evaluating convolution integrals, whose cost increases quickly with…

Machine Learning · Computer Science 2025-12-22 Farinaz Mostajeran , Aruzhan Tleubek , Salah A Faroughi

Any applied mathematical model contains parameters. The paper proposes to use kernel learning for the parametric analysis of the model. The approach consists in setting a distribution on the parameter space, obtaining a finite training…

Optimization and Control · Mathematics 2025-01-27 Vladimir Norkin , Alois Pichler

By learning the mappings between infinite function spaces using carefully designed neural networks, the operator learning methodology has exhibited significantly more efficiency than traditional methods in solving complex problems such as…

Numerical Analysis · Mathematics 2023-03-06 Ziyuan Liu , Haifeng Wang , Hong Zhang , Kaijuna Bao , Xu Qian , Songhe Song