English
Related papers

Related papers: Numerically Efficient and Stable Algorithms for Ke…

200 papers

Acquiring labels are often costly, whereas unlabeled data are usually easy to obtain in modern machine learning applications. Semi-supervised learning provides a principled machine learning framework to address such situations, and has been…

Machine Learning · Computer Science 2017-04-07 Trung Le , Khanh Nguyen , Van Nguyen , Vu Nguyen , Dinh Phung

We introduce in this paper the mechanism of graph random features (GRFs). GRFs can be used to construct unbiased randomized estimators of several important kernels defined on graphs' nodes, in particular the regularized Laplacian kernel. As…

Machine Learning · Computer Science 2023-05-02 Krzysztof Choromanski

Topological data analysis offers a rich source of valuable information to study vision problems. Yet, so far we lack a theoretically sound connection to popular kernel-based learning techniques, such as kernel SVMs or kernel PCA. In this…

Machine Learning · Statistics 2014-12-24 Jan Reininghaus , Stefan Huber , Ulrich Bauer , Roland Kwitt

Non-parametric representations of dynamical systems based on the image of a Hankel matrix of data are extensively used for data-driven control. However, if samples of data are missing, obtaining such representations becomes a difficult…

Systems and Control · Electrical Eng. & Systems 2024-07-09 Mohammad Alsalti , Ivan Markovsky , Victor G. Lopez , Matthias A. Müller

Graph Neural Networks (GNNs) have emerged as powerful tools for learning representations from structured data. Despite their growing popularity and success across various applications, GNNs encounter several challenges that limit their…

Machine Learning · Computer Science 2026-02-03 Yassine Abbahaddou

Recently the use of neural networks has been introduced in the context of the signed particle formulation of quantum mechanics to rapidly and reliably compute the Wigner kernel of any provided potential. This new technique has introduced…

Computational Physics · Physics 2018-06-04 Jean Michel Sellier , Jacob Leygonie , Gaetan Marceau Caron

We consider the problem of developing interpretable and computationally efficient matrix decomposition methods for matrices whose entries have bounded support. Such matrices are found in large-scale DNA methylation studies and many other…

Machine Learning · Computer Science 2024-10-25 Anjali N. Albert , Patrick Flaherty , Aaron Schein

We derive a numerically stable method to compute an image representation of an unknown linear system only from data, leveraging a continuous-time version of Willems et al.'s fundamental lemma. To this end, we use derivatives approximated by…

Optimization and Control · Mathematics 2026-04-30 Amine Othmane , Philipp Schmitz , Karl Worthmann , Kathrin Flaßkamp

Graph convolutional neural networks (GCNNs) have emerged as powerful tools for analyzing graph-structured data, achieving remarkable success across diverse applications. However, the theoretical understanding of the stability of these…

Machine Learning · Computer Science 2025-10-28 Ning Zhang , Henry Kenlay , Li Zhang , Mihai Cucuringu , Xiaowen Dong

Algorithmic verification of realistic systems to satisfy safety and other temporal requirements has suffered from poor scalability of the employed formal approaches. To design systems with rigorous guarantees, many approaches still rely on…

Systems and Control · Electrical Eng. & Systems 2024-03-18 Oliver Schön , Zhengang Zhong , Sadegh Soudjani

Recent developments in system identification have brought attention to regularized kernel-based methods. This type of approach has been proven to compare favorably with classic parametric methods. However, current formulations are not…

Systems and Control · Computer Science 2016-11-25 Giulio Bottegal , Aleksandr Y. Aravkin , Håkan Hjalmarsson , Gianluigi Pillonetto

Many scientific computing problems can be reduced to Matrix-Matrix Multiplications (MMM), making the General Matrix Multiply (GEMM) kernels in the Basic Linear Algebra Subroutine (BLAS) of interest to the high-performance computing…

Hardware Architecture · Computer Science 2023-05-31 Louis Ledoux , Marc Casas

This work develops a distributed graph neural network (GNN) methodology for mesh-based modeling applications using a consistent neural message passing layer. As the name implies, the focus is on enabling scalable operations that satisfy…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-03 Shivam Barwey , Riccardo Balin , Bethany Lusch , Saumil Patel , Ramesh Balakrishnan , Pinaki Pal , Romit Maulik , Venkatram Vishwanath

In this paper, a class of high order numerical schemes is proposed to solve the nonlinear parabolic equations with variable coefficients. This method is based on our previous work [10] for convection-diffusion equations, which relies on a…

Numerical Analysis · Mathematics 2020-12-30 Kaipeng Wang , Andrew Christlieb , Yan Jiang , Mengping Zhang

Graph-based methods pervade the inference toolkits of numerous disciplines including sociology, biology, neuroscience, physics, chemistry, and engineering. A challenging problem encountered in this context pertains to determining the…

Machine Learning · Computer Science 2018-09-25 Daniel Romero , Vassilis N. Ioannidis , Georgios B. Giannakis

While kernel methods and Graph Neural Networks offer complementary strengths, integrating the two has posed challenges in efficiency and scalability. The Graph Neural Tangent Kernel provides a theoretical bridge by interpreting GNNs through…

Machine Learning · Computer Science 2025-07-17 Lin Wang , Shijie Wang , Sirui Huang , Qing Li

Support vector machines (SVMs) are special kernel based methods and belong to the most successful learning methods since more than a decade. SVMs can informally be described as a kind of regularized M-estimators for functions and have…

Machine Learning · Statistics 2010-07-26 Andreas Christmann , Robert Hable

Recurrent neural networks (RNNs) are a class of nonlinear dynamical systems often used to model sequence-to-sequence maps. RNNs have excellent expressive power but lack the stability or robustness guarantees that are necessary for many…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

We present a new paradigm for speeding up randomized computations of several frequently used functions in machine learning. In particular, our paradigm can be applied for improving computations of kernels based on random embeddings. Above…

Machine Learning · Statistics 2016-04-26 Krzysztof Choromanski , Francois Fagan

Stability of graph neural networks (GNNs) characterizes how GNNs react to graph perturbations and provides guarantees for architecture performance in noisy scenarios. This paper develops a self-regularized graph neural network (SR-GNN)…

Signal Processing · Electrical Eng. & Systems 2022-11-15 Zhan Gao , Elvin Isufi