English
Related papers

Related papers: Generalized Kernel-Based Dynamic Mode Decompositio…

200 papers

We develop an accelerated algorithm for computing an approximate eigenvalue decomposition of bistochastic normalized kernel matrices. Our approach constructs a low rank approximation of the original kernel matrix by the pivoted partial…

Numerical Analysis · Mathematics 2025-11-13 Chris Vales , Dimitrios Giannakis

In this paper we combine the theory of reproducing kernel Hilbert spaces with the field of collocation methods to solve boundary value problems with special emphasis on reproducing property of kernels. From the reproducing property of…

Numerical Analysis · Mathematics 2019-03-26 Babak Azarnavid , Mahdi Emamjome , Mohammad Nabati , Saeid Abbasbandy

In this paper, we present an efficient algorithm for solving a class of chance constrained optimization under non-parametric uncertainty. Our algorithm is built on the possibility of representing arbitrary distributions as functions in…

Robotics · Computer Science 2018-11-26 Bharath Gopalakrishnan , Arun Kumar Singh , K. Madhava Krishna , Dinesh Manocha

In this paper, we study two general classes of optimization algorithms for kernel methods with convex loss function and quadratic norm regularization, and analyze their convergence. The first approach, based on fixed-point iterations, is…

Machine Learning · Computer Science 2013-07-02 Francesco Dinuzzo

The Koopman operator is a mathematical tool that allows for a linear description of non-linear systems, but working in infinite dimensional spaces. Dynamic Mode Decomposition and Extended Dynamic Mode Decomposition are amongst the most…

Machine Learning · Computer Science 2021-03-26 Francesco Zanini , Alessandro Chiuso

This paper concerns the distributed training of nonlinear kernel machines on Map-Reduce. We show that a re-formulation of Nystr\"om approximation based solution which is solved using gradient based techniques is well suited for this,…

Machine Learning · Computer Science 2014-05-20 Dhruv Mahajan , S. Sathiya Keerthi , S. Sundararajan

We present several generative and predictive algorithms based on the RKHS (reproducing kernel Hilbert spaces) methodology, which, most importantly, are scale up efficiently with large datasets or high-dimensional data. It is well recognized…

Numerical Analysis · Mathematics 2024-12-12 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov

Much recent work has addressed the solution of a family of partial differential equations by computing the inverse operator map between the input and solution space. Toward this end, we incorporate function-valued reproducing kernel Hilbert…

Numerical Analysis · Mathematics 2022-04-05 Kaijun Bao , Xu Qian , Ziyuan Liu , Songhe Song

We show that sampling or interpolation formulas in reproducing kernel Hilbert spaces can be obtained by reproducing kernels whose dual systems form molecules, ensuring that the size profile of a function is fully reflected by the size…

Functional Analysis · Mathematics 2022-05-04 José Luis Romero , Jordy Timo van Velthoven , Felix Voigtlaender

In the context of kernel optimization, we prove a result that yields new factorizations and realizations. Our initial context is that of general positive operator-valued kernels. We further present implications for Hilbert space-valued…

Operator Algebras · Mathematics 2024-10-14 Palle E. T. Jorgensen , James Tian

Kernel-based methods in Numerical Analysis have the advantage of yielding optimal recovery processes in the "native" Hilbert space $\calh$ in which they are reproducing. Continuous kernels on compact domains have an expansion into…

Numerical Analysis · Mathematics 2018-10-09 Gabriele Santin , Robert Schaback

This paper presents a stochastic behavior analysis of a kernel-based stochastic restricted-gradient descent method. The restricted gradient gives a steepest ascent direction within the so-called dictionary subspace. The analysis provides…

Machine Learning · Computer Science 2014-10-15 Masa-aki Takizawa , Masahiro Yukawa , Cedric Richard

We focus on establishing the foundational paradigm of a novel optimization theory based on convolution with convex kernels. Our goal is to devise a morally deterministic model of locating the global optima of an arbitrary function, which is…

Optimization and Control · Mathematics 2025-03-31 Zhipeng Lu

In this paper, we discuss the convergence analysis of the conjugate gradient-based algorithm for the functional linear model in the reproducing kernel Hilbert space framework, utilizing early stopping results in regularization against…

Statistics Theory · Mathematics 2023-10-05 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

This paper presents reproducing kernel Hilbert spaces method to obtain the numerical solution for partial differential equation constrained optimization problem.

Optimization and Control · Mathematics 2016-11-09 Majid Darehmiraki

Simulating dynamics of open quantum systems is sometimes a significant challenge, despite the availability of various exact or approximate methods. Particularly when dealing with complex systems, the huge computational cost will largely…

Quantum Physics · Physics 2023-08-04 Wei Liu , Zi-Hao Chen , Yu Su , Yao Wang , Wenjie Dou

Several statistical approaches based on reproducing kernels have been proposed to detect abrupt changes arising in the full distribution of the observations and not only in the mean or variance. Some of these approaches enjoy good…

Statistics Theory · Mathematics 2017-10-13 Alain Celisse , Guillemette Marot , Morgane Pierre-Jean , Guillem Rigaill

We study kernel functions, and associated reproducing kernel Hilbert spaces $\mathscr{H}$ over infinite, discrete and countable sets $V$. Numerical analysis builds discrete models (e.g., finite element) for the purpose of finding…

Functional Analysis · Mathematics 2015-08-17 Palle Jorgensen , Feng Tian

In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability.…

Machine Learning · Computer Science 2015-08-31 Songlin Zhao

Mode decomposition is a prototypical pattern recognition problem that can be addressed from the (a priori distinct) perspectives of numerical approximation, statistical inference and deep learning. Could its analysis through these combined…

Machine Learning · Statistics 2020-08-07 Houman Owhadi , Clint Scovel , Gene Ryan Yoo