English
Related papers

Related papers: Shorting Dynamics and Structured Kernel Regulariza…

200 papers

The composition operators preserving total non-negativity and total positivity for various classes of kernels are classified, following three themes. Letting a function act by post composition on kernels with arbitrary domains, it is shown…

Functional Analysis · Mathematics 2023-09-27 Alexander Belton , Dominique Guillot , Apoorva Khare , Mihai Putinar

Kernel segmentation aims at partitioning a data sequence into several non-overlapping segments that may have nonlinear and complex structures. In general, it is formulated as a discrete optimization problem with combinatorial constraints. A…

Machine Learning · Computer Science 2022-06-23 Tung Doan , Atsuhiro Takasu

This paper considers the design of nonlinear data-enabled predictive control (DeePC) using kernel functions. Compared with existing methods that use kernels to parameterize multi-step predictors for nonlinear DeePC, we adopt a novel,…

Optimization and Control · Mathematics 2025-01-30 Thomas de Jong , Siep Weiland , Mircea Lazar

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

Regularity estimates for an integral operator with a symmetric continuous kernel on a convex bounded domain are derived. The covariance of a mean-square continuous random field on the domain is an example of such an operator. The estimates…

Probability · Mathematics 2022-04-25 Mihály Kovács , Annika Lang , Andreas Petersson

This manuscript presents an algorithm for obtaining an approximation of a nonlinear high order control affine dynamical system. Controlled trajectories of the system are leveraged as the central unit of information via embedding them in…

Optimization and Control · Mathematics 2026-01-23 Moad Abudia , Tejasvi Channagiri , Joel A. Rosenfeld , Rushikesh Kamalapurkar

This paper derives predictive reduced-order models for rocket engine combustion dynamics via Operator Inference, a scientific machine learning approach that blends data-driven learning with physics-based modeling. The non-intrusive nature…

Computational Engineering, Finance, and Science · Computer Science 2021-10-19 Shane A. McQuarrie , Cheng Huang , Karen E. Willcox

This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate shifts. By a…

Machine Learning · Statistics 2024-06-06 Yihang Chen , Fanghui Liu , Taiji Suzuki , Volkan Cevher

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

Transfer operators such as the Perron--Frobenius or Koopman operator play an important role in the global analysis of complex dynamical systems. The eigenfunctions of these operators can be used to detect metastable sets, to project the…

Dynamical Systems · Mathematics 2019-12-02 Stefan Klus , Ingmar Schuster , Krikamol Muandet

Nonlinear dynamical systems with symmetries exhibit a rich variety of behaviors, including complex attractor-basin portraits and enhanced and suppressed bifurcations. Symmetry arguments provide a way to study these collective behaviors and…

Dynamical Systems · Mathematics 2019-10-23 Anastasiya Salova , Jeffrey Emenheiser , Adam Rupe , James P. Crutchfield , Raissa M. D'Souza

In this paper, sparsification techniques aided online prediction algorithms in a reproducing kernel Hilbert space are studied for nonstationary time series. The online prediction algorithms as usual consist of the selection of kernel…

Signal Processing · Electrical Eng. & Systems 2022-05-13 Jinhua Guo , Hao Chen , Jingxin Zhang , Sheng Chen

This paper studies the construction of a refinement kernel for a given operator-valued reproducing kernel such that the vector-valued reproducing kernel Hilbert space of the refinement kernel contains that of the given one as a subspace.…

Machine Learning · Computer Science 2011-02-08 Yuesheng Xu , Haizhang Zhang , Qinghui Zhang

The kernel trick concept, formulated as an inner product in a feature space, facilitates powerful extensions to many well-known algorithms. While the kernel matrix involves inner products in the feature space, the sample covariance matrix…

Computation · Statistics 2017-07-20 Tomer Lancewicki

Data-driven control algorithms use observations of system dynamics to construct an implicit model for the purpose of control. However, in practice, data-driven techniques often require excessive sample sizes, which may be infeasible in…

Systems and Control · Electrical Eng. & Systems 2023-01-10 Adam J. Thorpe , Cyrus Neary , Franck Djeumou , Meeko M. K. Oishi , Ufuk Topcu

In this paper, we illustrate the effectiveness of reproducing kernel Hilbert space techniques in the study of composition operators. For weighted Hardy spaces on the unit disk, we characterize the composition operators whose adjoint is…

Functional Analysis · Mathematics 2026-01-28 Preeti Kumari , P. Muthukumar , Antti Rasila

Previous analysis of regularized functional linear regression in a reproducing kernel Hilbert space (RKHS) typically requires the target function to be contained in this kernel space. This paper studies the convergence performance of…

Machine Learning · Statistics 2024-02-20 Jiading Liu , Lei Shi

This manuscript is aimed at addressing several long standing limitations of dynamic mode decompositions in the application of Koopman analysis. Principle among these limitations are the convergence of associated Dynamic Mode Decomposition…

Systems and Control · Electrical Eng. & Systems 2021-06-15 Joel A. Rosenfeld , Rushikesh Kamalapurkar

We study the stability properties of nonlinear multi-task regression in reproducing Hilbert spaces with operator-valued kernels. Such kernels, a.k.a. multi-task kernels, are appropriate for learning prob- lems with nonscalar outputs like…

Machine Learning · Computer Science 2013-06-18 Julien Audiffren , Hachem Kadri

It is by now well-established that modern over-parameterized models seem to elude the bias-variance tradeoff and generalize well despite overfitting noise. Many recent works attempt to analyze this phenomenon in the relatively tractable…

Machine Learning · Computer Science 2024-02-21 Daniel Barzilai , Ohad Shamir