English
Related papers

Related papers: A Representer Theorem for Hawkes Processes via Pen…

200 papers

Estimating the dissipativity of nonlinear systems from empirical data is useful for the analysis and control of nonlinear systems, especially when an accurate model is unavailable. Based on a Koopman operator model of the nonlinear system…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Xiuzhen Ye , Wentao Tang

Over the last decade, kernel methods for nonlinear processing have successfully been used in the machine learning community. The primary mathematical tool employed in these methods is the notion of the Reproducing Kernel Hilbert Space.…

Machine Learning · Computer Science 2017-04-26 Pantelis Bouboulis , Sergios Theodoridis

We consider the random-design least-squares regression problem within the reproducing kernel Hilbert space (RKHS) framework. Given a stream of independent and identically distributed input/output data, we aim to learn a regression function…

Statistics Theory · Mathematics 2016-03-30 Aymeric Dieuleveut , Francis Bach

Hawkes Processes are a type of point process for modeling self-excitation, i.e., when the occurrence of an event makes future events more likely to occur. The corresponding self-triggering function of this type of process may be inferred…

Applications · Statistics 2018-06-01 Rafael Lima , Jaesik Choi

This paper proposes a method for constructing one-step prediction tubes for nonlinear systems using reproducing kernel Hilbert spaces. We approximate a bounded reproducing kernel Hilbert space (RKHS) hypothesis set by a finite-dimensional…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Jannis Lübsen , Annika Eichler

The necessary and sufficient conditions for existence of a generalized representer theorem are presented for learning Hilbert space-valued functions. Representer theorems involving explicit basis functions and Reproducing Kernels are a…

Machine Learning · Computer Science 2018-09-21 Sanket Diwale , Colin Jones

Sparsity of a learning solution is a desirable feature in machine learning. Certain reproducing kernel Banach spaces (RKBSs) are appropriate hypothesis spaces for sparse learning methods. The goal of this paper is to understand what kind of…

Functional Analysis · Mathematics 2024-03-08 Rui Wang , Yuesheng Xu , Mingsong Yan

The Hawkes process (HP) has been widely applied to modeling self-exciting events including neuron spikes, earthquakes and tweets. To avoid designing parametric triggering kernel and to be able to quantify the prediction confidence, the…

Machine Learning · Computer Science 2021-02-05 Rui Zhang , Christian Walder , Marian-Andrei Rizoiu

We merge computational mechanics' definition of causal states (predictively-equivalent histories) with reproducing-kernel Hilbert space (RKHS) representation inference. The result is a widely-applicable method that infers causal structure…

Machine Learning · Computer Science 2024-06-19 Nicolas Brodu , James P. Crutchfield

The Hawkes process models self-exciting event streams, requiring a strictly non-negative and stable stochastic intensity. Standard identification methods enforce these properties using non-negative causal bases, yielding conservative…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Xinhui Rong , Girish N. Nair

We consider a general regularised interpolation problem for learning a parameter vector from data. The well known representer theorem says that under certain conditions on the regulariser there exists a solution in the linear span of the…

Functional Analysis · Mathematics 2019-05-14 Kevin Schlegel

This paper presents two models of neural-networks and their training applicable to neural networks of arbitrary width, depth and topology, assuming only finite-energy neural activations; and a novel representor theory for neural networks in…

Machine Learning · Statistics 2024-05-27 Alistair Shilton , Sunil Gupta , Santu Rana , Svetha Venkatesh

This paper is devoted to establishing the full scaling limit theorems for multivariate Hawkes processes. Under some mild conditions on the exciting kernels, we develop a new way to prove that after a suitable time-spatial scaling, the…

Probability · Mathematics 2024-12-20 Wei Xu

The aim of this study is to present a good modernistic strategy for solving some well-known classes of Lane-Emden type singular differential equations. The proposed approach is based on the reproducing kernel Hilbert space (RKHS) and…

Large machine learning models achieve unprecedented performance on various tasks and have evolved as the go-to technique. However, deploying these compute and memory hungry models on resource constraint environments poses new challenges. In…

Machine Learning · Computer Science 2021-06-23 Zichang Liu , Benjamin Coleman , Anshumali Shrivastava

We study distributed learning with the least squares regularization scheme in a reproducing kernel Hilbert space (RKHS). By a divide-and-conquer approach, the algorithm partitions a data set into disjoint data subsets, applies the least…

Machine Learning · Computer Science 2017-03-14 Shao-Bo Lin , Xin Guo , Ding-Xuan Zhou

In this work, we develop and study an empirical projection operator scheme for solving nonparametric regression problems. This scheme is based on an approximate projection of the regression function over a suitable reproducing kernel…

Statistics Theory · Mathematics 2020-02-04 Bilel Bousselmi , Jean-François Dupuy , Abderrazek Karoui

The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential…

Optimization and Control · Mathematics 2020-07-14 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

We present a new framework for online Least Squares algorithms for nonlinear modeling in RKH spaces (RKHS). Instead of implicitly mapping the data to a RKHS (e.g., kernel trick), we map the data to a finite dimensional Euclidean space,…

Machine Learning · Computer Science 2016-06-14 Pantelis Bouboulis , Spyridon Pougkakiotis , Sergios Theodoridis

We propose a general framework for policy representation for reinforcement learning tasks. This framework involves finding a low-dimensional embedding of the policy on a reproducing kernel Hilbert space (RKHS). The usage of RKHS based…

Machine Learning · Computer Science 2020-10-16 Bogdan Mazoure , Thang Doan , Tianyu Li , Vladimir Makarenkov , Joelle Pineau , Doina Precup , Guillaume Rabusseau