English
Related papers

Related papers: Scalable Machine Learning Algorithms using Path Si…

200 papers

Recently, there has been an increased interest in the development of kernel methods for learning with sequential data. The signature kernel is a learning tool with potential to handle irregularly sampled, multivariate time series. In…

Analysis of PDEs · Mathematics 2021-09-30 Cristopher Salvi , Thomas Cass , James Foster , Terry Lyons , Weixin Yang

We provide an introduction to the topic of path signatures as means of feature extraction for machine learning from data streams. The article stresses the mathematical theory underlying the signature methodology, highlighting the conceptual…

Machine Learning · Computer Science 2025-06-03 Stephan Sturm

Inferring topological and geometrical information from data can offer an alternative perspective on machine learning problems. Methods from topological data analysis, e.g., persistent homology, enable us to obtain such information,…

Computer Vision and Pattern Recognition · Computer Science 2018-02-19 Christoph Hofer , Roland Kwitt , Marc Niethammer , Andreas Uhl

We bring the theory of rough paths to the study of non-parametric statistics on streamed data. We discuss the problem of regression where the input variable is a stream of information, and the dependent response is also (potentially) a…

Statistical Finance · Quantitative Finance 2016-03-23 Daniel Levin , Terry Lyons , Hao Ni

Signature kernels, inner products of path signatures, underpin several machine learning algorithms for multivariate time series analysis. For bounded variation paths, signature kernels were recently shown to solve a Goursat PDE. However,…

Machine Learning · Computer Science 2025-06-03 Maud Lemercier , Terry Lyons , Cristopher Salvi

Bayesian methods for learning Gaussian graphical models offer a principled framework for quantifying model uncertainty and incorporating prior knowledge. However, their scalability is constrained by the computational cost of jointly…

Methodology · Statistics 2025-08-28 Reza Mohammadi , Marit Schoonhoven , Lucas Vogels , S. Ilker Birbil

Path signatures have been proposed as a powerful representation of paths that efficiently captures the path's analytic and geometric characteristics, having useful algebraic properties including fast concatenation of paths through tensor…

Systems and Control · Electrical Eng. & Systems 2024-06-21 Motoya Ohnishi , Iretiayo Akinola , Jie Xu , Ajay Mandlekar , Fabio Ramos

Deep kernel learning combines the non-parametric flexibility of kernel methods with the inductive biases of deep learning architectures. We propose a novel deep kernel learning model and stochastic variational inference procedure which…

Machine Learning · Statistics 2016-11-03 Andrew Gordon Wilson , Zhiting Hu , Ruslan Salakhutdinov , Eric P. Xing

Neural forecasting of spatiotemporal time series drives both research and industrial innovation in several relevant application domains. Graph neural networks (GNNs) are often the core component of the forecasting architecture. However, in…

Machine Learning · Computer Science 2023-02-21 Andrea Cini , Ivan Marisca , Filippo Maria Bianchi , Cesare Alippi

Understanding protein dynamics are essential for deciphering protein functional mechanisms and developing molecular therapies. However, the complex high-dimensional dynamics and interatomic interactions of biological processes pose…

Quantitative Methods · Quantitative Biology 2025-05-15 Tiexin Qin , Mengxu Zhu , Chunyang Li , Terry Lyons , Hong Yan , Haoliang Li

Outstanding achievements of graph neural networks for spatiotemporal time series analysis show that relational constraints introduce an effective inductive bias into neural forecasting architectures. Often, however, the relational…

Machine Learning · Computer Science 2023-08-03 Andrea Cini , Daniele Zambon , Cesare Alippi

Message-passing based approaches form the default backbone of most learning architectures on graph-structured data. However, the rapid progress of modern deep learning architectures in other domains, particularly sequence modeling, raises…

Machine Learning · Computer Science 2026-05-13 Joël Mathys , Basil Rohner , Saku Peltonen , Roger Wattenhofer

Machine learning is increasingly targeting areas where input data cannot be accurately described by a single vector, but can be modeled instead using the more flexible concept of random vectors, namely probability measures or more simply…

Machine Learning · Statistics 2019-02-21 Gwendoline de Bie , Gabriel Peyré , Marco Cuturi

The signature kernel is a kernel between time series of arbitrary length and comes with strong theoretical guarantees from stochastic analysis. It has found applications in machine learning such as covariance functions for Gaussian…

Machine Learning · Statistics 2024-12-30 Csaba Tóth , Masaki Adachi , Michael A. Osborne , Harald Oberhauser

Many finance, physics, and engineering phenomena are modeled by continuous-time dynamical systems driven by highly irregular (stochastic) inputs. A powerful tool to perform time series analysis in this context is rooted in rough path theory…

Machine Learning · Computer Science 2023-04-27 Enea Monzio Compagnoni , Anna Scampicchio , Luca Biggio , Antonio Orvieto , Thomas Hofmann , Josef Teichmann

Building on the functional-analytic framework of operator-valued kernels and un-truncated signature kernels, we propose a scalable, provably convergent signature-based algorithm for a broad class of high-dimensional, path-dependent hedging…

Functional Analysis · Mathematics 2025-02-06 Nicola Muca Cirone , Cristopher Salvi

Graph neural networks (GNNs) have evolved into one of the most popular deep learning architectures. However, GNNs suffer from over-smoothing node information and, therefore, struggle to solve tasks where global graph properties are…

Machine Learning · Computer Science 2023-08-31 Bernhard Schäfl , Lukas Gruber , Johannes Brandstetter , Sepp Hochreiter

We present a theoretically grounded Gaussian process framework that leverages neural feature maps to construct expressive kernels. We show that the learned feature map can be interpreted as an optimal low-rank approximation to a Gram matrix…

Machine Learning · Statistics 2026-05-12 Anthony Stephenson

This article provides a concise overview of some of the recent advances in the application of rough path theory to machine learning. Controlled differential equations (CDEs) are discussed as the key mathematical model to describe the…

Machine Learning · Computer Science 2023-02-10 Adeline Fermanian , Terry Lyons , James Morrill , Cristopher Salvi

The proliferation of capable and efficient machine learning (ML) models marks one of the strongest methodological shifts in signal processing (SP) in its nearly 100-year history. ML models support the development of SP systems that…

Signal Processing · Electrical Eng. & Systems 2026-05-01 Daniel Waxman , Fernando Llorente , Petar M. Djurić