English
Related papers

Related papers: Kernel Embedding based Variational Approach for Lo…

200 papers

We introduce a new scalable variational Gaussian process approximation which provides a high fidelity approximation while retaining general applicability. We propose the harmonic kernel decomposition (HKD), which uses Fourier series to…

Machine Learning · Computer Science 2021-06-14 Shengyang Sun , Jiaxin Shi , Andrew Gordon Wilson , Roger Grosse

Transfer and Koopman operator methods offer a framework for representing complex, nonlinear dynamical systems via linear transformations, enabling a deeper understanding of the underlying dynamics. The spectra of these operators provide…

Dynamical Systems · Mathematics 2026-03-25 Gary Froyland , Kevin Kühl

Variational methods are widely used for approximate posterior inference. However, their use is typically limited to families of distributions that enjoy particular conjugacy properties. To circumvent this limitation, we propose a family of…

Machine Learning · Computer Science 2012-06-22 Samuel Gershman , Matt Hoffman , David Blei

The dynamics of physical systems that require high-dimensional representation can often be captured in a few meaningful degrees of freedom called collective variables (CVs). However, identifying CVs is challenging and constitutes a…

Chemical Physics · Physics 2024-04-03 Jakub Rydzewski

With their high energy efficiency, processing-in-memory (PIM) arrays are increasingly used for convolutional neural network (CNN) inference. In PIM-based CNN inference, the computational latency and energy are dependent on how the CNN…

Machine Learning · Computer Science 2021-12-22 Johnny Rhe , Sungmin Moon , Jong Hwan Ko

Visual SLAM in dynamic environments remains challenging, as several existing methods rely on semantic filtering that only handles known object classes, or use fixed robust kernels that cannot adapt to unknown moving objects, leading to…

Robotics · Computer Science 2025-10-21 João Carlos Virgolino Soares , Gabriel Fischer Abati , Claudio Semini

Human action recognition from skeletal data is a hot research topic and important in many open domain applications of computer vision, thanks to recently introduced 3D sensors. In the literature, naive methods simply transfer off-the-shelf…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Jacopo Cavazza , Pietro Morerio , Vittorio Murino

This paper presents a novel framework for visual object recognition using infinite-dimensional covariance operators of input features in the paradigm of kernel methods on infinite-dimensional Riemannian manifolds. Our formulation provides…

Computer Vision and Pattern Recognition · Computer Science 2016-09-30 Hà Quang Minh , Marco San Biagio , Loris Bazzani , Vittorio Murino

Koopman analysis of a general dynamics system provides a linear Koopman operator and an embedded eigenfunction space, enabling the application of standard techniques from linear analysis. However, in practice, deriving exact operators and…

Systems and Control · Electrical Eng. & Systems 2025-04-29 Alexander Estornell , Leonard Jung , Alenna Spiro , Mario Sznaier , Michael Everett

Unsupervised learning with functional data is an emerging paradigm of machine learning research with applications to computer vision, climate modeling and physical systems. A natural way of modeling functional data is by learning operators…

Machine Learning · Computer Science 2023-02-22 Jacob H. Seidman , Georgios Kissas , George J. Pappas , Paris Perdikaris

Kernel analog forecasting (KAF), alternatively known as kernel principal component regression, is a kernel method used for nonparametric statistical forecasting of dynamically generated time series data. This paper synthesizes descriptions…

Statistics Theory · Mathematics 2020-06-24 Romeo Alexander , Dimitrios Giannakis

Inference and simulation in the context of high-dimensional dynamical systems remain computationally challenging problems. Some form of dimensionality reduction is required to make the problem tractable in general. In this paper, we propose…

Machine Learning · Statistics 2024-01-04 Jonathan Schmidt , Philipp Hennig , Jörg Nick , Filip Tronarp

Existing architectures for operator learning require that the number and locations of sensors (where the input functions are evaluated) remain the same across all training and test samples, significantly restricting the range of their…

Machine Learning · Computer Science 2022-05-24 Michael Prasthofer , Tim De Ryck , Siddhartha Mishra

The Koopman and Perron Frobenius transport operators are fundamentally changing how we approach dynamical systems, providing linear representations for even strongly nonlinear dynamics. Although there is tremendous potential benefit of such…

Dynamical Systems · Mathematics 2019-02-28 Eurika Kaiser , J. Nathan Kutz , Steven L. Brunton

The accuracy of Koopman operator approximations over finite-dimensional spaces relies critically on their invariance properties. These can be rigorously quantified via the principal angles between a candidate subspace and its image under…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Dhruv Shah , Jorge Cortés

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh

We propose a variational scheme to represent composite quantum systems using multiple parameterized functions of varying accuracies on both classical and quantum hardware. The approach follows the variational principle over the entire…

Quantum Physics · Physics 2024-06-21 Stefano Barison , Filippo Vicentini , Giuseppe Carleo

Vector approximate message passing (VAMP) is an efficient approximate inference algorithm used for generalized linear models. Although VAMP exhibits excellent performance, particularly when measurement matrices are sampled from rotationally…

Information Theory · Computer Science 2025-08-05 Takashi Takahashi , Yoshiyuki Kabashima

We present a new framework for optimal and feedback control of PDEs using Koopman operator-based reduced order models (K-ROMs). The Koopman operator is a linear but infinite-dimensional operator which describes the dynamics of observables.…

Dynamical Systems · Mathematics 2019-08-14 Sebastian Peitz , Stefan Klus

Identifying coherent spatiotemporal patterns generated by complex dynamical systems is a central problem in many science and engineering disciplines. Here, we combine ideas from the theory of operator-valued kernels with delay-embedding…

Data Analysis, Statistics and Probability · Physics 2018-05-24 Dimitrios Giannakis , Joanna Slawinska , Abbas Ourmazd , Zhizhen Zhao