English
Related papers

Related papers: Hilbert Space Embeddings of Predictive State Repre…

200 papers

Symmetric functions, which take as input an unordered, fixed-size set, are known to be universally representable by neural networks that enforce permutation invariance. These architectures only give guarantees for fixed input sizes, yet in…

Machine Learning · Computer Science 2022-10-11 Aaron Zweig , Joan Bruna

We propose Continuous Scene Representations (CSR), a scene representation constructed by an embodied agent navigating within a space, where objects and their relationships are modeled by continuous valued embeddings. Our method captures…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Samir Yitzhak Gadre , Kiana Ehsani , Shuran Song , Roozbeh Mottaghi

The spectral density function describes the second-order properties of a stationary stochastic process on $\mathbb{R}^d$. This paper considers the nonparametric estimation of the spectral density of a continuous-time stochastic process…

Statistics Theory · Mathematics 2023-02-07 Rafail Kartsioukas , Stilian Stoev , Tailen Hsing

We argue and demonstrate that projected entangled-pair states (PEPS) outperform matrix product states significantly for the task of generative modeling of datasets with an intrinsic two-dimensional structure such as images. Our approach…

Quantum Physics · Physics 2022-02-17 Tom Vieijra , Laurens Vanderstraeten , Frank Verstraete

We consider a class of statistical inverse problems involving the estimation of a regression operator from a Polish space to a separable Hilbert space, where the target lies in a vector-valued reproducing kernel Hilbert space induced by an…

Machine Learning · Statistics 2026-04-28 Jia-Qi Yang , Lei Shi

We present a general framework to learn functions in tensor product reproducing kernel Hilbert spaces (TP-RKHSs). The methodology is based on a novel representer theorem suitable for existing as well as new spectral penalties for tensors.…

Machine Learning · Computer Science 2013-10-21 Marco Signoretto , Lieven De Lathauwer , Johan A. K. Suykens

We provide a functional view of distributional robustness motivated by robust statistics and functional analysis. This results in two practical computational approaches for approximate distributionally robust nonlinear optimization based on…

Systems and Control · Electrical Eng. & Systems 2021-10-27 Yassine Nemmour , Bernhard Schölkopf , Jia-Jie Zhu

Despite the fundamental nature of the inhomogeneous Poisson process in the theory and application of stochastic processes, and its attractive generalizations (e.g. Cox process), few tractable nonparametric modeling approaches of intensity…

Machine Learning · Statistics 2017-06-27 Seth Flaxman , Yee Whye Teh , Dino Sejdinovic

Symmetries impose structure on the Hilbert space of a quantum mechanical model. The mathematical units of this structure are the irreducible representations of symmetry groups and I consider how they function as conceptual units of…

Quantum Physics · Physics 2018-01-29 N. L. Harshman

Motivated by the need of processing functional-valued data, or more general, operatorvalued data, we introduce the notion of the operator reproducing kernel Hilbert space (ORKHS). This space admits a unique operator reproducing kernel which…

Functional Analysis · Mathematics 2016-10-23 Rui Wang , Yuesheng Xu

Regularized kernel methods such as support vector machines (SVM) and support vector regression (SVR) constitute a broad and flexible class of methods which are theoretically well investigated and commonly used in nonparametric…

Methodology · Statistics 2013-05-07 Robert Hable

Not having access to compact and meaningful representations is known to significantly increase the complexity of reinforcement learning (RL). For this reason, it can be useful to perform state representation learning (SRL) before tackling…

Machine Learning · Computer Science 2022-02-16 Astrid Merckling , Nicolas Perrin-Gilbert , Alex Coninx , Stéphane Doncieux

We present a data-driven algorithm for efficiently computing stochastic control policies for general joint chance constrained optimal control problems. Our approach leverages the theory of kernel distribution embeddings, which allows…

Systems and Control · Electrical Eng. & Systems 2022-02-10 Adam J. Thorpe , Thomas Lew , Meeko M. K. Oishi , Marco Pavone

This work introduces Physics-informed State-space neural network Models (PSMs), a novel solution to achieving real-time optimization, flexibility, and fault tolerance in autonomous systems, particularly in transport-dominated systems such…

Machine Learning · Computer Science 2024-08-21 Akshay J. Dave , Richard B. Vilim

In this work, we consider the problem of learning nonlinear operators that correspond to discrete-time nonlinear dynamical systems with inputs. Given an initial state and a finite input trajectory, such operators yield a finite output…

Optimization and Control · Mathematics 2024-12-25 Mircea Lazar

Symbolic Regression (SR) algorithms attempt to learn analytic expressions which fit data accurately and in a highly interpretable manner. Conventional SR suffers from two fundamental issues which we address here. First, these methods search…

Cosmology and Nongalactic Astrophysics · Physics 2024-08-05 Deaglan J. Bartlett , Harry Desmond , Pedro G. Ferreira

Pre-trained transformer models shine in many natural language processing tasks and therefore are expected to bear the representation of the input sentence or text meaning. These sentence-level embeddings are also important in…

Computation and Language · Computer Science 2025-02-21 Lukas Stankevičius , Mantas Lukoševičius

Reproducing kernel Hilbert spaces (RKHSs) are special Hilbert spaces where all the evaluation functionals are linear and bounded. They are in one-to-one correspondence with positive definite maps called kernels. Stable RKHSs enjoy the…

Systems and Control · Electrical Eng. & Systems 2023-05-04 Mauro Bisiacco , Gianluigi Pillonetto

Spectral embedding is a procedure which can be used to obtain vector representations of the nodes of a graph. This paper proposes a generalisation of the latent position network model known as the random dot product graph, to allow…

Machine Learning · Statistics 2021-11-17 Patrick Rubin-Delanchy , Joshua Cape , Minh Tang , Carey E. Priebe

Nonlinearities in piezoelectric systems can arise from internal factors such as nonlinear constitutive laws or external factors like realizations of boundary conditions. It can be difficult or even impossible to derive detailed models from…

Optimization and Control · Mathematics 2020-04-14 Sai Tej Paruchuri , Jia Guo , Andrew J. Kurdila