English
Related papers

Related papers: Reproducing Kernels and New Approaches in Composit…

200 papers

This short technical report presents some learning theory results on vector-valued reproducing kernel Hilbert space (RKHS) regression, where the input space is allowed to be non-compact and the output space is a (possibly…

Machine Learning · Statistics 2022-02-17 Junhyunng Park , Krikamol Muandet

This paper develops a frequentist solution to the functional calibration problem, where the value of a calibration parameter in a computer model is allowed to vary with the value of control variables in the physical system. The need of…

Methodology · Statistics 2021-07-20 Rui Tuo , Shiyuan He , Arash Pourhabib , Yu Ding , Jianhua Z. Huang

A model for the prediction of functional time series is introduced, where observations are assumed to be continuous random functions. We model the dependence of the data with a nonstandard autoregressive structure, motivated in terms of the…

Methodology · Statistics 2018-07-03 Beatriz Bueno-Larraz , Johannes Klepsch

We present several generative and predictive algorithms based on the RKHS (reproducing kernel Hilbert spaces) methodology, which, most importantly, are scale up efficiently with large datasets or high-dimensional data. It is well recognized…

Numerical Analysis · Mathematics 2024-12-12 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov

This work presents a nonparametric framework for dissipativity learning in reproducing kernel Hilbert spaces, which enables data-driven certification of stability and performance properties for unknown nonlinear systems without requiring an…

Systems and Control · Electrical Eng. & Systems 2025-11-03 Xiuzhen Ye , Wentao Tang

In Magnetic Resonance Imaging (MRI) data samples are collected in the spatial frequency domain (k-space), typically by time-consuming line-by-line scanning on a Cartesian grid. Scans can be accelerated by simultaneous acquisition of data…

Medical Physics · Physics 2015-03-24 Vivek Athalye , Michael Lustig , Martin Uecker

We present a geometric framework for regression on structured high-dimensional data that shifts the analysis from the ambient space to a geometric object capturing the data's intrinsic structure. The method addresses a fundamental challenge…

Methodology · Statistics 2025-11-07 Pawel Gajer , Jacques Ravel

Despite its importance, choosing the structural form of the kernel in nonparametric regression remains a black art. We define a space of kernel structures which are built compositionally by adding and multiplying a small number of base…

Machine Learning · Statistics 2013-05-15 David Duvenaud , James Robert Lloyd , Roger Grosse , Joshua B. Tenenbaum , Zoubin Ghahramani

Reconstruction of a function from noisy data is often formulated as a regularized optimization problem over an infinite-dimensional reproducing kernel Hilbert space (RKHS). The solution describes the observed data and has a small RKHS norm.…

Machine Learning · Statistics 2013-07-18 Aleksandr Y. Aravkin , Bradley M. Bell , James V. Burke , Gianluigi Pillonetto

A Hilbert space embedding for probability measures has recently been proposed, with applications including dimensionality reduction, homogeneity testing, and independence testing. This embedding represents any probability measure as a mean…

In this paper, we consider the reproducing property in Reproducing Kernel Hilbert Spaces (RKHS). We establish a reproducing property for the closure of the class of combinations of composition operators under minimal conditions. This allows…

Statistics Theory · Mathematics 2025-04-01 Fatima-Zahrae El-Boukkouri , Josselin Garnier , Olivier Roustant

This paper investigates a general regularization framework for unsupervised domain adaptation in vector-valued regression under the covariate shift assumption, utilizing vector-valued reproducing kernel Hilbert spaces (vRKHS). Covariate…

Statistics Theory · Mathematics 2026-01-30 Markus Holzleitner , Sergiy Pereverzyev , Sergei V. Pereverzyev , Vaibhav Silmana , S. Sivananthan

With the emergence of passive and active optical sensors available for geospatial imaging, information fusion across sensors is becoming ever more important. An important aspect of single (or multiple) sensor geospatial image analysis is…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Saurabh Prasad , Minshan Cui , Lifeng Yan

We merge computational mechanics' definition of causal states (predictively-equivalent histories) with reproducing-kernel Hilbert space (RKHS) representation inference. The result is a widely-applicable method that infers causal structure…

Machine Learning · Computer Science 2024-06-19 Nicolas Brodu , James P. Crutchfield

We consider the problem of learning a set from random samples. We show how relevant geometric and topological properties of a set can be studied analytically using concepts from the theory of reproducing kernel Hilbert spaces. A new kind of…

Machine Learning · Statistics 2014-11-26 Ernesto De Vito , Lorenzo Rosasco , Alessandro Toigo

Hierarchical data pervades diverse machine learning applications, including natural language processing, computer vision, and social network analysis. Hyperbolic space, characterized by its negative curvature, has demonstrated strong…

Artificial Intelligence · Computer Science 2026-03-13 Leping Si , Meimei Yang , Hui Xue , Shipeng Zhu , Pengfei Fang

Compositional data sets are ubiquitous in science, including geology, ecology, and microbiology. In microbiome research, compositional data primarily arise from high-throughput sequence-based profiling experiments. These data comprise…

Statistics Theory · Mathematics 2019-03-05 Patrick L. Combettes , Christian L. Müller

Reproducing kernel Hilbert spaces (RKHSs) play an important role in many statistics and machine learning applications ranging from support vector machines to Gaussian processes and kernel embeddings of distributions. Operators acting on…

Functional Analysis · Mathematics 2021-04-06 Mattes Mollenhauer , Ingmar Schuster , Stefan Klus , Christof Schütte

Statistical machine learning plays an important role in modern statistics and computer science. One main goal of statistical machine learning is to provide universally consistent algorithms, i.e., the estimator converges in probability or…

Machine Learning · Statistics 2016-04-18 Andreas Christmann , Florian Dumpert , Dao-Hong Xiang

The fields of signal processing and information theory have evolved with the goal of developing formulations to extract intrinsic information from limited amount of data. When one considers the modeling of unpredictably varying processes…

Signal Processing · Electrical Eng. & Systems 2019-05-07 Rishabh Singh , Jose C. Principe