English
Related papers

Related papers: Characteristic Kernels and Infinitely Divisible Di…

200 papers

When solving data analysis problems it is important to integrate prior knowledge and/or structural invariances. This paper contributes by a novel framework for incorporating algebraic invariance structure into kernels. In particular, we…

Machine Learning · Statistics 2014-12-01 Franz J. Király , Andreas Ziehe , Klaus-Robert Müller

When analyzing modern machine learning algorithms, we may need to handle kernel density estimation (KDE) with intricate kernels that are not designed by the user and might even be irregular and asymmetric. To handle this emerging challenge,…

Statistics Theory · Mathematics 2021-06-09 Hau-Tieng Wu , Nan Wu

In this paper, we consider the nonparametric estimation of the multivariate probability density function and its partial derivative with a support on $[0,\infty)$. To this end we use the class of kernel estimators with asymmetric gamma…

Probability · Mathematics 2017-12-27 L. A. Markovich

In a general context of positive definite kernels $k$, we develop tools and algorithms for sampling in reproducing kernel Hilbert space $\mathscr{H}$ (RKHS). With reference to these RKHSs, our results allow inference from samples; more…

Functional Analysis · Mathematics 2016-01-28 Palle Jorgensen , Feng Tian

Convolutional neural networks have shown great success on feature extraction from raw input data such as images. Although convolutional neural networks are invariant to translations on the inputs, they are not invariant to other…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Hongyang Gao , Shuiwang Ji

We introduce a nonparametric way to estimate the global probability density function for a random persistence diagram. Precisely, a kernel density function centered at a given persistence diagram and a given bandwidth is constructed. Our…

Statistics Theory · Mathematics 2018-03-14 Joshua Lee Mike , Vasileios Maroulas

Bayesian inference and kernel methods are well established in machine learning. The neural network Gaussian process in particular provides a concept to investigate neural networks in the limit of infinitely wide hidden layers by using…

Disordered Systems and Neural Networks · Physics 2023-11-10 Javed Lindner , David Dahmen , Michael Krämer , Moritz Helias

Applying machine learning to biological sequences - DNA, RNA and protein - has enormous potential to advance human health, environmental sustainability, and fundamental biological understanding. However, many existing machine learning…

Machine Learning · Statistics 2023-04-11 Alan Nawzad Amin , Eli Nathan Weinstein , Debora Susan Marks

It has been hypothesized that quantum computers may lend themselves well to applications in machine learning. In the present work, we analyze function classes defined via quantum kernels. Quantum computers offer the possibility to…

Quantum Physics · Physics 2021-11-10 Jonas M. Kübler , Simon Buchholz , Bernhard Schölkopf

In many applications of machine learning, a large number of variables are considered. Motivated by machine learning of interacting particle systems, we consider the situation when the number of input variables goes to infinity. First, we…

Machine Learning · Computer Science 2023-10-30 Christian Fiedler , Michael Herty , Sebastian Trimpe

A novel strategy that combines a given collection of $\pi$-reversible Markov kernels is proposed. At each Markov transition, one of the available kernels is selected via a state-dependent probability distribution. In contrast to random-scan…

Methodology · Statistics 2022-03-30 Florian Maire , Pierre Vandekerkhove

Contrastive learning is an efficient approach to self-supervised representation learning. Although recent studies have made progress in the theoretical understanding of contrastive learning, the investigation of how to characterize the…

Machine Learning · Computer Science 2023-08-21 Hiroki Waida , Yuichiro Wada , Léo Andéol , Takumi Nakagawa , Yuhui Zhang , Takafumi Kanamori

Positive and negative dependence are fundamental concepts that characterize the attractive and repulsive behavior of random subsets. Although some probabilistic models are known to exhibit positive or negative dependence, it is challenging…

Machine Learning · Statistics 2025-02-11 Takahiro Kawashima , Hideitsu Hino

Inference in popular nonparametric Bayesian models typically relies on sampling or other approximations. This paper presents a general methodology for constructing novel tractable nonparametric Bayesian methods by applying the kernel trick…

Machine Learning · Statistics 2011-08-15 Ferenc Huszár , Simon Lacoste-Julien

The popular qubit framework has dominated recent work on quantum kernel machine learning, with results characterising expressivity, learnability and generalisation. As yet, there is no comparative framework to understand these concepts for…

Quantum Physics · Physics 2024-12-18 Laura J. Henderson , Rishi Goel , Sally Shrapnel

Group convolutional neural networks (G-CNNs) have been shown to increase parameter efficiency and model accuracy by incorporating geometric inductive biases. In this work, we investigate the properties of representations learned by regular…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 David M. Knigge , David W. Romero , Erik J. Bekkers

In this paper we focus on continuous univariate probability distributions, like McKay distributions, $K$-distribution, generalized inverse Gaussian distribution and generalised McKay distributions, with support $[0,\infty),$ which are…

Probability · Mathematics 2026-05-27 Árpád Baricz , Dhivya Prabhu K , Sanjeev Singh , Antony Vijesh

We provide a unifying framework linking two classes of statistics used in two-sample and independence testing: on the one hand, the energy distances and distance covariances from the statistics literature; on the other, distances between…

Machine Learning · Computer Science 2015-03-20 Dino Sejdinovic , Arthur Gretton , Bharath Sriperumbudur , Kenji Fukumizu

We study notions of robustness of Markov kernels and probability distribution of a system that is described by $n$ input random variables and one output random variable. Markov kernels can be expanded in a series of potentials that allow to…

Commutative Algebra · Mathematics 2011-10-07 Johannes Rauh , Nihat Ay

Deep kernel learning provides an elegant and principled framework for combining the structural properties of deep learning algorithms with the flexibility of kernel methods. By means of a deep neural network, we learn a parametrized kernel…

Machine Learning · Computer Science 2020-12-14 Prudencio Tossou , Basile Dura , Francois Laviolette , Mario Marchand , Alexandre Lacoste