English
Related papers

Related papers: Diffeomorphic Measure Matching with Kernels for Ge…

200 papers

Sample reweighting is one of the most widely used methods for correcting the error of least squares learning algorithms in reproducing kernel Hilbert spaces (RKHS), that is caused by future data distributions that are different from the…

Machine Learning · Computer Science 2023-07-24 Duc Hoan Nguyen , Sergei V. Pereverzyev , Werner Zellinger

Energy-based models for discrete domains, such as graphs, explicitly capture relative likelihoods, naturally enabling composable probabilistic inference tasks like conditional generation or enforcing constraints at test-time. However,…

Recent studies utilize multiple kernel learning to deal with incomplete-data problem. In this study, we introduce new methods that do not only complete multiple incomplete kernel matrices simultaneously, but also allow control of the…

Machine Learning · Computer Science 2018-12-26 Rachelle Rivero , Tsuyoshi Kato

We present a novel kernel-based method for learning multivariate stochastic differential equations (SDEs). The method follows a two-step procedure: we first estimate the drift term function, then the (matrix-valued) diffusion function given…

Machine Learning · Statistics 2025-12-22 Michael L. Wells , Kamel Lahouel , Bruno Jedynak

The decoder-based machine learning generative algorithms such as Generative Adversarial Networks (GAN), Variational Auto-Encoders (VAE), Transformers show impressive results when constructing objects similar to those in a training ensemble.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Gabriel Turinici

Variational methods are widely used for approximate posterior inference. However, their use is typically limited to families of distributions that enjoy particular conjugacy properties. To circumvent this limitation, we propose a family of…

Machine Learning · Computer Science 2012-06-22 Samuel Gershman , Matt Hoffman , David Blei

We extend the herding algorithm to continuous spaces by using the kernel trick. The resulting "kernel herding" algorithm is an infinite memory deterministic process that learns to approximate a PDF with a collection of samples. We show that…

Machine Learning · Computer Science 2012-03-19 Yutian Chen , Max Welling , Alex Smola

When performing classification tasks, raw high dimensional features often contain redundant information, and lead to increased computational complexity and overfitting. In this paper, we assume the data samples lie on a single underlying…

Image and Video Processing · Electrical Eng. & Systems 2020-08-11 Bowen Jiang , Maohao Shen

A model for the prediction of functional time series is introduced, where observations are assumed to be continuous random functions. We model the dependence of the data with a nonstandard autoregressive structure, motivated in terms of the…

Methodology · Statistics 2018-07-03 Beatriz Bueno-Larraz , Johannes Klepsch

To generate data from trained diffusion models, most inference algorithms, such as DDPM, DDIM, and other variants, rely on discretizing the reverse SDEs or their equivalent ODEs. In this paper, we view such approaches as decomposing the…

Machine Learning · Statistics 2024-05-28 Xunpeng Huang , Difan Zou , Hanze Dong , Yi Zhang , Yi-An Ma , Tong Zhang

In this paper, we study the problem of learning dynamical properties of ensemble systems from their collective behaviors using statistical approaches in reproducing kernel Hilbert space (RKHS). Specifically, we provide a framework to…

Machine Learning · Computer Science 2022-03-24 Wei Miao , Gong Cheng , Jr-Shin Li

Random Forests and Gradient Boosting are among the most effective algorithms for supervised learning on tabular data. Both belong to the class of tree-based ensemble methods, where predictions are obtained by aggregating many randomized…

Machine Learning · Statistics 2025-12-02 Mehdi Dagdoug , Clement Dombry , Jean-Jil Duchamps

We propose a novel adaptive learning algorithm based on iterative orthogonal projections in the Cartesian product of multiple reproducing kernel Hilbert spaces (RKHSs). The task is estimating/tracking nonlinear functions which are supposed…

Machine Learning · Computer Science 2015-10-28 Masahiro Yukawa

This paper proposes a new framework and algorithms to address the problem of diffeomorphic registration on a general class of geometric objects that can be described as discrete distributions of local direction vectors. It builds on both…

Optimization and Control · Mathematics 2018-02-15 Hsi-Wei Hsieh , Nicolas Charon

Kernel methods offer the flexibility to learn complex relationships in modern, large data sets while enjoying strong theoretical guarantees on quality. Unfortunately, these methods typically require cubic running time in the data set size,…

Machine Learning · Statistics 2019-03-01 Raj Agrawal , Trevor Campbell , Jonathan H. Huggins , Tamara Broderick

We propose a novel procedure which adds "content-addressability" to any given unconditional implicit model e.g., a generative adversarial network (GAN). The procedure allows users to control the generative process by specifying a set…

Machine Learning · Computer Science 2019-05-16 Wittawat Jitkrittum , Patsorn Sangkloy , Muhammad Waleed Gondal , Amit Raj , James Hays , Bernhard Schölkopf

Kernel methods are powerful tools in machine learning. Classical kernel methods are based on positive-definite kernels, which map data spaces into reproducing kernel Hilbert spaces (RKHS). For non-Euclidean data spaces, positive-definite…

Machine Learning · Computer Science 2024-07-31 Nathael Da Costa , Cyrus Mostajeran , Juan-Pablo Ortega , Salem Said

The success of kernel-based learning methods depend on the choice of kernel. Recently, kernel learning methods have been proposed that use data to select the most appropriate kernel, usually by combining a set of base kernels. We introduce…

Machine Learning · Computer Science 2011-12-21 Arash Afkanpour , Csaba Szepesvari , Michael Bowling

In this paper we investigate the problem of estimating the regression function in models with correlated observations. The data is obtained from several experimental units each of them forms a time series. We propose a new estimator based…

Statistics Theory · Mathematics 2019-06-13 Djihad Benelmadani , Karim Benhenni , Sana Louhichi

We propose a novel approach to model selection for simulator-based statistical models. The proposed approach defines a mixture of candidate models, and then iteratively updates the weight coefficients for those models as well as the…

Machine Learning · Statistics 2019-02-08 Takafumi Kajihara , Motonobu Kanagawa , Yuuki Nakaguchi , Kanishka Khandelwal , Kenji Fukumiziu