English
Related papers

Related papers: D2KE: From Distance to Kernel and Embedding

200 papers

This paper proposes a consensus-based distributed nonlinear filter with kernel mean embedding (KME). This fills with gap of posterior density approximation with KME for distributed nonlinear dynamic systems. To approximate the posterior…

Systems and Control · Electrical Eng. & Systems 2023-12-05 Liping Guo , Jimin Wang , Yanlong Zhao , Ji-Feng Zhang

Optimal experimental design seeks to determine the most informative allocation of experiments to infer an unknown statistical quantity. In this work, we investigate the optimal design of experiments for {\em estimation of linear functionals…

Artificial Intelligence · Computer Science 2023-01-18 Mojmír Mutný , Andreas Krause

This paper generalizes regularized regression problems in a hyper-reproducing kernel Hilbert space (hyper-RKHS), illustrates its utility for kernel learning and out-of-sample extensions, and proves asymptotic convergence results for the…

Machine Learning · Computer Science 2022-10-20 Fanghui Liu , Lei Shi , Xiaolin Huang , Jie Yang , Johan A. K. Suykens

Research is taking place to find effective algorithms for content-based image representation and description. There is a substantial amount of algorithms available that use visual features (color, shape, texture). Shape feature has…

Computer Vision and Pattern Recognition · Computer Science 2012-03-23 Tranos Zuva , Oludayo O. Olugbara , Sunday O. Ojo , Seleman M. Ngwira

Recent advances in self-supervised learning and neural network scaling have enabled the creation of large models, known as foundation models, which can be easily adapted to a wide range of downstream tasks. The current paradigm for…

Machine Learning · Computer Science 2024-01-09 Brandon Duderstadt , Hayden S. Helm , Carey E. Priebe

Accurately reconstructing continuous flow fields from sparse or indirect measurements remains an open challenge, as existing techniques often suffer from oversmoothing artifacts, reliance on heterogeneous architectures, and the…

Graphics · Computer Science 2025-04-03 Xingyu Ni , Jingrui Xing , Xingqiao Li , Bin Wang , Baoquan Chen

Measures of similarity (or dissimilarity) are a key ingredient to many machine learning algorithms. We introduce DID, a pairwise dissimilarity measure applicable to a wide range of data spaces, which leverages the data's internal structure…

Machine Learning · Statistics 2022-03-08 Théophile Cantelobre , Carlo Ciliberto , Benjamin Guedj , Alessandro Rudi

An important feature of kernel mean embeddings (KME) is that the rate of convergence of the empirical KME to the true distribution KME can be bounded independently of the dimension of the space, properties of the distribution and smoothness…

Statistics Theory · Mathematics 2025-04-17 Geoffrey Wolfer , Pierre Alquier

A model for the prediction of functional time series is introduced, where observations are assumed to be continuous random functions. We model the dependence of the data with a nonstandard autoregressive structure, motivated in terms of the…

Methodology · Statistics 2018-07-03 Beatriz Bueno-Larraz , Johannes Klepsch

Multidimensional function data arise from many fields nowadays. The covariance function plays an important role in the analysis of such increasingly common data. In this paper, we propose a novel nonparametric covariance function estimation…

Methodology · Statistics 2021-09-14 Jiayi Wang , Raymond K. W. Wong , Xiaoke Zhang

Kernel methods are powerful and flexible approach to solve many problems in machine learning. Due to the pairwise evaluations in kernel methods, the complexity of kernel computation grows as the data size increases; thus the applicability…

Machine Learning · Computer Science 2017-11-28 Bharath Bhushan Damodaran , Nicolas Courty , Philippe-Henri Gosselin

Feature learning in neural networks is crucial for their expressive power and inductive biases, motivating various theoretical approaches. Some approaches describe network behavior after training through a change in kernel scale from…

Disordered Systems and Neural Networks · Physics 2025-05-29 Noa Rubin , Kirsten Fischer , Javed Lindner , David Dahmen , Inbar Seroussi , Zohar Ringel , Michael Krämer , Moritz Helias

The distance metric plays an important role in nearest neighbor (NN) classification. Usually the Euclidean distance metric is assumed or a Mahalanobis distance metric is optimized to improve the NN performance. In this paper, we study the…

Machine Learning · Statistics 2007-06-26 Bharath K. Sriperumbudur , Gert R. G. Lanckriet

Multiple kernel learning (MKL) algorithms combine different base kernels to obtain a more efficient representation in the feature space. Focusing on discriminative tasks, MKL has been used successfully for feature selection and finding the…

Machine Learning · Computer Science 2019-03-14 Babak Hosseini , Barbara Hammer

Deep kernel learning aims at designing nonlinear combinations of multiple standard elementary kernels by training deep networks. This scheme has proven to be effective, but intractable when handling large-scale datasets especially when the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Mingyuan Jiu , Hichem Sahbi

Gaussian Radial Basis Function (RBF) Kernels are the most-often-employed kernels in artificial intelligence and machine learning routines for providing optimally-best results in contrast to their respective counter-parts. However, a little…

Machine Learning · Computer Science 2023-12-19 Himanshu Singh

We propose a novel framework for matching estimators for causal effect from observational data that is based on minimizing the dual norm of estimation error when expressed as an operator. We show that many popular matching estimators can be…

Methodology · Statistics 2017-03-01 Nathan Kallus

Accurate and efficient environment representation is crucial for robotic applications such as motion planning, manipulation, and navigation. Signed distance functions (SDFs) have emerged as a powerful representation for encoding distance to…

Robotics · Computer Science 2026-04-01 Zhirui Dai , Tianxing Fan , Mani Amani , Jaemin Seo , Ki Myung Brian Lee , Hyondong Oh , Nikolay Atanasov

Approximation of scattered data is often a task in many engineering problems. The Radial Basis Function (RBF) approximation is appropriate for large scattered (unordered) datasets in d-dimensional space. This approach is useful for a higher…

Numerical Analysis · Computer Science 2018-06-21 Zuzana Majdisova , Vaclav Skala

Depth measures have gained popularity in the statistical literature for defining level sets in complex data structures like multivariate data, functional data, and graphs. Despite their versatility, integrating depth measures into…