English
Related papers

Related papers: Learning Kernel Tests Without Data Splitting

200 papers

Embedding probability distributions into reproducing kernel Hilbert spaces (RKHS) has enabled powerful nonparametric methods such as the maximum mean discrepancy (MMD), a statistical distance with strong theoretical and computational…

Machine Learning · Statistics 2025-05-28 Masha Naslidnyk , Siu Lun Chau , François-Xavier Briol , Krikamol Muandet

We consider the two-group classification problem and propose a kernel classifier based on the optimal scoring framework. Unlike previous approaches, we provide theoretical guarantees on the expected risk consistency of the method. We also…

Machine Learning · Statistics 2021-04-01 Alexander F. Lapanowski , Irina Gaynanova

Selecting relevant features associated with a given response variable is an important issue in many scientific fields. Quantifying quality and uncertainty of a selection result via false discovery rate (FDR) control has been of recent…

Methodology · Statistics 2020-12-17 Chenguang Dai , Buyu Lin , Xin Xing , Jun S. Liu

The problem of learning functions over spaces of probabilities - or distribution regression - is gaining significant interest in the machine learning community. A key challenge behind this problem is to identify a suitable representation…

Machine Learning · Statistics 2022-06-20 Dimitri Meunier , Massimiliano Pontil , Carlo Ciliberto

We prove minimax optimal learning rates for kernel ridge regression, resp.~support vector machines based on a data dependent partition of the input space, where the dependence of the dimension of the input space is replaced by the fractal…

Statistics Theory · Mathematics 2021-07-19 Thomas Hamm , Ingo Steinwart

In this paper, we study the problem of sparse multiple kernel learning (MKL), where the goal is to efficiently learn a combination of a fixed small number of kernels from a large pool that could lead to a kernel classifier with a small…

Machine Learning · Computer Science 2013-02-05 Rong Jin , Tianbao Yang , Mehrdad Mahdavi

Acquiring labels are often costly, whereas unlabeled data are usually easy to obtain in modern machine learning applications. Semi-supervised learning provides a principled machine learning framework to address such situations, and has been…

Machine Learning · Computer Science 2017-04-07 Trung Le , Khanh Nguyen , Van Nguyen , Vu Nguyen , Dinh Phung

In modern scientific research, massive datasets with huge numbers of observations are frequently encountered. To facilitate the computational process, a divide-and-conquer scheme is often used for the analysis of big data. In such a…

Machine Learning · Statistics 2015-05-06 Chen Xu , Yongquan Zhang , Runze Li

Metrics specifying distances between data points can be learned in a discriminative manner or from generative models. In this paper, we show how to unify generative and discriminative learning of metrics via a kernel learning framework.…

Machine Learning · Computer Science 2011-09-26 Yuan Shi , Yung-Kyun Noh , Fei Sha , Daniel D. Lee

We propose a goodness-of-fit measure for probability densities modeling observations with varying dimensionality, such as text documents of differing lengths or variable-length sequences. The proposed measure is an instance of the kernel…

Machine Learning · Statistics 2023-07-14 Jerome Baum , Heishiro Kanagawa , Arthur Gretton

Scaling analysis, in which one infers scaling exponents and a scaling function in a scaling law from given data, is a powerful tool for determining universal properties of critical phenomena in many fields of science. However, there are…

Statistical Mechanics · Physics 2015-07-08 Kenji Harada

Among dissimilarities between probability distributions, the Kernel Stein Discrepancy (KSD) has received much interest recently. We investigate the properties of its Wasserstein gradient flow to approximate a target probability distribution…

Machine Learning · Statistics 2021-05-24 Anna Korba , Pierre-Cyril Aubin-Frankowski , Szymon Majewski , Pierre Ablin

The success of kernel-based learning methods depend on the choice of kernel. Recently, kernel learning methods have been proposed that use data to select the most appropriate kernel, usually by combining a set of base kernels. We introduce…

Machine Learning · Computer Science 2011-12-21 Arash Afkanpour , Csaba Szepesvari , Michael Bowling

The main objective of the Multiple Kernel k-Means (MKKM) algorithm is to extract non-linear information and achieve optimal clustering by optimizing base kernel matrices. Current methods enhance information diversity and reduce redundancy…

Machine Learning · Computer Science 2024-03-07 Rina Su , Yu Guo , Caiying Wu , Qiyu Jin , Tieyong Zeng

Recent breakthroughs and successful deployment of large language and vision models in a constrained environment predominantly follow a two phase approach. First, large models are trained to achieve peak performance, followed by a model…

Machine Learning · Computer Science 2024-11-22 Hanna Mazzawi , Pranjal Awasthi , Xavi Gonzalvo , Srikumar Ramalingam

We present a novel distributionally robust framework for dynamic programming that uses kernel methods to design feedback control policies. Specifically, we leverage kernel mean embedding to map the transition probabilities governing the…

Systems and Control · Electrical Eng. & Systems 2023-12-20 Licio Romao , Ashish R. Hota , Alessandro Abate

In modern data analysis, nonparametric measures of discrepancies between random variables are particularly important. The subject is well-studied in the frequentist literature, while the development in the Bayesian setting is limited where…

Methodology · Statistics 2022-01-25 Qinyi Zhang , Veit Wild , Sarah Filippi , Seth Flaxman , Dino Sejdinovic

Sliced Stein discrepancy (SSD) and its kernelized variants have demonstrated promising successes in goodness-of-fit tests and model learning in high dimensions. Despite their theoretical elegance, their empirical performance depends…

Machine Learning · Computer Science 2021-07-22 Wenbo Gong , Kaibo Zhang , Yingzhen Li , José Miguel Hernández-Lobato

We study the problem of nonparametric two-sample testing using the sliced Wasserstein (SW) distance. While prior theoretical and empirical work indicates that the SW distance offers a promising balance between strong statistical guarantees…

Machine Learning · Statistics 2025-11-03 Binh Thuan Tran , Nicolas Schreuder

Synthetic data generation has become a key ingredient for training machine learning procedures, addressing tasks such as data augmentation, analysing privacy-sensitive data, or visualising representative samples. Assessing the quality of…

Machine Learning · Statistics 2022-06-02 Wenkai Xu , Gesine Reinert
‹ Prev 1 8 9 10 Next ›