English
Related papers

Related papers: Analysis of Kernel Mean Matching under Covariate S…

200 papers

Estimating the distribution of outcomes under counterfactual policies is critical for decision-making in domains such as recommendation, advertising, and healthcare. We propose and analyze a novel framework-Counterfactual Policy Mean…

Machine Learning · Statistics 2025-10-29 Houssam Zenati , Bariscan Bozkurt , Arthur Gretton

In many contemporary statistical and machine learning methods, one needs to optimize an objective function that depends on the discrepancy between two probability distributions. The discrepancy can be referred to as a metric for…

Machine Learning · Computer Science 2025-02-11 Yijin Ni , Xiaoming Huo

We develop the contextual measurement model (CMM) which is used for clarification of the quantum foundations. This model matches with Bohr's views on the role of experimental contexts. CMM is based on contextual probability theory which is…

Quantum Physics · Physics 2025-11-21 Andrei Khrennikov

Conditional contrastive learning frameworks consider the conditional sampling procedure that constructs positive or negative data pairs conditioned on specific variables. Fair contrastive learning constructs negative pairs, for example,…

Machine Learning · Computer Science 2022-03-16 Yao-Hung Hubert Tsai , Tianqin Li , Martin Q. Ma , Han Zhao , Kun Zhang , Louis-Philippe Morency , Ruslan Salakhutdinov

The kernel least-mean-square (KLMS) algorithm is an appealing tool for online identification of nonlinear systems due to its simplicity and robustness. In addition to choosing a reproducing kernel and setting filter parameters, designing a…

Machine Learning · Statistics 2013-11-01 Jie Chen , Wei Gao , Cédric Richard , Jose-Carlos M. Bermudez

Conformal prediction is widely used to equip black-box machine learning models with uncertainty quantification, offering formal coverage guarantees under exchangeable data. However, these guarantees fail when faced with subpopulation…

Machine Learning · Computer Science 2025-11-10 Nien-Shao Wang , Duygu Nur Yaldiz , Yavuz Faruk Bakman , Sai Praneeth Karimireddy

This paper investigates the critical role of eigenalignments between the kernel matrix and learning targets in achieving robust generalization in learning problems. We establish a direct connection between generalization performance in…

Machine Learning · Statistics 2026-05-18 Yang Liu , Ernest Fokoue , Richard Lange , Daniel Krutz

In recent years, machine learning researchers have focused on methods to construct flexible and interpretable prediction models. However, an interpretability evaluation, a relationship between generalization performance and an…

Machine Learning · Computer Science 2019-10-08 Jinwei Zhao , Qizhou Wang , Yufei Wang , Yu Liu , Zhenghao Shi , Xinhong Hei

We show that in the context of classification the property of source and target distributions to be related by covariate shift may be lost if the information content captured in the covariates is reduced, for instance by dropping components…

Machine Learning · Statistics 2022-08-16 Dirk Tasche

Varying domains and biased datasets can lead to differences between the training and the target distributions, known as covariate shift. Current approaches for alleviating this often rely on estimating the ratio of training and target…

Machine Learning · Statistics 2020-10-27 Bijan Mazaheri , Siddharth Jain , Jehoshua Bruck

We consider the problem of two-sample testing in a semi-supervised setting with abundant unlabeled covariate data. Standard two-sample tests neglect covariate information, which has the potential to significantly boost performance. However,…

Machine Learning · Statistics 2026-05-05 Gyumin Lee , Shubhanshu Shekhar , Ilmun Kim

Kernel survival analysis models estimate individual survival distributions with the help of a kernel function, which measures the similarity between any two data points. Such a kernel function can be learned using deep kernel survival…

Machine Learning · Computer Science 2025-02-18 George H. Chen

Supervised learning is often affected by a covariate shift in which the marginal distributions of instances (covariates $x$) of training and testing samples $\mathrm{p}_\text{tr}(x)$ and $\mathrm{p}_\text{te}(x)$ are different but the label…

Machine Learning · Statistics 2023-06-12 José I. Segovia-Martín , Santiago Mazuelas , Anqi Liu

Quantum kernels quantify similarity between data points by measuring the inner product between quantum states, computed through quantum circuit measurements. By embedding data into quantum systems, quantum kernel feature maps, that may be…

Quantum Physics · Physics 2025-03-24 Joachim Tomasi , Sandrine Anthoine , Hachem Kadri

Contrastive learning is an efficient approach to self-supervised representation learning. Although recent studies have made progress in the theoretical understanding of contrastive learning, the investigation of how to characterize the…

Machine Learning · Computer Science 2023-08-21 Hiroki Waida , Yuichiro Wada , Léo Andéol , Takumi Nakagawa , Yuhui Zhang , Takafumi Kanamori

Selecting an appropriate kernel is a central challenge in kernel-based spectral methods. In \emph{Kernelized Diffusion Maps} (KDM), the kernel determines the accuracy of the RKHS estimator of a diffusion-type operator and hence the quality…

Machine Learning · Statistics 2026-04-21 Othmane Aboussaad , Adam Miraoui , Boumediene Hamzi , Houman Owhadi

Approximate Markov chain Monte Carlo (MCMC) offers the promise of more rapid sampling at the cost of more biased inference. Since standard MCMC diagnostics fail to detect these biases, researchers have developed computable Stein discrepancy…

Machine Learning · Statistics 2020-10-16 Jackson Gorham , Lester Mackey

Recent studies utilize multiple kernel learning to deal with incomplete-data problem. In this study, we introduce new methods that do not only complete multiple incomplete kernel matrices simultaneously, but also allow control of the…

Machine Learning · Computer Science 2018-12-26 Rachelle Rivero , Tsuyoshi Kato

Nonparametric two-sample tests such as the Maximum Mean Discrepancy (MMD) are often used to detect differences between two distributions in machine learning applications. However, the majority of existing literature assumes that error-free…

Machine Learning · Statistics 2023-08-08 Ron Nafshi , Maggie Makar

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira