English
Related papers

Related papers: Remarks on kernel Bayes' rule

200 papers

The goal of causal inference is to understand the outcome of alternative courses of action. However, all causal inference requires assumptions. Such assumptions can be more influential than in typical tasks for probabilistic modeling, and…

Methodology · Statistics 2016-10-31 Dustin Tran , Francisco J. R. Ruiz , Susan Athey , David M. Blei

The distribution regression problem encompasses many important statistics and machine learning tasks, and arises in a large range of applications. Among various existing approaches to tackle this problem, kernel methods have become a method…

Statistics Theory · Mathematics 2025-09-22 François Bachoc , Louis Béthune , Alberto González-Sanz , Jean-Michel Loubes

Choosing the most adequate kernel is crucial in many Machine Learning applications. Gaussian Process is a state-of-the-art technique for regression and classification that heavily relies on a kernel function. However, in the Gaussian…

Machine Learning · Computer Science 2019-10-15 Ibai Roman , Roberto Santana , Alexander Mendiburu , Jose A. Lozano

In this paper we formulate the problem of inference under incomplete information in very general terms. This includes modelling the process responsible for the incompleteness, which we call the incompleteness process. We allow the process…

Artificial Intelligence · Computer Science 2014-01-16 Marco Zaffalon , Enrique Miranda

Reproducing kernel Hilbert spaces are elucidated without assuming prior familiarity with Hilbert spaces. Compared with extant pedagogic material, greater care is placed on motivating the definition of reproducing kernel Hilbert spaces and…

History and Overview · Mathematics 2015-11-06 Jonathan H. Manton , Pierre-Olivier Amblard

Model inference for dynamical systems aims to estimate the future behaviour of a system from observations. Purely model-free statistical methods, such as Artificial Neural Networks, tend to perform poorly for such tasks. They are therefore…

Machine Learning · Computer Science 2019-08-07 David K. E. Green , Filip Rindler

We consider the problem of how decision making can be fair when the underlying probabilistic model of the world is not known with certainty. We argue that recent notions of fairness in machine learning need to explicitly incorporate…

Machine Learning · Computer Science 2018-11-06 Christos Dimitrakakis , Yang Liu , David Parkes , Goran Radanovic

Gaussian Radial Basis Function (RBF) Kernels are the most-often-employed kernels in artificial intelligence and machine learning routines for providing optimally-best results in contrast to their respective counter-parts. However, a little…

Machine Learning · Computer Science 2023-12-19 Himanshu Singh

This paper gives new foundations of quantum state reduction without appealing to the projection postulate for the probe measurement. For this purpose, the quantum Bayes principle is formulated as the most fundamental principle for…

Quantum Physics · Physics 2025-06-06 Masanao Ozawa

In a probability-based reasoning system, Bayes' theorem and its variations are often used to revise the system's beliefs. However, if the explicit conditions and the implicit conditions of probability assignments `me properly distinguished,…

Artificial Intelligence · Computer Science 2013-03-08 Pei Wang

This paper presents a kernel-based framework for physics-informed nonlinear system identification. The key contribution is a structured methodology that extends kernel-based techniques to seamlessly embed partially known physics-based…

Systems and Control · Electrical Eng. & Systems 2025-10-20 Cesare Donati , Martina Mammarella , Giuseppe C. Calafiore , Fabrizio Dabbene , Constantino Lagoa , Carlo Novara

In this paper, we consider the coefficient-based regularized distribution regression which aims to regress from probability measures to real-valued responses over a reproducing kernel Hilbert space (RKHS), where the regularization is put on…

Machine Learning · Statistics 2022-08-29 Yuan Mao , Lei Shi , Zheng-Chu Guo

Kernel methods are an extremely popular set of techniques used for many important machine learning and data analysis applications. In addition to having good practical performances, these methods are supported by a well-developed theory.…

Machine Learning · Statistics 2015-04-23 Shiva Prasad Kasiviswanathan , Mark Rudelson

Model misspecification can create significant challenges for the implementation of probabilistic models, and this has led to development of a range of robust methods which directly account for this issue. However, whether these more…

Machine Learning · Statistics 2025-04-22 Oscar Key , Arthur Gretton , François-Xavier Briol , Tamara Fernandez

Kernel mean embeddings -- integrals of a kernel with respect to a probability distribution -- are essential in Bayesian quadrature, but also widely used in other computational tools for numerical integration or for statistical inference…

Machine Learning · Statistics 2025-04-29 François-Xavier Briol , Alexandra Gessner , Toni Karvonen , Maren Mahsereci

Recent work has developed Bayesian methods for the automatic statistical analysis and description of single time series as well as of homogeneous sets of time series data. We extend prior work to create an interpretable kernel embedding for…

Machine Learning · Computer Science 2019-08-27 Andre T. Nguyen , Edward Raff

Bayes' rule, which is routinely used to update beliefs based on new evidence, can be derived from a principle of minimum change. This principle states that updated beliefs must be consistent with new data, while deviating minimally from the…

Quantum Physics · Physics 2025-09-03 Ge Bai , Francesco Buscemi , Valerio Scarani

Parametric Bayesian modeling offers a powerful and flexible toolbox for machine learning. Yet the model, however detailed, may still be wrong, and this can make inferences untrustworthy. In this paper we introduce a new class of…

Methodology · Statistics 2026-04-03 Bohan Wu , Eli N. Weinstein , Sohrab Salehi , Yixin Wang , David M. Blei

Randomized benchmarking (RB) protocols are standard tools for characterizing quantum devices. Prior analyses of RB protocols have not provided a complete method for analyzing realistic data, resulting in a variety of ad-hoc methods. The…

Quantum Physics · Physics 2018-02-02 Ian Hincks , Joel J. Wallman , Chris Ferrie , Chris Granade , David G. Cory

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…

Machine Learning · Computer Science 2015-11-10 Francis Bach