English
Related papers

Related papers: Predictive Information Rate in Discrete-time Gauss…

200 papers

Multi-task learning models using Gaussian processes (GP) have been developed and successfully applied in various applications. The main difficulty with this approach is the computational cost of inference using the union of examples from…

Machine Learning · Computer Science 2012-11-29 Yuyang Wang , Roni Khardon

In engineering design, one often wishes to calculate the probability that the performance of a system is satisfactory under uncertainty. State of the art algorithms exist to solve this problem using active learning with Gaussian process…

Machine Learning · Computer Science 2022-11-03 Jonathan Sadeghi , Romain Mueller , John Redford

We present the first framework for Gaussian-process-modulated Poisson processes when the temporal data appear in the form of panel counts. Panel count data frequently arise when experimental subjects are observed only at discrete time…

Machine Learning · Statistics 2018-03-13 Hongyi Ding , Young Lee , Issei Sato , Masashi Sugiyama

For a setting in which a large number of asymmetrically informed agents are randomly matched into groups over time, exchanging their information with each other when matched, we provide an explicit solution for the dynamics of the…

Probability · Mathematics 2008-11-20 Darrell Duffie , Gaston Giroux , Gustavo Manso

We introduce the problem of \emph{timely} private information retrieval (PIR) from $N$ non-colluding and replicated servers. In this problem, a user desires to retrieve a message out of $M$ messages from the servers, whose contents are…

Information Theory · Computer Science 2021-05-19 Karim Banawan , Ahmed Arafa , Sennur Ulukus

Model selection in machine learning (ML) is a crucial part of the Bayesian learning procedure. Model choice may impose strong biases on the resulting predictions, which can hinder the performance of methods such as Bayesian neural networks…

Machine Learning · Statistics 2022-08-09 Simón Rodríguez Santana , Luis A. Ortega , Daniel Hernández-Lobato , Bryan Zaldívar

We establish uniform pointwise estimates for the densities of a family of $\alpha$-stable processes with respect to the index $\alpha \in [\alpha_0,2]$ for some $\alpha_0>0$. In addition, we estimate the difference between the heat kernels…

Probability · Mathematics 2026-03-27 Xianming Liu , Chongyang Ren , Mingyan Wu

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to…

Machine Learning · Computer Science 2025-01-10 Shai Feldman , Yaniv Romano

For machine learning of interatomic potentials a scalable sparse Gaussian process regression formalism is introduced with a data-efficient on-the-fly adaptive sampling algorithm. With this approach, the computational cost is effectively…

Computational Physics · Physics 2021-06-09 Amir Hajibabaei , Chang Woo Myung , Kwang S. Kim

We construct flexible likelihoods for multi-output Gaussian process models that leverage neural networks as components. We make use of sparse variational inference methods to enable scalable approximate inference for the resulting class of…

Machine Learning · Statistics 2019-06-03 Martin Jankowiak , Jacob Gardner

This paper investigates a financial market where returns depend on an unobservable Gaussian drift process. While the observation of returns yields information about the underlying drift, we also incorporate discrete-time expert opinions as…

Portfolio Management · Quantitative Finance 2021-11-04 Jörn Sass , Dorothee Westphal , Ralf Wunderlich

In this work we consider Bayesian inference problems with intractable likelihood functions. We present a method to compute an approximate of the posterior with a limited number of model simulations. The method features an inverse Gaussian…

Computation · Statistics 2021-02-23 Hongqiao Wang , Ziqiao Ao , Tengchao Yu , Jinglai Li

For propensity score analysis and sparse estimation, we develop an information criterion for determining the regularization parameters needed in variable selection. First, for Gaussian distribution-based causal inference models, we extend…

Methodology · Statistics 2022-04-22 Yoshiyuki Ninomiya

An agent acquires information dynamically until her belief about a binary state reaches an upper or lower threshold. She can choose any signal process subject to a constraint on the rate of entropy reduction. Strategies are ordered by "time…

Theoretical Economics · Economics 2024-08-23 Daniel Chen , Weijie Zhong

This paper investigates the use of a Passive Intelligent Mirrors (PIM) to operate a multi-user MISO downlink communication. The transmit powers and the mirror reflection coefficients are designed for sum-rate maximization subject to…

Information Theory · Computer Science 2018-07-20 Chongwen Huang , Alessio Zappone , Mérouane Debbah , Chau Yuen

We introduce the problem of deceptive information retrieval (DIR), in which a user wishes to download a required file out of multiple independent files stored in a system of databases while \emph{deceiving} the databases by making the…

Information Theory · Computer Science 2023-07-11 Sajani Vithana , Sennur Ulukus

Through sequential construction of posteriors on observing data online, Bayes' theorem provides a natural framework for continual learning. We develop Variational Auto-Regressive Gaussian Processes (VAR-GPs), a principled posterior updating…

Machine Learning · Statistics 2021-06-15 Sanyam Kapoor , Theofanis Karaletsos , Thang D. Bui

.Stochastic models based on random diffusivities, such as the diffusing-diffusivity approach, are popular concepts for the description of non-Gaussian diffusion in heterogeneous media. Studies of these models typically focus on the moments…

Statistical Mechanics · Physics 2020-08-26 V. Sposini , D. S. Grebenkov , R. Metzler , G. Oshanin , F. Seno

Standard sparse pseudo-input approximations to the Gaussian process (GP) cannot handle complex functions well. Sparse spectrum alternatives attempt to answer this but are known to over-fit. We suggest the use of variational inference for…

Machine Learning · Statistics 2015-03-23 Yarin Gal , Richard Turner

In this work, we propose a new Gaussian process regression (GPR) method: physics information aided Kriging (PhIK). In the standard data-driven Kriging, the unknown function of interest is usually treated as a Gaussian process with assumed…

Machine Learning · Statistics 2021-11-17 Xiu Yang , Guzel Tartakovsky , Alexandre Tartakovsky