中文
相关论文

相关论文: A Probabilistic Approach to Self-Supervised Learni…

200 篇论文

Due to the escalating growth of big data sets in recent years, new Bayesian Markov chain Monte Carlo (MCMC) parallel computing methods have been developed. These methods partition large data sets by observations into subsets. However, for…

统计方法学 · 统计学 2019-01-21 Zheng Wei , Erin M. Conlon

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

We explore the application of a nonlinear MCMC technique first introduced in [1] to problems in Bayesian machine learning. We provide a convergence guarantee in total variation that uses novel results for long-time convergence and…

机器学习 · 统计学 2022-11-28 James Vuckovic

Bayesian filtering aims at tracking sequentially a hidden process from an observed one. In particular, sequential Monte Carlo (SMC) techniques propagate in time weighted trajectories which represent the posterior probability density…

统计计算 · 统计学 2012-10-22 Yohan Petetin , François Desbouvries

Conventional frequentist learning, as assumed by existing federated learning protocols, is limited in its ability to quantify uncertainty, incorporate prior knowledge, guide active learning, and enable continual learning. Bayesian learning…

信息论 · 计算机科学 2021-08-31 Dongzhu Liu , Osvaldo Simeone

For big data analysis, high computational cost for Bayesian methods often limits their applications in practice. In recent years, there have been many attempts to improve computational efficiency of Bayesian inference. Here we propose an…

统计计算 · 统计学 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

Prompt learning has emerged as an effective technique for fine-tuning large-scale foundation models for downstream tasks. However, conventional prompt learning methods are prone to overfitting and can struggle with out-of-distribution…

Recently self supervised learning has seen explosive growth and use in variety of machine learning tasks because of its ability to avoid the cost of annotating large-scale datasets. This paper gives an overview for best self supervised…

机器学习 · 计算机科学 2022-10-21 Naman Goyal

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

机器学习 · 计算机科学 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

State space models (SSM) have been widely applied for the analysis and visualization of large sequential datasets. Sequential Monte Carlo (SMC) is a very popular particle-based method to sample latent states from intractable posteriors.…

机器学习 · 计算机科学 2019-01-07 Duo Xu

Deriving Bayesian inference for exponential random graph models (ERGMs) is a challenging "doubly intractable" problem as the normalizing constants of the likelihood and posterior density are both intractable. Markov chain Monte Carlo (MCMC)…

统计计算 · 统计学 2019-11-26 Linda S. L. Tan , Nial Friel

In this paper, we propose a new stochastic optimization algorithm for Bayesian inference based on multilevel Monte Carlo (MLMC) methods. In Bayesian statistics, biased estimators of the model evidence have been often used as stochastic…

机器学习 · 统计学 2021-02-26 Kei Ishikawa , Takashi Goda

Bayesian methods have become a popular way to incorporate prior knowledge and a notion of uncertainty into machine learning models. At the same time, the complexity of modern machine learning makes it challenging to comprehend a model's…

机器学习 · 计算机科学 2021-09-09 Sarem Seitz

This paper presents Probabilistic Video Contrastive Learning, a self-supervised representation learning method that bridges contrastive learning with probabilistic representation. We hypothesize that the clips composing the video have…

计算机视觉与模式识别 · 计算机科学 2022-04-11 Jungin Park , Jiyoung Lee , Ig-Jae Kim , Kwanghoon Sohn

We introduce a variational Bayesian neural network where the parameters are governed via a probability distribution on random matrices. Specifically, we employ a matrix variate Gaussian \cite{gupta1999matrix} parameter posterior…

机器学习 · 统计学 2016-06-24 Christos Louizos , Max Welling

The identification of parameters in mathematical models using noisy observations is a common task in uncertainty quantification. We employ the framework of Bayesian inversion: we combine monitoring and observational data with prior…

统计计算 · 统计学 2018-05-11 Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

Increasingly complex datasets pose a number of challenges for Bayesian inference. Conventional posterior sampling based on Markov chain Monte Carlo can be too computationally intensive, is serial in nature and mixes poorly between posterior…

机器学习 · 统计学 2019-08-27 Edwin Fong , Simon Lyddon , Chris Holmes

In many applications of Bayesian clustering, posterior sampling on the discrete state space of cluster allocations is achieved via Markov chain Monte Carlo (MCMC) techniques. As it is typically challenging to design transition kernels to…

统计计算 · 统计学 2019-06-14 Masoud Asgharian , Martin Lysy , Vahid Partovi Nia

We consider the problem of Bayesian learning on sensitive datasets and present two simple but somewhat surprising results that connect Bayesian learning to "differential privacy:, a cryptographic approach to protect individual-level privacy…

机器学习 · 统计学 2015-04-14 Yu-Xiang Wang , Stephen E. Fienberg , Alex Smola

Estimating model parameters of a general family of cure models is always a challenging task mainly due to flatness and multimodality of the likelihood function. In this work, we propose a fully Bayesian approach in order to overcome these…

统计方法学 · 统计学 2024-08-20 Panagiotis Papastamoulis , Fotios Milienos