English
Related papers

Related papers: Stochastic Feature Mapping for PAC-Bayes Classific…

200 papers

Stochastic variational Bayes algorithms have become very popular in the machine learning literature, particularly in the context of nonparametric Bayesian inference. These algorithms replace the true but intractable posterior distribution…

Methodology · Statistics 2024-10-04 Pedro Regueiro , Abel Rodríguez , Juan Sosa

Deep learning techniques have become widely utilized in histopathology image classification due to their superior performance. However, this success heavily relies on the availability of substantial labeled data, which necessitates…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Meng Li , Chaoyi Li , Can Peng , Brian C. Lovell

Stochastic gradient methods enable learning probabilistic models from large amounts of data. While large step-sizes (learning rates) have shown to be best for least-squares (e.g., Gaussian noise) once combined with parameter averaging,…

Machine Learning · Statistics 2018-11-22 Dmitry Babichev , Francis Bach

Ensemble weather forecasts based on multiple runs of numerical weather prediction models typically show systematic errors and require post-processing to obtain reliable forecasts. Accurately modeling multivariate dependencies is crucial in…

Atmospheric and Oceanic Physics · Physics 2024-02-02 Jieyu Chen , Tim Janke , Florian Steinke , Sebastian Lerch

In this article, we develop and investigate a new classifier based on features extracted using spatial depth. Our construction is based on fitting a generalized additive model to the posterior probabilities of the different competing…

Methodology · Statistics 2015-04-16 Subhajit Dutta , Anil K. Ghosh

In real-time trajectory planning for unmanned vehicles, on-board sensors, radars and other instruments are used to collect information on possible obstacles to be avoided and pathways to be followed. Since, in practice, observations of the…

Methodology · Statistics 2013-09-25 Adriano Zanin Zambom , Julian A. A. Collazos , Ronaldo Dias

We present here a PAC-Bayesian point of view on adaptive supervised classification. Using convex analysis, we show how to get local measures of the complexity of the classification model involving the relative entropy of posterior…

Statistics Theory · Mathematics 2007-06-13 Olivier Catoni

Motivated by the need of the linking records across various databases, we propose a novel graphical model based classifier that uses a mixture of Poisson distributions with latent variables. The idea is to derive insight into each pair of…

Machine Learning · Computer Science 2019-08-13 Harish Kashyap K , Kiran Byadarhaly , Saumya Shah

We propose a generative multivariate posterior sampler via flow matching. It offers a simple training objective, and does not require access to likelihood evaluation. The method learns a dynamic, block-triangular velocity field in the joint…

Machine Learning · Statistics 2026-04-02 Percy S. Zhai , So Won Jeong , Veronika Ročková

In this paper, we develop a dynamic framework for the modeling and analysis of social networks to work with web documents. We illustrate the model with features of web, design a form to analyze relationships of attributes as a modality of…

Probability · Mathematics 2012-07-18 Mahyuddin K. M. Nasution , Shahrul Azman Noah

Learning the continuous dynamics of a system from snapshots of its temporal marginals is a problem which appears throughout natural sciences and machine learning, including in quantum systems, single-cell biological data, and generative…

Machine Learning · Computer Science 2023-06-12 Kirill Neklyudov , Rob Brekelmans , Daniel Severo , Alireza Makhzani

We present a multi-fidelity method for uncertainty quantification of parameter estimates in complex systems, leveraging generative models trained to sample the target conditional distribution. In the Bayesian inference setting, traditional…

Machine Learning · Computer Science 2025-04-03 Caroline Tatsuoka , Minglei Yang , Dongbin Xiu , Guannan Zhang

We propose a novel Bayesian inference framework for distributed differentially private linear regression. We consider a distributed setting where multiple parties hold parts of the data and share certain summary statistics of their portions…

Machine Learning · Statistics 2023-06-08 Barış Alparslan , Sinan Yıldırım , Ş. İlker Birbil

In genome-wide association studies (GWAS), penalization is an important approach for identifying genetic markers associated with trait while mixed model is successful in accounting for a complicated dependence structure among samples.…

Methodology · Statistics 2013-05-21 Jin Liu , Can Yang , Xingjie Shi , Cong Li , Jian Huang , Hongyu Zhao , Shuangge Ma

We make three related contributions motivated by the challenge of training stochastic neural networks, particularly in a PAC-Bayesian setting: (1) we show how averaging over an ensemble of stochastic neural networks enables a new class of…

Machine Learning · Computer Science 2021-12-16 Felix Biggs , Benjamin Guedj

While generative models have proved successful in many domains, they may pose a privacy leakage risk in practical deployment. To address this issue, differentially private generative model learning has emerged as a solution to train private…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Bochao Liu , Pengju Wang , Weijia Guo , Yong Li , Liansheng Zhuang , Weiping Wang , Shiming Ge

We consider the problem of scalable sampling algorithms to fit Bayesian generalized linear mixed models on large datasets. Stochastic gradient Langevin dynamics, coupled with smooth re-parameterizations of variance parameters, produces…

Methodology · Statistics 2026-04-30 Youngsoo Baek , Samuel I. Berchuck

We introduce Flux Matching, a new paradigm for generative modeling that generalizes existing score-based models to a broader family of vector fields that need not be conservative. Rather than requiring the model to equal the data score, the…

Machine Learning · Computer Science 2026-05-11 Peter Pao-Huang , Xiaojie Qiu , Stefano Ermon

It has been found that stochastic algorithms often find good solutions much more rapidly than inherently-batch approaches. Indeed, a very useful rule of thumb is that often, when solving a machine learning problem, an iterative technique…

Machine Learning · Computer Science 2013-08-19 Andrew Cotter

Generative models inspired by dynamical transport of measure -- such as flows and diffusions -- construct a continuous-time map between two probability densities. Conventionally, one of these is the target density, only accessible through…

Machine Learning · Computer Science 2024-09-24 Michael S. Albergo , Mark Goldstein , Nicholas M. Boffi , Rajesh Ranganath , Eric Vanden-Eijnden