English
Related papers

Related papers: Stochastic Feature Mapping for PAC-Bayes Classific…

200 papers

Recent works leveraging Graph Neural Networks to approach graph matching tasks have shown promising results. Recent progress in learning discrete distributions poses new opportunities for learning graph matching models. In this work, we…

Machine Learning · Computer Science 2021-09-14 Linfeng Liu , Michael C. Hughes , Soha Hassoun , Li-Ping Liu

Probabilistic generative models provide a flexible and systematic framework for learning the underlying geometry of data. However, model selection in this setting is challenging, particularly when selecting for ill-defined qualities such as…

Machine Learning · Computer Science 2022-10-05 Chester Holtz , Gal Mishne , Alexander Cloninger

Generative machine learning models are being increasingly viewed as a way to share sensitive data between institutions. While there has been work on developing differentially private generative modeling approaches, these approaches…

Cryptography and Security · Computer Science 2022-10-13 Yixi Xu , Sumit Mukherjee , Xiyang Liu , Shruti Tople , Rahul Dodhia , Juan Lavista Ferres

With the development of graph applications, generative models for graphs have been more crucial. Classically, stochastic models that generate graphs with a pre-defined probability of edges and nodes have been studied. Recently, some models…

Machine Learning · Computer Science 2023-04-07 Shohei Nakazawa , Yoshiki Sato , Kenji Nakagawa , Sho Tsugawa , Kohei Watabe

Variable selection techniques have become increasingly popular amongst statisticians due to an increased number of regression and classification applications involving high-dimensional data where we expect some predictors to be unimportant.…

Methodology · Statistics 2010-09-20 Anthony Lee , Francois Caron , Arnaud Doucet , Chris Holmes

The discriminative approach to classification using deep neural networks has become the de-facto standard in various fields. Complementing recent reservations about safety against adversarial examples, we show that conventional…

Machine Learning · Computer Science 2018-07-25 William Wang , Angelina Wang , Aviv Tamar , Xi Chen , Pieter Abbeel

This article makes discrete masked models for the generative modeling of discrete data controllable. The goal is to generate samples of a discrete random variable that adheres to a posterior distribution, satisfies specific constraints, or…

Machine Learning · Computer Science 2024-10-04 Wei Guo , Yuchen Zhu , Molei Tao , Yongxin Chen

We present a probabilistic model for stochastic iterative algorithms with the use case of optimization algorithms in mind. Based on this model, we present PAC-Bayesian generalization bounds for functions that are defined on the trajectory…

Machine Learning · Computer Science 2024-08-22 Michael Sucker , Peter Ochs

Unsupervised feature selection is an important method to reduce dimensions of high dimensional data without labels, which is benefit to avoid ``curse of dimensionality'' and improve the performance of subsequent machine learning tasks, like…

Machine Learning · Computer Science 2020-12-29 Yanyong Huang , Zongxin Shen , Fuxu Cai , Tianrui Li , Fengmao Lv

Theory of graphical models has matured over more than three decades to provide the backbone for several classes of models that are used in a myriad of applications such as genetic mapping of diseases, credit risk evaluation, reliability and…

Machine Learning · Statistics 2014-11-13 Henrik Nyman , Johan Pensar , Timo Koski , Jukka Corander

This paper formed part of a preliminary research report for a risk consultancy and academic research. Stochastic Programming models provide a powerful paradigm for decision making under uncertainty. In these models the uncertainties are…

Computational Finance · Quantitative Finance 2009-04-08 Sovan Mitra

Nonlinear Mixed effects models are hidden variables models that are widely used in many fields such as pharmacometrics. In such models, the distribution characteristics of hidden variables can be specified by including several parameters…

Methodology · Statistics 2021-10-19 Edouard Ollier

PAC-Bayesian set up involves a stochastic classifier characterized by a posterior distribution on a classifier set, offers a high probability bound on its averaged true risk and is robust to the training sample used. For a given posterior,…

Machine Learning · Computer Science 2019-12-17 Puja Sahu , Nandyala Hemachandra

\noindent Hyper-parameter selection is a central practical problem in modern machine learning, governing regularization strength, model capacity, and robustness choices. Cross-validation is often computationally prohibitive at scale, while…

Machine Learning · Statistics 2025-12-24 Hedibert Lopes , Nick Polson , Vadim Sokolov

We propose a probabilistic framework for developing computational models of biological neural systems. In this framework, physiological recordings are viewed as discrete-time partial observations of an underlying continuous-time stochastic…

Neurons and Cognition · Quantitative Biology 2026-02-10 Ahmed ElGazzar , Marcel van Gerven

We informally call a stochastic process learnable if it admits a generalization error approaching zero in probability for any concept class with finite VC-dimension (IID processes are the simplest example). A mixture of learnable processes…

Machine Learning · Statistics 2015-07-27 Cosma Rohilla Shalizi , Aryeh Kontorovich

In this work, we present a probabilistic model for directed graphs where nodes have attributes and labels. This model serves as a generative classifier capable of predicting the labels of unseen nodes using either maximum likelihood or…

Machine Learning · Computer Science 2025-01-06 Diego Huerta , Gerardo Arizmendi

In information theory, lossless compression of general data is based on an explicit assumption of a stochastic generative model on target data. However, in lossless image compression, the researchers have mainly focused on the coding…

Information Theory · Computer Science 2021-08-24 Yuta Nakahara , Toshiyasu Matsushima

Learning a parametric model from a given dataset indeed enables to capture intrinsic dependencies between random variables via a parametric conditional probability distribution and in turn predict the value of a label variable given…

Machine Learning · Statistics 2024-06-14 Elouan Argouarc'h , François Desbouvries , Eric Barat , Eiji Kawasaki

We develop a Bayesian framework for variable selection in linear regression with autocorrelated errors, accommodating lagged covariates and autoregressive structures. This setting occurs in time series applications where responses depend on…

Methodology · Statistics 2025-08-18 Alokesh Manna , Sujit K. Ghosh