English
Related papers

Related papers: Information Theoretic Structured Generative Modeli…

200 papers

Fully unsupervised deep generative modeling (FU-DGM) is promising for compressively sampled MRI (CS-MRI) when training data or compute are limited. Classical FU-DGMs such as DIP and INR rely on architectural priors, but the ill-conditioned…

Image and Video Processing · Electrical Eng. & Systems 2026-03-19 Qingyong Zhu , Yumin Tan , Xiang Gu , Dong Liang

In supervised learning with distributional inputs in the two-stage sampling setup, relevant to applications like learning-based medical screening or causal learning, the inputs (which are probability distributions) are not accessible in the…

Machine Learning · Computer Science 2026-01-22 Christian Fiedler

There has been a growing interest in mutual information measures due to their wide range of applications in Machine Learning and Computer Vision. In this paper, we present a generalized structured regression framework based on Shama-Mittal…

Machine Learning · Computer Science 2015-06-02 Mohamed Elhoseiny , Ahmed Elgammal

To bridge the digital divide, space-ground integrated networks (SGINs) are expected to deliver artificial intelligence (AI) services to every corner of the world. One key mission of SGINs is to support federated learning (FL) at a global…

Machine Learning · Computer Science 2025-12-24 Qian Chen , Xianhao Chen , Kaibin Huang

We develop here a semiparametric Gaussian mixture model (SGMM) for unsupervised learning with valuable spatial information taken into consideration. Specifically, we assume for each instance a random location. Then, conditional on this…

Methodology · Statistics 2025-10-21 Baichen Yu , Jin Liu , Hansheng Wang

Generative Recommendation (GR) has emerged as a promising paradigm by formulating item recommendation as a sequence-to-sequence generation task over item identifiers. Recent studies have incorporated multimodal signals to provide richer…

Information Retrieval · Computer Science 2026-05-20 Wei Chen , Xingyu Guo , Shuang Li , Fuwei Zhang , Meng Yuan , Jing Fan , Zhao Zhang , Deqing Wang , Fuzhen Zhuang

Medical image reconstruction with pre-trained score-based generative models (SGMs) has advantages over other existing state-of-the-art deep-learned reconstruction methods, including improved resilience to different scanner setups and…

Score-based generative models (SGMs) synthesize new data samples from Gaussian white noise by running a time-reversed Stochastic Differential Equation (SDE) whose drift coefficient depends on some probabilistic score. The discretization of…

Machine Learning · Computer Science 2022-08-11 Florentin Guth , Simon Coste , Valentin De Bortoli , Stephane Mallat

We propose a class of structured diffusion models, in which the prior distribution is chosen as a mixture of Gaussians, rather than a standard Gaussian distribution. The specific mixed Gaussian distribution, as prior, can be chosen to…

Machine Learning · Computer Science 2024-10-28 Nanshan Jia , Tingyu Zhu , Haoyu Liu , Zeyu Zheng

We propose Deep Residual Mixture Models (DRMMs), a novel deep generative model architecture. Compared to other deep models, DRMMs allow more flexible conditional sampling: The model can be trained once with all variables, and then used for…

Machine Learning · Computer Science 2021-07-22 Perttu Hämäläinen , Martin Trapp , Tuure Saloheimo , Arno Solin

Predictions for physical systems often rely upon knowledge acquired from ensembles of entities, e.g., ensembles of cells in biological sciences. For qualitative and quantitative analysis, these ensembles are simulated with parametric…

Machine Learning · Statistics 2023-09-28 Timothy Rumbell , Jaimit Parikh , James Kozloski , Viatcheslav Gurev

Regularized regression models are well studied and, under appropriate conditions, offer fast and statistically interpretable results. However, large data in many applications are heterogeneous in the sense of harboring distributional…

Methodology · Statistics 2022-10-25 Konstantinos Perrakis , Thomas Lartigue , Frank Dondelinger , Sach Mukherjee

Normative modeling has recently been proposed as an alternative for the case-control approach in modeling heterogeneity within clinical cohorts. Normative modeling is based on single-output Gaussian process regression that provides coherent…

Machine Learning · Statistics 2018-06-07 Seyed Mostafa Kia , Andre Marquand

Traditional hidden Markov models have been a useful tool to understand and model stochastic dynamic data; in the case of non-Gaussian data, models such as mixture of Gaussian hidden Markov models can be used. However, these suffer from the…

Machine Learning · Statistics 2023-05-16 Carlos Puerto-Santana , Concha Bielza , Pedro Larrañaga , Gustav Eje Henter

We propose a probabilistic framework for modelling and exploring the latent structure of relational data. Given feature information for the nodes in a network, the scalable deep generative relational model (SDREM) builds a deep network…

Machine Learning · Statistics 2019-11-06 Xuhui Fan , Bin Li , Scott Anthony Sisson , Caoyuan Li , Ling Chen

Text-to-image generation and image captioning are recently emerged as a new experimental paradigm to assess machine intelligence. They predict continuous quantity accompanied by their sampling techniques in the generation, making evaluation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jin-Hwa Kim , Yunji Kim , Jiyoung Lee , Kang Min Yoo , Sang-Woo Lee

The paper introduces the Hidden Tree Markov Network (HTN), a neuro-probabilistic hybrid fusing the representation power of generative models for trees with the incremental and discriminative learning capabilities of neural networks. We put…

Machine Learning · Computer Science 2017-11-22 Davide Bacciu

Due to its causal semantics, Bayesian networks (BN) have been widely employed to discover the underlying data relationship in exploratory studies, such as brain research. Despite its success in modeling the probability distribution of…

Computer Vision and Pattern Recognition · Computer Science 2015-06-24 Luping Zhou , Lei Wang , Lingqiao Liu , Philip Ogunbona , Dinggang Shen

Markov random fields area popular model for high-dimensional probability distributions. Over the years, many mathematical, statistical and algorithmic problems on them have been studied. Until recently, the only known algorithms for…

Machine Learning · Computer Science 2017-06-01 Linus Hamilton , Frederic Koehler , Ankur Moitra

We define a general class of network formation models, Statistical Exponential Random Graph Models (SERGMs), that nest standard exponential random graph models (ERGMs) as a special case. We provide the first general results on when these…

Physics and Society · Physics 2014-06-26 Arun G. Chandrasekhar , Matthew O. Jackson