English
Related papers

Related papers: Squared Neural Families: A New Class of Tractable …

200 papers

Neural network approaches for meta-learning distributions over functions have desirable properties such as increased flexibility and a reduced complexity of inference. Building on the successes of denoising diffusion models for generative…

Machine Learning · Statistics 2023-06-08 Vincent Dutordoir , Alan Saul , Zoubin Ghahramani , Fergus Simpson

Probability density function estimation with weighted samples is the main foundation of all adaptive importance sampling algorithms. Classically, a target distribution is approximated either by a non-parametric model or within a parametric…

Machine Learning · Computer Science 2023-10-16 Julien Demange-Chryst , François Bachoc , Jérôme Morio , Timothé Krauth

We propose a novel approach for density estimation with exponential families for the case when the true density may not fall within the chosen family. Our approach augments the sufficient statistics with features designed to accumulate…

Machine Learning · Statistics 2012-09-07 Lin Yuan , Sergey Kirshner , Robert Givan

Fair representation learning is an attractive approach that promises fairness of downstream predictors by encoding sensitive data. Unfortunately, recent work has shown that strong adversarial predictors can still exhibit unfairness by…

Machine Learning · Computer Science 2022-03-21 Mislav Balunović , Anian Ruoss , Martin Vechev

In quantum mechanics, a norm squared wave function can be interpreted as the probability density that describes the likelihood of a particle to be measured in a given position or momentum. This statistical property is at the core of the…

Machine Learning · Computer Science 2020-11-12 Ying-Tao Luo , Peng-Qi Li , Dong-Ting Li , Yu-Gui Peng , Zhi-Guo Geng , Shu-Huan Xie , Yong Li , Andrea Alu , Jie Zhu , Xue-Feng Zhu

Diffusion (score-based) generative models have been widely used for modeling various types of complex data, including images, audios, and point clouds. Recently, the deep connection between forward-backward stochastic differential equations…

Machine Learning · Computer Science 2022-06-22 Weitao Du , Tao Yang , He Zhang , Yuanqi Du

Unsupervised anomaly detection is often framed around two widely studied paradigms. Deep one-class classification, exemplified by Deep SVDD, learns compact latent representations of normality, while density estimators realized by…

Machine Learning · Computer Science 2025-10-13 Faried Abu Zaid , Tim Katzke , Emmanuel Müller , Daniel Neider

Beyond their origin in modeling many-body quantum systems, tensor networks have emerged as a promising class of models for solving machine learning problems, notably in unsupervised generative learning. While possessing many desirable…

Machine Learning · Computer Science 2024-07-26 Alex Meiburg , Jing Chen , Jacob Miller , Raphaëlle Tihon , Guillaume Rabusseau , Alejandro Perdomo-Ortiz

A new family of compound Poisson distribution functions from statistical linguistic is used to study the n-tuples and nucleotide composition features of DNA sequences. The relative frequency distribution of the 6-tuples and 7- tuples…

Statistical Mechanics · Physics 2007-05-23 K. L. Ng , S. P. Li

Normalizing flows provide an elegant approach to generative modeling that allows for efficient sampling and exact density evaluation of unknown data distributions. However, current techniques have significant limitations in their…

Machine Learning · Computer Science 2022-06-22 Sahil Sidheekh , Chris B. Dock , Tushar Jain , Radu Balan , Maneesh K. Singh

Classification and probability estimation are fundamental tasks with broad applications across modern machine learning and data science, spanning fields such as biology, medicine, engineering, and computer science. Recent development of…

Methodology · Statistics 2026-03-25 Liyun Zeng , Hao Helen Zhang

We introduce a class of neural networks derived from probabilistic models in the form of Bayesian belief networks. By imposing additional assumptions about the nature of the probabilistic models represented in the belief networks, we derive…

Disordered Systems and Neural Networks · Physics 2007-05-23 M. J. Barber , J. W. Clark , C. H. Anderson

We propose a wide class of preferential attachment models of random graphs, generalizing previous approaches. Graphs described by these models obey the power-law degree distribution, with the exponent that can be controlled in the models.…

Combinatorics · Mathematics 2015-05-20 Liudmila Ostroumova , Alexander Ryabchenko , Egor Samosvat

Spiking Neural Networks (SNN) are models for "realistic" neuronal computation, which makes them somehow different in scope from "ordinary" deep-learning models widely used in AI platforms nowadays. SNNs focus on timed latency (and possibly…

Artificial Intelligence · Computer Science 2025-06-17 Zhen Yao , Elisabetta De Maria , Robert De Simone

Generative models for classification use the joint probability distribution of the class variable and the features to construct a decision rule. Among generative models, Bayesian networks and naive Bayes classifiers are the most commonly…

Artificial Intelligence · Computer Science 2022-08-05 Federico Carli , Manuele Leonelli , Gherardo Varando

Methods based on Deep Learning have recently been applied on astrophysical parameter recovery thanks to their ability to capture information from complex data. One of these methods is the approximate Bayesian Neural Networks (BNNs) which…

Instrumentation and Methods for Astrophysics · Physics 2023-06-21 Héctor J. Hortúa , Luz Ángela García , Leonardo Castañeda C

The smooth piecewise-linear models cover a wide range of applications nowadays. Basically, there are two classes of them: models are transitional or hyperbolic according to their behaviour at the phase-transition zones. This study explored…

Methodology · Statistics 2020-11-17 Ferreira , Iuri Emmanuel de Paula , Zocchi , Silvio Sandoval

Neural processes are a family of probabilistic models that inherit the flexibility of neural networks to parameterize stochastic processes. Despite providing well-calibrated predictions, especially in regression problems, and quick…

Machine Learning · Computer Science 2023-07-04 Peiman Mohseni , Nick Duffield , Bani Mallick , Arman Hasanzadeh

Normalizing flows are a powerful class of generative models for continuous random variables, showing both strong model flexibility and the potential for non-autoregressive generation. These benefits are also desired when modeling discrete…

Machine Learning · Statistics 2019-06-06 Zachary M. Ziegler , Alexander M. Rush

In many real-world scenarios, it is crucial to be able to reliably and efficiently reason under uncertainty while capturing complex relationships in data. Probabilistic circuits (PCs), a prominent family of tractable probabilistic models,…

Machine Learning · Computer Science 2023-12-14 Zhongjie Yu , Martin Trapp , Kristian Kersting