English
Related papers

Related papers: Squared Neural Families: A New Class of Tractable …

200 papers

We introduce a new family of random compact metric spaces $\mathcal{S}_\alpha$ for $\alpha\in(1,2)$, which we call stable shredded spheres. They are constructed from excursions of $\alpha$-stable L\'evy processes on $[0,1]$ possessing no…

Probability · Mathematics 2021-05-27 Jakob Björnberg , Nicolas Curien , Sigurdur Örn Stefánsson

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

Normalizing flows and variational autoencoders are powerful generative models that can represent complicated density functions. However, they both impose constraints on the models: Normalizing flows use bijective transformations to model…

Machine Learning · Computer Science 2020-11-02 Didrik Nielsen , Priyank Jaini , Emiel Hoogeboom , Ole Winther , Max Welling

Normalizing flows are a flexible class of probability distributions, expressed as transformations of a simple base distribution. A limitation of standard normalizing flows is representing distributions with heavy tails, which arise in…

Machine Learning · Statistics 2025-06-13 Tennessee Hickling , Dennis Prangle

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Signal Processing · Electrical Eng. & Systems 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Density estimation, a central problem in machine learning, can be performed using Normalizing Flows (NFs). NFs comprise a sequence of invertible transformations, that turn a complex target distribution into a simple one, by exploiting the…

Machine Learning · Computer Science 2024-01-04 Massimiliano Patacchiola , Aliaksandra Shysheya , Katja Hofmann , Richard E. Turner

interpretable, and well understood models that are routinely employed even though, as is revealed through prior and posterior predictive checks, these can poorly characterise the spatial heterogeneity in the underlying process of interest.…

Machine Learning · Statistics 2024-04-08 Andrew Zammit-Mangion , Michael D. Kaminski , Ba-Hien Tran , Maurizio Filippone , Noel Cressie

A new class of distributions, called as normal power series (NPS), which contains the normal one as a particular case, is introduced in this paper. This new class which is obtained by compounding the normal and power series distributions,…

Methodology · Statistics 2015-10-27 Eisa Mahmoudi , Hamed Mahmoodian

We present PPCEF, a novel method for generating probabilistically plausible counterfactual explanations (CFs). PPCEF advances beyond existing methods by combining a probabilistic formulation that leverages the data distribution with the…

Machine Learning · Computer Science 2025-12-16 Patryk Wielopolski , Oleksii Furman , Jerzy Stefanowski , Maciej Zięba

The kernel exponential family is a rich class of distributions, which can be fit efficiently and with statistical guarantees by score matching. Being required to choose a priori a simple kernel such as the Gaussian, however, limits its…

Machine Learning · Statistics 2021-01-15 Li Wenliang , Danica J. Sutherland , Heiko Strathmann , Arthur Gretton

Modeling sets is an important problem in machine learning since this type of data can be found in many domains. A promising approach defines a family of permutation invariant densities with continuous normalizing flows. This allows us to…

Machine Learning · Computer Science 2021-07-01 Marin Biloš , Stephan Günnemann

Our universe is homogeneous and isotropic, and its perturbations obey translation and rotation symmetry. In this work we develop Translation and Rotation Equivariant Normalizing Flow (TRENF), a generative Normalizing Flow (NF) model which…

Cosmology and Nongalactic Astrophysics · Physics 2022-08-03 Biwei Dai , Uros Seljak

Guiding the design of neural networks is of great importance to save enormous resources consumed on empirical decisions of architectural parameters. This paper constructs shallow sigmoid-type neural networks that achieve 100% accuracy in…

Machine Learning · Computer Science 2019-04-22 Youngjae Min , Hye Won Chung

Treating neural network inputs and outputs as random variables, we characterize the structure of neural networks that can be used to model data that are invariant or equivariant under the action of a compact group. Much recent research has…

Machine Learning · Statistics 2020-09-18 Benjamin Bloem-Reddy , Yee Whye Teh

A new robust class of multivariate skew distributions is introduced. Practical aspects such as parameter estimation method of the proposed class are discussed, we show that the proposed class can be fitted under a reasonable time frame. Our…

Methodology · Statistics 2020-11-17 H. Kwong , S. Nadarajah

In the past few years, deep generative models, such as generative adversarial networks \autocite{GAN}, variational autoencoders \autocite{vaepaper}, and their variants, have seen wide adoption for the task of modelling complex data…

Machine Learning · Statistics 2020-09-02 Guilherme G. P. Freitas Pires , Mário A. T. Figueiredo

Neuromorphic hardware platforms, such as Intel's Loihi chip, support the implementation of Spiking Neural Networks (SNNs) as an energy-efficient alternative to Artificial Neural Networks (ANNs). SNNs are networks of neurons with internal…

Machine Learning · Computer Science 2019-12-19 Hyeryung Jang , Osvaldo Simeone

Stable random variables are motivated by the central limit theorem for densities with (potentially) unbounded variance and can be thought of as natural generalizations of the Gaussian distribution to skewed and heavy-tailed phenomenon. In…

Machine Learning · Computer Science 2014-04-17 Navodit Misra , Ercan E. Kuruoglu

Conjugate pairs of distributions over infinite dimensional spaces are prominent in statistical learning theory, particularly due to the widespread adoption of Bayesian nonparametric methodologies for a host of models and applications. Much…

Machine Learning · Computer Science 2016-01-12 Robert Finn , Brian Kulis

In this article we study the existence and uniqueness of strong solutions of a class of parameterized family of SDEs driven by L\'evy noise. These SDEs occurs in connection with a class of stochastic PDEs, which take values in the space of…

Probability · Mathematics 2018-01-23 Suprio Bhar , Barun Sarkar