English
Related papers

Related papers: Approximating exponential family models (not singl…

200 papers

We investigate a generic problem of learning pairwise exponential family graphical models with pairwise sufficient statistics defined by a global mapping function, e.g., Mercer kernels. This subclass of pairwise graphical models allow us to…

Machine Learning · Statistics 2013-11-25 Xiao-Tong Yuan , Ping Li , Tong Zhang

Networks are mathematical structures that are universally used to describe a large variety of complex systems such as the brain or the Internet. Characterizing the geometrical properties of these networks has become increasingly relevant…

Physics and Society · Physics 2015-05-26 Zhihao Wu , Giulia Menichetti , Christoph Rahmede , Ginestra Bianconi

It is well established that neural networks with deep architectures perform better than shallow networks for many tasks in machine learning. In statistical physics, while there has been recent interest in representing physical data with…

Disordered Systems and Neural Networks · Physics 2019-03-06 Alan Morningstar , Roger G. Melko

Recursive Neural Networks are non-linear adaptive models that are able to learn deep structured information. However, these models have not yet been broadly accepted. This fact is mainly due to its inherent complexity. In particular, not…

Neural and Evolutionary Computing · Computer Science 2009-11-18 Alejandro Chinea

Without any assumptions about data generation, multiple causal models may explain our observations equally well. To avoid selecting a single arbitrary model that could result in unsafe decisions if it does not match reality, it is therefore…

Machine Learning · Computer Science 2025-01-13 Tristan Deleu

Generative Adversarial Networks have shown remarkable success in learning a distribution that faithfully recovers a reference distribution in its entirety. However, in some cases, we may want to only learn some aspects (e.g., cluster or…

Machine Learning · Computer Science 2019-05-16 Charlotte Bunne , David Alvarez-Melis , Andreas Krause , Stefanie Jegelka

Generative flow networks (GFlowNets) are a family of algorithms that learn a generative policy to sample discrete objects $x$ with non-negative reward $R(x)$. Learning objectives guarantee the GFlowNet samples $x$ from the target…

Machine Learning · Computer Science 2023-05-15 Max W. Shen , Emmanuel Bengio , Ehsan Hajiramezanali , Andreas Loukas , Kyunghyun Cho , Tommaso Biancalani

The growing availability of network data and of scientific interest in distributed systems has led to the rapid development of statistical models of network structure. Typically, however, these are models for the entire network, while the…

Statistics Theory · Mathematics 2022-03-18 Cosma Rohilla Shalizi , Alessandro Rinaldo

The {\lambda}-exponential family has recently been proposed to generalize the exponential family. While the exponential family is well-understood and widely used, this it not the case of the {\lambda}-exponential family. However, many…

Statistics Theory · Mathematics 2024-06-21 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

Bayesian learning has been recently considered as an effective means of accounting for uncertainty in trained deep network parameters. This is of crucial importance when dealing with small or sparse training datasets. On the other hand,…

Machine Learning · Computer Science 2018-02-13 Harris Partaourides , Sotirios Chatzis

A principled approach to understand network structures is to formulate generative models. Given a collection of models, however, an outstanding key task is to determine which one provides a more accurate description of the network at hand,…

Machine Learning · Statistics 2018-06-29 Toni Vallès-Català , Tiago P. Peixoto , Roger Guimerà , Marta Sales-Pardo

Modeling the complex interactions of systems of particles or agents is a fundamental scientific and mathematical problem that is studied in diverse fields, ranging from physics and biology, to economics and machine learning. In this work,…

Machine Learning · Statistics 2020-10-09 Jason Miller , Sui Tang , Ming Zhong , Mauro Maggioni

Information spreads across social and technological networks, but often the network structures are hidden from us and we only observe the traces left by the diffusion processes, called cascades. Can we recover the hidden network structures…

Social and Information Networks · Computer Science 2014-05-14 Hadi Daneshmand , Manuel Gomez-Rodriguez , Le Song , Bernhard Schoelkopf

Empirical evidence suggests that heavy-tailed degree distributions occurring in many real networks are well-approximated by power laws with exponents $\eta$ that may take values either less than and greater than two. Models based on various…

Machine Learning · Statistics 2018-07-10 Benjamin Bloem-Reddy , Adam Foster , Emile Mathieu , Yee Whye Teh

Deep learning models have gained great success in many real-world applications. However, most existing networks are typically designed in heuristic manners, thus lack of rigorous mathematical principles and derivations. Several recent…

Computer Vision and Pattern Recognition · Computer Science 2017-12-18 Risheng Liu , Xin Fan , Shichao Cheng , Xiangyu Wang , Zhongxuan Luo

Matrix completion is one of the key problems in signal processing and machine learning, with applications ranging from image pro- cessing and data gathering to classification and recommender sys- tems. Recently, deep neural networks have…

Machine Learning · Statistics 2018-05-15 Duc Minh Nguyen , Evaggelia Tsiligianni , Nikos Deligiannis

Exponential random graph models (ERGMs) are a widely used framework for network data, enabling hypothesis testing on the structural mechanisms underlying observed networks. Bayesian ERGMs provide principled uncertainty quantification and…

Methodology · Statistics 2026-05-26 Alberto Caimo , Isabella Gollini

In numerous instances, the generalized exponential distribution can be used as an alternative to the most widely used non-regular family of distributions: Weibull, gamma, lognormal with three-parameters when analyzing lifetime or any skewed…

Methodology · Statistics 2026-03-03 Kiran Prajapat , Sharmishtha Mitra , Debasis Kundu

Exponential-family Random Graph Models (ERGMs) constitute a large statistical framework for modeling sparse and dense random graphs, short- and long-tailed degree distributions, covariates, and a wide range of complex dependencies. Special…

Methodology · Statistics 2021-05-21 Michael Schweinberger , Pavel N. Krivitsky , Carter T. Butts , Jonathan Stewart

Typical amortized inference in variational autoencoders is specialized for a single probabilistic query. Here we propose an inference network architecture that generalizes to unseen probabilistic queries. Instead of an encoder-decoder pair,…

Machine Learning · Computer Science 2019-12-09 Miguel Lazaro-Gredilla , Wolfgang Lehrach , Dileep George