English
Related papers

Related papers: Latent Variable Modelling with Hyperbolic Normaliz…

200 papers

Recently, there has been a surge of interest in representation learning in hyperbolic spaces, driven by their ability to represent hierarchical data with significantly fewer dimensions than standard Euclidean spaces. However, the viability…

Machine Learning · Computer Science 2022-11-02 Melanie Weber , Manzil Zaheer , Ankit Singh Rawat , Aditya Menon , Sanjiv Kumar

Hyperbolic neural networks have been popular in the recent past due to their ability to represent hierarchical data sets effectively and efficiently. The challenge in developing these networks lies in the nonlinearity of the embedding space…

Machine Learning · Computer Science 2021-12-08 Xiran Fan , Chun-Hao Yang , Baba C. Vemuri

In the past few years, deep generative models, such as generative adversarial networks \autocite{GAN}, variational autoencoders \autocite{vaepaper}, and their variants, have seen wide adoption for the task of modelling complex data…

Machine Learning · Statistics 2020-09-02 Guilherme G. P. Freitas Pires , Mário A. T. Figueiredo

Diffusion generative models (DMs) have achieved promising results in image and graph generation. However, real-world graphs, such as social networks, molecular graphs, and traffic graphs, generally share non-Euclidean topologies and hidden…

Machine Learning · Computer Science 2024-01-04 Lingfeng Wen , Xuan Tang , Mingjie Ouyang , Xiangxiang Shen , Jian Yang , Daxin Zhu , Mingsong Chen , Xian Wei

Hyperbolic neural networks have emerged as a powerful tool for modeling hierarchical data structures prevalent in real-world datasets. Notably, residual connections, which facilitate the direct flow of information across layers, have been…

Machine Learning · Computer Science 2025-01-14 Neil He , Menglin Yang , Rex Ying

Normalizing flows, which learn a distribution by transforming the data to samples from a Gaussian base distribution, have proven powerful density approximations. But their expressive power is limited by this choice of the base distribution.…

Machine Learning · Computer Science 2021-07-16 Mike Laszkiewicz , Johannes Lederer , Asja Fischer

A rich class of network models associate each node with a low-dimensional latent coordinate that controls the propensity for connections to form. Models of this type are well established in the network analysis literature, where it is…

Methodology · Statistics 2022-02-11 Marios Papamichalis , Kathryn Turnbull , Simon Lunagomez , Edoardo Airoldi

Human motion taxonomies serve as high-level hierarchical abstractions that classify how humans move and interact with their environment. They have proven useful to analyse grasps, manipulation skills, and whole-body support poses. Despite…

This paper presents a novel framework for aligning learnable latent spaces to arbitrary target distributions by leveraging flow-based generative models as priors. Our method first pretrains a flow model on the target features to capture the…

Machine Learning · Computer Science 2026-03-17 Yizhuo Li , Yuying Ge , Yixiao Ge , Ying Shan , Ping Luo

We present a framework for learning probability distributions on topologically non-trivial manifolds, utilizing normalizing flows. Current methods focus on manifolds that are homeomorphic to Euclidean space, enforce strong structural priors…

Machine Learning · Computer Science 2022-07-12 Dimitris Kalatzis , Johan Ziruo Ye , Alison Pouplin , Jesper Wohlert , Søren Hauberg

Initial work on variational autoencoders assumed independent latent variables with simple distributions. Subsequent work has explored incorporating more complex distributions and dependency structures: including normalizing flows in the…

Machine Learning · Computer Science 2022-04-27 Jacobie Mouton , Steve Kroon

Hyperbolic space can naturally embed hierarchies, unlike Euclidean space. Hyperbolic Neural Networks (HNNs) exploit such representational power by lifting Euclidean features into hyperbolic space for classification, outperforming Euclidean…

Machine Learning · Computer Science 2022-05-17 Yunhui Guo , Xudong Wang , Yubei Chen , Stella X. Yu

Based on the manifold hypothesis, real-world data often lie on a low-dimensional manifold, while normalizing flows as a likelihood-based generative model are incapable of finding this manifold due to their structural constraints. So, one…

Machine Learning · Computer Science 2022-06-08 Seyedeh Fatemeh Razavi , Mohammad Mahdi Mehmanchi , Reshad Hosseini , Mostafa Tavassolipour

Deep Learning is mostly responsible for the surge of interest in Artificial Intelligence in the last decade. So far, deep learning researchers have been particularly successful in the domain of image processing, where Convolutional Neural…

Machine Learning · Computer Science 2023-08-31 Andrii Skliar , Maurice Weiler

Hyperbolic representations are effective in modeling knowledge graph data which is prevalently used to facilitate multi-hop reasoning. However, a rigorous and detailed comparison of the two spaces for this task is lacking. In this paper,…

Computation and Language · Computer Science 2025-07-08 Simon Welz , Lucie Flek , Akbar Karimi

In the past, normalizing generative flows have emerged as a promising class of generative models for natural images. This type of model has many modeling advantages: the ability to efficiently compute log-likelihood of the input data, fast…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Alexander Kolesnikov , André Susano Pinto , Michael Tschannen

Learning generalizable self-supervised graph representations for downstream tasks is challenging. To this end, Contrastive Learning (CL) has emerged as a leading approach. The embeddings of CL are arranged on a hypersphere where similarity…

Machine Learning · Computer Science 2025-02-25 Yifei Zhang , Hao Zhu , Menglin Yang , Jiahong Liu , Rex Ying , Irwin King , Piotr Koniusz

Hyperbolic spaces have recently gained momentum in the context of machine learning due to their high capacity and tree-likeliness properties. However, the representational power of hyperbolic geometry is not yet on par with Euclidean…

Machine Learning · Computer Science 2018-06-29 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

Normalizing flows are exact-likelihood generative neural networks which approximately transform samples from a simple prior distribution to samples of the probability distribution of interest. Recent work showed that such generative models…

Machine Learning · Statistics 2020-10-27 Jonas Köhler , Leon Klein , Frank Noé

We use hyperbolic wavelet regression for the fast reconstruction of high-dimensional functions having only low dimensional variable interactions. Compactly supported periodic Chui-Wang wavelets are used for the tensorized hyperbolic wavelet…

Numerical Analysis · Mathematics 2021-08-31 Laura Lippert , Daniel Potts , Tino Ullrich