English
Related papers

Related papers: Poincar\'e Wasserstein Autoencoder

200 papers

Artificial neural networks have become important to improve the search for admissible string compactifications and characterize them. In this paper we construct the heterotic orbiencoder, a general deep autoencoder to study heterotic…

High Energy Physics - Theory · Physics 2024-01-31 Enrique Escalante-Notario , Ignacio Portillo-Castillo , Saul Ramos-Sanchez

Deep latent variable models, trained using variational autoencoders or generative adversarial networks, are now a key technique for representation learning of continuous structures. However, applying similar methods to discrete structures,…

Machine Learning · Computer Science 2018-07-02 Jake Zhao , Yoon Kim , Kelly Zhang , Alexander M. Rush , Yann LeCun

Hierarchy is a natural representation of semantic taxonomies, including the ones routinely used in image segmentation. Indeed, recent work on semantic segmentation reports improved accuracy from supervised training leveraging hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Simon Weber , Barış Zöngür , Nikita Araslanov , Daniel Cremers

Measuring the similarity between data points often requires domain knowledge, which can in parts be compensated by relying on unsupervised methods such as latent-variable models, where similarity/distance is estimated in a more compact…

Machine Learning · Statistics 2020-08-13 Nutan Chen , Alexej Klushyn , Francesco Ferroni , Justin Bayer , Patrick van der Smagt

The dynamics of a turbulent flow tend to occupy only a portion of the phase space at a statistically stationary regime. From a dynamical systems point of view, this portion is the attractor. The knowledge of the turbulent attractor is…

Fluid Dynamics · Physics 2022-12-05 Luca Magri , Anh Khoa Doan

Most real-world datasets consist of a natural hierarchy between classes or an inherent label structure that is either already available or can be constructed cheaply. However, most existing representation learning methods ignore this…

Machine Learning · Computer Science 2024-12-03 Aditya Sinha , Siqi Zeng , Makoto Yamada , Han Zhao

Deep embedding methods have influenced many areas of unsupervised learning. However, the best methods for learning hierarchical structure use non-Euclidean representations, whereas Euclidean geometry underlies the theory behind many…

Machine Learning · Computer Science 2020-11-02 Jinyu Zhao , Yi Hao , Cyrus Rashtchian

This paper presents the geometric aspect of the autoencoder framework, which, despite its importance, has been relatively less recognized. Given a set of high-dimensional data points that approximately lie on some lower-dimensional…

Machine Learning · Computer Science 2023-09-28 Yonghyeon Lee

This paper focuses on the problem of unsupervised alignment of hierarchical data such as ontologies or lexical databases. This is a problem that appears across areas, from natural language processing to bioinformatics, and is typically…

Machine Learning · Computer Science 2020-05-11 David Alvarez-Melis , Youssef Mroueh , Tommi S. Jaakkola

Machine-learning models have demonstrated a great ability to learn complex patterns and make predictions. In high-dimensional nonlinear problems of fluid dynamics, data representation often greatly affects the performance and…

Fluid Dynamics · Physics 2022-07-29 Runze Li , Yufei Zhang , Haixin Chen

On the hyperbolic space, we study a semilinear equation with non-autonomous nonlinearity having a critical Sobolev exponent. The Poincar\'e-Sobolev equation on the hyperbolic space explored by Mancini and Sandeep [Ann. Sc. Norm. Super. Pisa…

Analysis of PDEs · Mathematics 2024-10-07 Mousomi Bhakta , Debdip Ganguly , Diksha Gupta , Alok Kumar Sahoo

Model reduction of high-dimensional dynamical systems alleviates computational burdens faced in various tasks from design optimization to model predictive control. One popular model reduction approach is based on projecting the governing…

Dynamical Systems · Mathematics 2018-08-24 Francisco J. Gonzalez , Maciej Balajewicz

A rich class of network models associate each node with a low-dimensional latent coordinate that controls the propensity for connections to form. Models of this type are well established in the network analysis literature, where it is…

Methodology · Statistics 2022-02-11 Marios Papamichalis , Kathryn Turnbull , Simon Lunagomez , Edoardo Airoldi

Probabilistic models with discrete latent variables naturally capture datasets composed of discrete classes. However, they are difficult to train efficiently, since backpropagation through discrete variables is generally not possible. We…

Machine Learning · Statistics 2017-04-25 Jason Tyler Rolfe

Deep generative networks have been widely used for learning mappings from a low-dimensional latent space to a high-dimensional data space. In many cases, data transformations are defined by linear paths in this latent space. However, the…

Machine Learning · Statistics 2019-12-06 Marissa Connor , Christopher Rozell

Approximating distributions over complicated manifolds, such as natural images, are conceptually attractive. The deep latent variable model, trained using variational autoencoders and generative adversarial networks, is now a key technique…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Wenju Xu , Shawn Keshmiri , Guanghui Wang

Hyperbolic space is a geometry that is known to be well-suited for representation learning of data with an underlying hierarchical structure. In this paper, we present a novel hyperbolic distribution called \textit{pseudo-hyperbolic…

Machine Learning · Statistics 2019-05-13 Yoshihiro Nagano , Shoichiro Yamaguchi , Yasuhiro Fujita , Masanori Koyama

We propose a Gaussian manifold variational auto-encoder (GM-VAE) whose latent space consists of a set of Gaussian distributions. It is known that the set of the univariate Gaussian distributions with the Fisher information metric form a…

Machine Learning · Computer Science 2023-10-31 Seunghyuk Cho , Juyong Lee , Dongwoo Kim

Foundation models pre-trained on massive datasets, including large language models (LLMs), vision-language models (VLMs), and large multimodal models, have demonstrated remarkable success in diverse downstream tasks. However, recent studies…

Machine Learning · Computer Science 2025-07-25 Neil He , Hiren Madhu , Ngoc Bui , Menglin Yang , Rex Ying

Recently, there has been an interest in embedding networks in hyperbolic space, since hyperbolic space has been shown to work well in capturing graph/network structure as it can naturally reflect some properties of complex networks.…

Social and Information Networks · Computer Science 2020-11-04 Lili Wang , Ying Lu , Chenghan Huang , Soroush Vosoughi