English
Related papers

Related papers: Hyperbolic sentence representations for solving Te…

200 papers

This work presents a reformulation of the recently proposed Wasserstein autoencoder framework on a non-Euclidean manifold, the Poincar\'e ball model of the hyperbolic space. By assuming the latent space to be hyperbolic, we can use its…

Machine Learning · Computer Science 2020-03-18 Ivan Ovinnikov

Hyperbolic neural networks can effectively capture the inherent hierarchy of graph datasets, and consequently a powerful choice of GNNs. However, they entangle multiple incongruent (gyro-)vector spaces within a layer, which makes them…

Machine Learning · Computer Science 2023-06-07 Mehrdad Khatir , Nurendra Choudhary , Sutanay Choudhury , Khushbu Agarwal , Chandan K. Reddy

Given the exponential growth of the volume of the ball w.r.t. its radius, the hyperbolic space is capable of embedding trees with arbitrarily small distortion and hence has received wide attention for representing hierarchical datasets.…

Machine Learning · Computer Science 2024-12-25 Gal Mishne , Zhengchao Wan , Yusu Wang , Sheng Yang

Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior…

Machine Learning · Computer Science 2018-06-08 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

Recent research in representation learning has shown that hierarchical data lends itself to low-dimensional and highly informative representations in hyperbolic space. However, even if hyperbolic embeddings have gathered attention in image…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Gabriel Moreira , Manuel Marques , João Paulo Costeira , Alexander Hauptmann

Hyperbolic space has become a popular choice of manifold for representation learning of various datatypes from tree-like structures and text to graphs. Building on the success of deep learning with prototypes in Euclidean and hyperspherical…

Machine Learning · Computer Science 2021-11-25 Mina Ghadimi Atigh , Martin Keller-Ressel , Pascal Mettes

Embedded topic models are able to learn interpretable topics even with large and heavy-tailed vocabularies. However, they generally hold the Euclidean embedding space assumption, leading to a basic limitation in capturing hierarchical…

Information Retrieval · Computer Science 2022-10-20 Yishi Xu , Dongsheng Wang , Bo Chen , Ruiying Lu , Zhibin Duan , Mingyuan Zhou

A hyperbolic space has been shown to be more capable of modeling complex networks than a Euclidean space. This paper proposes an explicit update rule along geodesics in a hyperbolic space. The convergence of our algorithm is theoretically…

Machine Learning · Statistics 2018-05-29 Yosuke Enokida , Atsushi Suzuki , Kenji Yamanishi

Representing data in hyperbolic space can effectively capture latent hierarchical relationships. With the goal of enabling accurate classification of points in hyperbolic space while respecting their hyperbolic geometry, we introduce…

Machine Learning · Computer Science 2018-06-04 Hyunghoon Cho , Benjamin DeMeo , Jian Peng , Bonnie Berger

Learning embeddings of entities and relations existing in knowledge bases allows the discovery of hidden patterns in data. In this work, we examine the geometrical space's contribution to the task of knowledge base completion. We focus on…

Computation and Language · Computer Science 2019-08-20 Prodromos Kolyvakis , Alexandros Kalousis , Dimitris Kiritsis

With the rapid development of text-to-image generation technology, accurately assessing the alignment between generated images and text prompts has become a critical challenge. Existing methods rely on Euclidean space metrics, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Wenzhi Chen , Bo Hu , Leida Li , Lihuo He , Wen Lu , Xinbo Gao

We introduce the use of Poincar\'e embeddings to improve existing state-of-the-art approaches to domain-specific taxonomy induction from text as a signal for both relocating wrong hyponym terms within a (pre-induced) taxonomy as well as for…

Computation and Language · Computer Science 2019-06-06 Rami Aly , Shantanu Acharya , Alexander Ossa , Arne Köhn , Chris Biemann , Alexander Panchenko

How can we represent hierarchical information present in large type inventories for entity typing? We study the ability of hyperbolic embeddings to capture hierarchical relations between mentions in context and their target types in a…

Computation and Language · Computer Science 2019-06-07 Federico López , Benjamin Heinzerling , Michael Strube

Learning the representation of data with hierarchical structures in the hyperbolic space attracts increasing attention in recent years. Due to the constant negative curvature, the hyperbolic space resembles tree metrics and captures the…

Machine Learning · Computer Science 2022-02-21 Huiru Xiao , Caigao Jiang , Yangqiu Song , James Zhang , Junwu Xiong

The black-box nature of deep learning models in NLP hinders their widespread application. The research focus has shifted to Hierarchical Attribution (HA) for its ability to model feature interactions. Recent works model non-contiguous…

Computation and Language · Computer Science 2024-06-13 Qian Chen , Dongyang Li , Xiaofeng He , Hongzhao Li , Hongyu Yi

Words are not created equal. In fact, they form an aristocratic graph with a latent hierarchical structure that the next generation of unsupervised learned word embeddings should reveal. In this paper, justified by the notion of…

Computation and Language · Computer Science 2018-11-26 Alexandru Tifrea , Gary Bécigneul , Octavian-Eugen Ganea

We are concerned with the discovery of hierarchical relationships from large-scale unstructured similarity scores. For this purpose, we study different models of hyperbolic space and find that learning embeddings in the Lorentz model is…

Artificial Intelligence · Computer Science 2018-07-10 Maximilian Nickel , Douwe Kiela

Learning fine-grained embeddings from coarse labels is a challenging task due to limited label granularity supervision, i.e., lacking the detailed distinctions required for fine-grained tasks. The task becomes even more demanding when…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Shu-Lin Xu , Yifan Sun , Faen Zhang , Anqi Xu , Xiu-Shen Wei , Yi Yang

Most real-world datasets consist of a natural hierarchy between classes or an inherent label structure that is either already available or can be constructed cheaply. However, most existing representation learning methods ignore this…

Machine Learning · Computer Science 2024-12-03 Aditya Sinha , Siqi Zeng , Makoto Yamada , Han Zhao

For natural language understanding and generation, embedding concepts using an order-based representation is an essential task. Unlike traditional point vector based representation, an order-based representation imposes geometric…

Computation and Language · Computer Science 2024-04-18 Croix Gyurek , Niloy Talukder , Mohammad Al Hasan