English
Related papers

Related papers: Comparing Euclidean and Hyperbolic Embeddings on t…

200 papers

Natural language text exhibits hierarchical structure in a variety of respects. Ideally, we could incorporate our prior knowledge of this hierarchical structure into unsupervised learning algorithms that work on text data. Recent work by…

Computation and Language · Computer Science 2018-06-13 Bhuwan Dhingra , Christopher J. Shallue , Mohammad Norouzi , Andrew M. Dai , George E. Dahl

Signed network embedding methods aim to learn vector representations of nodes in signed networks. However, existing algorithms only managed to embed networks into low-dimensional Euclidean spaces whereas many intrinsic features of signed…

Machine Learning · Computer Science 2021-07-16 Wenzhuo Song , Hongxu Chen , Xueyan Liu , Hongzhe Jiang , Shengsheng Wang

Hyperbolic spaces have recently gained momentum in the context of machine learning due to their high capacity and tree-likeliness properties. However, the representational power of hyperbolic geometry is not yet on par with Euclidean…

Machine Learning · Computer Science 2018-06-29 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

Words are not created equal. In fact, they form an aristocratic graph with a latent hierarchical structure that the next generation of unsupervised learned word embeddings should reveal. In this paper, justified by the notion of…

Computation and Language · Computer Science 2018-11-26 Alexandru Tifrea , Gary Bécigneul , Octavian-Eugen Ganea

Cross-lingual word embeddings can be applied to several natural language processing applications across multiple languages. Unlike prior works that use word embeddings based on the Euclidean space, this short paper presents a simple and…

Computation and Language · Computer Science 2022-06-28 Chandni Saxena , Mudit Chaudhary , Helen Meng

Hyperbolic spaces have proven to be suitable for modeling data of hierarchical nature. As such we use the Poincare ball to embed sentences with the goal of proving how hyperbolic spaces can be used for solving Textual Entailment. To this…

Computation and Language · Computer Science 2024-06-25 Igor Petrovski

Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior…

Machine Learning · Computer Science 2018-06-08 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

Embedded topic models are able to learn interpretable topics even with large and heavy-tailed vocabularies. However, they generally hold the Euclidean embedding space assumption, leading to a basic limitation in capturing hierarchical…

Information Retrieval · Computer Science 2022-10-20 Yishi Xu , Dongsheng Wang , Bo Chen , Ruiying Lu , Zhibin Duan , Mingyuan Zhou

Hyperbolic neural networks can effectively capture the inherent hierarchy of graph datasets, and consequently a powerful choice of GNNs. However, they entangle multiple incongruent (gyro-)vector spaces within a layer, which makes them…

Machine Learning · Computer Science 2023-06-07 Mehrdad Khatir , Nurendra Choudhary , Sutanay Choudhury , Khushbu Agarwal , Chandan K. Reddy

Recent research in representation learning has shown that hierarchical data lends itself to low-dimensional and highly informative representations in hyperbolic space. However, even if hyperbolic embeddings have gathered attention in image…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Gabriel Moreira , Manuel Marques , João Paulo Costeira , Alexander Hauptmann

Learning low-dimensional numerical representations from symbolic data, e.g., embedding the nodes of a graph into a geometric space, is an important concept in machine learning. While embedding into Euclidean space is common, recent…

Machine Learning · Computer Science 2024-10-10 Thomas Bläsius , Jean-Pierre von der Heydt , Maximilian Katzmann , Nikolai Maas

Representation learning has become an invaluable approach for learning from symbolic data such as text and graphs. However, while complex symbolic datasets often exhibit a latent hierarchical structure, state-of-the-art methods typically…

Artificial Intelligence · Computer Science 2017-05-29 Maximilian Nickel , Douwe Kiela

Recent work has demonstrated that embeddings of tree-like graphs in hyperbolic space surpass their Euclidean counterparts in performance by a large margin. Inspired by these results and scale-free structure in the word co-occurrence graph,…

Computation and Language · Computer Science 2019-05-28 Matthias Leimeister , Benjamin J. Wilson

Graph-structured data are widespread in real-world applications, such as social networks, recommender systems, knowledge graphs, chemical molecules etc. Despite the success of Euclidean space for graph-related learning tasks, its ability to…

Machine Learning · Computer Science 2022-11-09 Min Zhou , Menglin Yang , Lujia Pan , Irwin King

A hyperbolic space has been shown to be more capable of modeling complex networks than a Euclidean space. This paper proposes an explicit update rule along geodesics in a hyperbolic space. The convergence of our algorithm is theoretically…

Machine Learning · Statistics 2018-05-29 Yosuke Enokida , Atsushi Suzuki , Kenji Yamanishi

Recently, a variety of probing tasks are proposed to discover linguistic properties learned in contextualized word embeddings. Many of these works implicitly assume these embeddings lay in certain metric spaces, typically the Euclidean…

Computation and Language · Computer Science 2021-04-09 Boli Chen , Yao Fu , Guangwei Xu , Pengjun Xie , Chuanqi Tan , Mosha Chen , Liping Jing

Efficient modeling of relational data arising in physical, social, and information sciences is challenging due to complicated dependencies within the data. In this work, we build off of semi-implicit graph variational auto-encoders to…

Machine Learning · Computer Science 2021-03-12 Ali Lotfi Rezaabad , Rahi Kalantari , Sriram Vishwanath , Mingyuan Zhou , Jonathan Tamir

Biomedical association studies are increasingly done using clinical concepts, and in particular diagnostic codes from clinical data repositories as phenotypes. Clinical concepts can be represented in a meaningful, vector space using word…

Quantitative Methods · Quantitative Biology 2018-11-06 Brett K. Beaulieu-Jones , Isaac S. Kohane , Andrew L. Beam

Many high-dimensional and large-volume data sets of practical relevance have hierarchical structures induced by trees, graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional…

Machine Learning · Computer Science 2021-09-16 Eli Chien , Chao Pan , Puoya Tabaghi , Olgica Milenkovic

We introduce the use of Poincar\'e embeddings to improve existing state-of-the-art approaches to domain-specific taxonomy induction from text as a signal for both relocating wrong hyponym terms within a (pre-induced) taxonomy as well as for…

Computation and Language · Computer Science 2019-06-06 Rami Aly , Shantanu Acharya , Alexander Ossa , Arne Köhn , Chris Biemann , Alexander Panchenko
‹ Prev 1 2 3 10 Next ›