English
Related papers

Related papers: Hyperbolic Attention Networks

200 papers

Recent papers in the graph machine learning literature have introduced a number of approaches for hyperbolic representation learning. The asserted benefits are improved performance on a variety of graph tasks, node classification and link…

Machine Learning · Computer Science 2025-02-26 Isay Katsman , Anna Gilbert

Due to its geometric properties, hyperbolic space can support high-fidelity embeddings of tree- and graph-structured data, upon which various hyperbolic networks have been developed. Existing hyperbolic networks encode geometric priors not…

Machine Learning · Computer Science 2023-03-14 Tao Yu , Christopher De Sa

Hyperbolic embeddings are a class of representation learning methods that offer competitive performances when data can be abstracted as a tree-like graph. However, in practice, learning hyperbolic embeddings of hierarchical data is…

Machine Learning · Computer Science 2024-07-24 Zhangyu Wang , Lantian Xu , Zhifeng Kong , Weilong Wang , Xuyu Peng , Enyang Zheng

Graph convolutional neural networks (GCNs) embed nodes in a graph into Euclidean space, which has been shown to incur a large distortion when embedding real-world graphs with scale-free or hierarchical structure. Hyperbolic geometry offers…

Machine Learning · Computer Science 2019-10-30 Ines Chami , Rex Ying , Christopher Ré , Jure Leskovec

Learning low-dimensional numerical representations from symbolic data, e.g., embedding the nodes of a graph into a geometric space, is an important concept in machine learning. While embedding into Euclidean space is common, recent…

Machine Learning · Computer Science 2024-10-10 Thomas Bläsius , Jean-Pierre von der Heydt , Maximilian Katzmann , Nikolai Maas

Knowledge hypergraphs generalize knowledge graphs using hyperedges to connect multiple entities and depict complicated relations. Existing methods either transform hyperedges into an easier-to-handle set of binary relations or view…

Machine Learning · Computer Science 2024-12-18 Mengfan Li , Xuanhua Shi , Chenqi Qiao , Teng Zhang , Hai Jin

Neural embeddings have been used with great success in Natural Language Processing (NLP). They provide compact representations that encapsulate word similarity and attain state-of-the-art performance in a range of linguistic tasks. The…

Machine Learning · Statistics 2018-09-20 Benjamin Paul Chamberlain , James Clough , Marc Peter Deisenroth

In heterogeneous graphs, we can observe complex structures such as tree-like or hierarchical structures. Recently, the hyperbolic space has been widely adopted in many studies to effectively learn these complex structures. Although these…

Machine Learning · Computer Science 2026-01-14 Jongmin Park , Seunghoon Han , Hyewon Lee , Won-Yong Shin , Sungsu Lim

Embedding into hyperbolic space is emerging as an effective representation technique for datasets that exhibit hierarchical structure. This development motivates the need for algorithms that are able to effectively extract knowledge and…

Data Structures and Algorithms · Computer Science 2020-09-03 Xian Wu , Moses Charikar

Learning from graph-structured data is an important task in machine learning and artificial intelligence, for which Graph Neural Networks (GNNs) have shown great promise. Motivated by recent advances in geometric representation learning, we…

Machine Learning · Computer Science 2019-10-30 Qi Liu , Maximilian Nickel , Douwe Kiela

The recent reconstruction of the Drosophila brain provides a neural network of unprecedented size and level of details. In this work, we study the geometrical properties of this system by applying network embedding techniques to the graph…

Physics and Society · Physics 2026-02-19 Bendegúz Sulyok , Sámuel G. Balogh , Gergely Palla

Finding a low dimensional representation of hierarchical, structured data described by a network remains a challenging problem in the machine learning community. An emerging approach is embedding these networks into hyperbolic space because…

Social and Information Networks · Computer Science 2019-05-03 David McDonald , Shan He

Binary Neural Network (BNN) converts full-precision weights and activations into their extreme 1-bit counterparts, making it particularly suitable for deployment on lightweight mobile devices. While binary neural networks are typically…

Machine Learning · Computer Science 2025-01-08 Jun Chen , Jingyang Xiang , Tianxin Huang , Xiangrui Zhao , Yong Liu

To leverage the complex structures within heterogeneous graphs, recent studies on heterogeneous graph embedding use a hyperbolic space, characterized by a constant negative curvature and exponentially increasing space, which aligns with the…

Machine Learning · Computer Science 2025-06-23 Jongmin Park , Seunghoon Han , Jong-Ryul Lee , Sungsu Lim

Capturing associations for knowledge graphs (KGs) through entity alignment, entity type inference and other related tasks benefits NLP applications with comprehensive knowledge representations. Recent related methods built on Euclidean…

Computation and Language · Computer Science 2020-10-06 Zequn Sun , Muhao Chen , Wei Hu , Chengming Wang , Jian Dai , Wei Zhang

Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior…

Machine Learning · Computer Science 2018-06-08 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

The choice of geometric space for knowledge graph (KG) embeddings can have significant effects on the performance of KG completion tasks. The hyperbolic geometry has been shown to capture the hierarchical patterns due to its tree-like…

Machine Learning · Computer Science 2022-11-08 Huiru Xiao , Xin Liu , Yangqiu Song , Ginny Y. Wong , Simon See

Network data is ubiquitous in various scientific disciplines, including sociology, economics, and neuroscience. Latent space models are often employed in network data analysis, but the geometric effect of latent space curvature remains a…

Methodology · Statistics 2026-02-11 Jinming Li , Gongjun Xu , Ji Zhu

Hyperbolic Neural Networks (HNNs), operating in hyperbolic space, have been widely applied in recent years, motivated by the existence of an optimal embedding in hyperbolic space that can preserve data hierarchical relationships (termed…

Machine Learning · Computer Science 2024-02-06 Shicheng Tan , Huanjing Zhao , Shu Zhao , Yanping Zhang

Finding the optimal embedding of networks into low-dimensional hyperbolic spaces is a challenge that received considerable interest in recent years, with several different approaches proposed in the literature. In general, these methods…

Physics and Society · Physics 2024-01-08 Bendegúz Sulyok , Gergely Palla