English
Related papers

Related papers: Fast and Geometrically Grounded Lorentz Neural Net…

200 papers

Hyperbolic geometry have shown significant potential in modeling complex structured data, particularly those with underlying tree-like and hierarchical structures. Despite the impressive performance of various hyperbolic neural networks…

Machine Learning · Computer Science 2025-08-26 Menglin Yang , Harshit Verma , Delvin Ce Zhang , Jiahong Liu , Irwin King , Rex Ying

Large language models (LLMs) have achieved remarkable success and demonstrated superior performance across various tasks, including natural language processing (NLP), weather forecasting, biological protein folding, text generation, and…

Artificial Intelligence · Computer Science 2025-12-09 Sarang Patil , Zeyong Zhang , Yiran Huang , Tengfei Ma , Mengjia Xu

Hyperbolic geometry has emerged as an effective latent space for representing complex networks, owing to its ability to capture hierarchical organization and heterogeneous connectivity patterns using low-dimensional embeddings. As a result,…

Machine Learning · Computer Science 2026-05-01 Sofía Pérez Casulo , Marcelo Fiori , Bernardo Marenco , Federico Larroca

Graph convolutional neural networks (GCNs) embed nodes in a graph into Euclidean space, which has been shown to incur a large distortion when embedding real-world graphs with scale-free or hierarchical structure. Hyperbolic geometry offers…

Machine Learning · Computer Science 2019-10-30 Ines Chami , Rex Ying , Christopher Ré , Jure Leskovec

Learning from graph-structured data is an important task in machine learning and artificial intelligence, for which Graph Neural Networks (GNNs) have shown great promise. Motivated by recent advances in geometric representation learning, we…

Machine Learning · Computer Science 2019-10-30 Qi Liu , Maximilian Nickel , Douwe Kiela

Functional magnetic resonance imaging (fMRI) reveals complex brain functional networks with hierarchical topologies crucial for cognitive processing. Standard Euclidean Graph Neural Networks (GNNs) often struggle to represent these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Junhao Jia , Yunyou Liu , Cheng Yang , Yifei Sun , Feiwei Qin , Changmiao Wang , Yong Peng

Hyperbolic rotation is commonly used to effectively model knowledge graphs and their inherent hierarchies. However, existing hyperbolic rotation models rely on logarithmic and exponential mappings for feature transformation. These models…

Artificial Intelligence · Computer Science 2024-11-08 Qiuyu Liang , Weihua Wang , Feilong Bao , Guanglai Gao

Recent works have demonstrated promising performances of neural networks on hyperbolic spaces and symmetric positive definite (SPD) manifolds. These spaces belong to a family of Riemannian manifolds referred to as symmetric spaces of…

Machine Learning · Statistics 2026-01-06 Xuan Son Nguyen , Shuo Yang , Aymeric Histace

We develop a geometric framework to study the structure and function of complex networks. We assume that hyperbolic geometry underlies these networks, and we show that with this assumption, heterogeneous degree distributions and strong…

Statistical Mechanics · Physics 2010-09-14 Dmitri Krioukov , Fragkiskos Papadopoulos , Maksim Kitsak , Amin Vahdat , Marian Boguna

Many complex networks exhibit hierarchical, tree-like structures, making hyperbolic space a natural candidate wherein to learn representations of them. Based on this observation, Hyperbolic Graph Neural Networks (HGNNs) have been widely…

Machine Learning · Computer Science 2026-05-15 Dionisia Naddeo , Jonas Linkerhägner , Nicola Toschi , Geri Skenderi , Veronica Lachi

Neural embeddings have been used with great success in Natural Language Processing (NLP). They provide compact representations that encapsulate word similarity and attain state-of-the-art performance in a range of linguistic tasks. The…

Machine Learning · Statistics 2018-09-20 Benjamin Paul Chamberlain , James Clough , Marc Peter Deisenroth

Geometric representation learning has recently shown great promise in several machine learning settings, ranging from relational learning to language processing and generative models. In this work, we consider the problem of performing…

Machine Learning · Statistics 2020-05-29 Gian Maria Marconi , Lorenzo Rosasco , Carlo Ciliberto

Learning representations according to the underlying geometry is of vital importance for non-Euclidean data. Studies have revealed that the hyperbolic space can effectively embed hierarchical or tree-like data. In particular, the few past…

Machine Learning · Computer Science 2023-06-16 Eric Qu , Dongmian Zou

Deep Learning is mostly responsible for the surge of interest in Artificial Intelligence in the last decade. So far, deep learning researchers have been particularly successful in the domain of image processing, where Convolutional Neural…

Machine Learning · Computer Science 2023-08-31 Andrii Skliar , Maurice Weiler

We are concerned with the discovery of hierarchical relationships from large-scale unstructured similarity scores. For this purpose, we study different models of hyperbolic space and find that learning embeddings in the Lorentz model is…

Artificial Intelligence · Computer Science 2018-07-10 Maximilian Nickel , Douwe Kiela

Recently, hyperbolic space has risen as a promising alternative for semi-supervised graph representation learning. Many efforts have been made to design hyperbolic versions of neural network operations. However, the inspiring geometric…

Machine Learning · Computer Science 2022-01-24 Jiahong Liu , Menglin Yang , Min Zhou , Shanshan Feng , Philippe Fournier-Viger

Artificial neural networks (ANNs) were inspired by the architecture and functions of the human brain and have revolutionised the field of artificial intelligence (AI). Inspired by studies on the latent geometry of the brain, in this…

Neurons and Cognition · Quantitative Biology 2025-02-04 Alexander Joseph , Nathan Francis , Meijke Balay

Backward compatible representation learning enables updated models to integrate seamlessly with existing ones, avoiding to reprocess stored data. Despite recent advances, existing compatibility approaches in Euclidean space neglect the…

Machine Learning · Computer Science 2025-06-09 Ngoc Bui , Menglin Yang , Runjin Chen , Leonardo Neves , Mingxuan Ju , Rex Ying , Neil Shah , Tong Zhao

Many high-dimensional practical data sets have hierarchical structures induced by graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional embeddings in other space forms to perform…

Machine Learning · Computer Science 2022-04-13 Chao Pan , Eli Chien , Puoya Tabaghi , Jianhao Peng , Olgica Milenkovic

Deep learning in hyperbolic space is quickly gaining traction in the fields of machine learning, multimedia, and computer vision. Deep networks commonly operate in Euclidean space, implicitly assuming that data lies on regular grids. Recent…

Machine Learning · Computer Science 2023-12-20 Max van Spengler , Philipp Wirth , Pascal Mettes