English
Related papers

Related papers: Why are hyperbolic neural networks effective? A st…

200 papers

Artificial neural networks (ANNs) were inspired by the architecture and functions of the human brain and have revolutionised the field of artificial intelligence (AI). Inspired by studies on the latent geometry of the brain, in this…

Neurons and Cognition · Quantitative Biology 2025-02-04 Alexander Joseph , Nathan Francis , Meijke Balay

In large-scale recommender systems, the user-item networks are generally scale-free or expand exponentially. The latent features (also known as embeddings) used to describe the user and item are determined by how well the embedding space…

Information Retrieval · Computer Science 2022-05-31 Menglin Yang , Min Zhou , Jiahong Liu , Defu Lian , Irwin King

Natural language text exhibits hierarchical structure in a variety of respects. Ideally, we could incorporate our prior knowledge of this hierarchical structure into unsupervised learning algorithms that work on text data. Recent work by…

Computation and Language · Computer Science 2018-06-13 Bhuwan Dhingra , Christopher J. Shallue , Mohammad Norouzi , Andrew M. Dai , George E. Dahl

Hyperbolic spaces, which have the capacity to embed tree structures without distortion owing to their exponential volume growth, have recently been applied to machine learning to better capture the hierarchical nature of data. In this…

Machine Learning · Computer Science 2021-03-18 Ryohei Shimizu , Yusuke Mukuta , Tatsuya Harada

The non-Euclidean geometry of hyperbolic spaces has recently garnered considerable attention in the realm of representation learning. Current endeavors in hyperbolic representation largely presuppose that the underlying hierarchies can be…

Machine Learning · Computer Science 2023-06-16 Menglin Yang , Min Zhou , Rex Ying , Yankai Chen , Irwin King

Representation learning has become an invaluable approach for learning from symbolic data such as text and graphs. However, while complex symbolic datasets often exhibit a latent hierarchical structure, state-of-the-art methods typically…

Artificial Intelligence · Computer Science 2017-05-29 Maximilian Nickel , Douwe Kiela

Metric learning plays a critical role in training image retrieval and classification. It is also a key algorithm in representation learning, e.g., for feature learning and its alignment in metric space. Hyperbolic embedding has been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Shiyang Yan , Zongxuan Liu , Lin Xu

Label inventories for fine-grained entity typing have grown in size and complexity. Nonetheless, they exhibit a hierarchical structure. Hyperbolic spaces offer a mathematically appealing approach for learning hierarchical representations of…

Computation and Language · Computer Science 2020-10-06 Federico López , Michael Strube

Foundation models pre-trained on massive datasets, including large language models (LLMs), vision-language models (VLMs), and large multimodal models, have demonstrated remarkable success in diverse downstream tasks. However, recent studies…

Machine Learning · Computer Science 2025-07-25 Neil He , Hiren Madhu , Ngoc Bui , Menglin Yang , Rex Ying

Due to its geometric properties, hyperbolic space can support high-fidelity embeddings of tree- and graph-structured data, upon which various hyperbolic networks have been developed. Existing hyperbolic networks encode geometric priors not…

Machine Learning · Computer Science 2023-03-14 Tao Yu , Christopher De Sa

Hyperbolic representations are effective in modeling knowledge graph data which is prevalently used to facilitate multi-hop reasoning. However, a rigorous and detailed comparison of the two spaces for this task is lacking. In this paper,…

Computation and Language · Computer Science 2025-07-08 Simon Welz , Lucie Flek , Akbar Karimi

Hyperbolic space is quickly gaining traction as a promising geometry for hierarchical and robust representation learning. A core open challenge is the development of a mathematical formulation of hyperbolic neural networks that is both…

Machine Learning · Computer Science 2026-01-30 Robert van der Klis , Ricardo Chávez Torres , Max van Spengler , Yuhui Ding , Thomas Hofmann , Pascal Mettes

Signed network embedding methods aim to learn vector representations of nodes in signed networks. However, existing algorithms only managed to embed networks into low-dimensional Euclidean spaces whereas many intrinsic features of signed…

Machine Learning · Computer Science 2021-07-16 Wenzhuo Song , Hongxu Chen , Xueyan Liu , Hongzhe Jiang , Shengsheng Wang

Graph representation learning in Euclidean space, despite its widespread adoption and proven utility in many domains, often struggles to effectively capture the inherent hierarchical and complex relational structures prevalent in real-world…

Machine Learning · Computer Science 2025-08-26 Menglin Yang , Min Zhou , Tong Zhang , Jiahong Liu , Zhihao Li , Lujia Pan , Hui Xiong , Irwin King

Learning the representation of data with hierarchical structures in the hyperbolic space attracts increasing attention in recent years. Due to the constant negative curvature, the hyperbolic space resembles tree metrics and captures the…

Machine Learning · Computer Science 2022-02-21 Huiru Xiao , Caigao Jiang , Yangqiu Song , James Zhang , Junwu Xiong

Deep representation learning is a ubiquitous part of modern computer vision. While Euclidean space has been the de facto standard manifold for learning visual representations, hyperbolic space has recently gained rapid traction for learning…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Pascal Mettes , Mina Ghadimi Atigh , Martin Keller-Ressel , Jeffrey Gu , Serena Yeung

Learning hyperbolic embeddings for knowledge graph (KG) has gained increasing attention due to its superiority in capturing hierarchies. However, some important operations in hyperbolic space still lack good definitions, making existing…

Machine Learning · Computer Science 2023-02-09 Wentao Shi , Junkang Wu , Xuezhi Cao , Jiawei Chen , Wenqiang Lei , Wei Wu , Xiangnan He

Hierarchical reinforcement learning deals with the problem of breaking down large tasks into meaningful sub-tasks. Autonomous discovery of these sub-tasks has remained a challenging problem. We propose a novel method of learning sub-tasks…

Machine Learning · Computer Science 2019-02-19 Saket Tiwari , M. Prannoy

The exponential volume growth of hyperbolic geometry can embed the hierarchical relationships between states in reinforcement learning (RL) with far less distortion than Euclidean space. However, hyperbolic deep RL faces severe optimization…

Understanding the intricate mappings between visual stimuli and neural responses is a fundamental challenge in cognitive neuroscience. While current approaches predominantly align images and functional magnetic resonance imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zihan Ma , Tian Xia , Kexin Wang , Xiao Li , Xiaowei He , Yudan Ren