English
Related papers

Related papers: Robust Large-Margin Learning in Hyperbolic Space

200 papers

We are concerned with the discovery of hierarchical relationships from large-scale unstructured similarity scores. For this purpose, we study different models of hyperbolic space and find that learning embeddings in the Lorentz model is…

Artificial Intelligence · Computer Science 2018-07-10 Maximilian Nickel , Douwe Kiela

We prove an exponential separation in sample complexity between Euclidean and hyperbolic representations for learning on hierarchical data under standard Lipschitz regularization. For depth-$R$ hierarchies with branching factor $m$, we…

Machine Learning · Statistics 2026-01-29 Divit Rawal , Sriram Vishwanath

Learning generalizable self-supervised graph representations for downstream tasks is challenging. To this end, Contrastive Learning (CL) has emerged as a leading approach. The embeddings of CL are arranged on a hypersphere where similarity…

Machine Learning · Computer Science 2025-02-25 Yifei Zhang , Hao Zhu , Menglin Yang , Jiahong Liu , Rex Ying , Irwin King , Piotr Koniusz

Hierarchical reinforcement learning deals with the problem of breaking down large tasks into meaningful sub-tasks. Autonomous discovery of these sub-tasks has remained a challenging problem. We propose a novel method of learning sub-tasks…

Machine Learning · Computer Science 2019-02-19 Saket Tiwari , M. Prannoy

Hyperbolic representations are effective in modeling knowledge graph data which is prevalently used to facilitate multi-hop reasoning. However, a rigorous and detailed comparison of the two spaces for this task is lacking. In this paper,…

Computation and Language · Computer Science 2025-07-08 Simon Welz , Lucie Flek , Akbar Karimi

Recently, Hyperbolic Spaces in the context of Non-Euclidean Deep Learning have gained popularity because of their ability to represent hierarchical data. We propose that it is possible to take advantage of the hierarchical characteristic…

Machine Learning · Computer Science 2021-02-11 Diego Lazcano , Nicolás Fredes , Werner Creixell

Metric learning plays a critical role in training image retrieval and classification. It is also a key algorithm in representation learning, e.g., for feature learning and its alignment in metric space. Hyperbolic embedding has been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Shiyang Yan , Zongxuan Liu , Lin Xu

This paper investigates the notion of learning user and item representations in non-Euclidean space. Specifically, we study the connection between metric learning in hyperbolic space and collaborative filtering by exploring Mobius…

Information Retrieval · Computer Science 2019-12-02 Lucas Vinh Tran , Yi Tay , Shuai Zhang , Gao Cong , Xiaoli Li

Hyperbolic space has become a popular choice of manifold for representation learning of various datatypes from tree-like structures and text to graphs. Building on the success of deep learning with prototypes in Euclidean and hyperspherical…

Machine Learning · Computer Science 2021-11-25 Mina Ghadimi Atigh , Martin Keller-Ressel , Pascal Mettes

Most of the existing literature regarding hyperbolic embedding concentrate upon supervised learning, whereas the use of unsupervised hyperbolic embedding is less well explored. In this paper, we analyze how unsupervised tasks can benefit…

Machine Learning · Computer Science 2021-03-31 Jiwoong Park , Junho Cho , Hyung Jin Chang , Jin Young Choi

Metric learning aims to learn a highly discriminative model encouraging the embeddings of similar classes to be close in the chosen metrics and pushed apart for dissimilar ones. The common recipe is to use an encoder to extract embeddings…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Aleksandr Ermolov , Leyla Mirvakhabova , Valentin Khrulkov , Nicu Sebe , Ivan Oseledets

Hyperbolic Neural Networks (HNNs), operating in hyperbolic space, have been widely applied in recent years, motivated by the existence of an optimal embedding in hyperbolic space that can preserve data hierarchical relationships (termed…

Machine Learning · Computer Science 2024-02-06 Shicheng Tan , Huanjing Zhao , Shu Zhao , Yanping Zhang

Most real-world datasets consist of a natural hierarchy between classes or an inherent label structure that is either already available or can be constructed cheaply. However, most existing representation learning methods ignore this…

Machine Learning · Computer Science 2024-12-03 Aditya Sinha , Siqi Zeng , Makoto Yamada , Han Zhao

Structuring latent representations in a hierarchical manner enables models to learn patterns at multiple levels of abstraction. However, most prevalent image understanding models focus on visual similarity, and learning visual hierarchies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Ziwei Wang , Sameera Ramasinghe , Chenchen Xu , Julien Monteil , Loris Bazzani , Thalaiyasingam Ajanthan

How can we represent hierarchical information present in large type inventories for entity typing? We study the ability of hyperbolic embeddings to capture hierarchical relations between mentions in context and their target types in a…

Computation and Language · Computer Science 2019-06-07 Federico López , Benjamin Heinzerling , Michael Strube

Euclidean embeddings of data are fundamentally limited in their ability to capture latent semantic structures, which need not conform to Euclidean spatial assumptions. Here we consider an alternative, which embeds data as discrete…

Machine Learning · Computer Science 2019-05-10 Charlie Frogner , Farzaneh Mirzazadeh , Justin Solomon

We consider the problem of multi-label classification where the labels lie in a hierarchy. However, unlike most existing works in hierarchical multi-label classification, we do not assume that the label-hierarchy is known. Encouraged by the…

Machine Learning · Computer Science 2021-01-14 Soumya Chatterjee , Ayush Maheshwari , Ganesh Ramakrishnan , Saketha Nath Jagaralpudi

The hyperbolic manifold is a smooth manifold of negative constant curvature. While the hyperbolic manifold is well-studied in the literature, it has gained interest in the machine learning and natural language processing communities lately…

Machine Learning · Computer Science 2019-03-19 Pratik Jawanpuria , Mayank Meghwanshi , Bamdev Mishra

Object detection, for the most part, has been formulated in the euclidean space, where euclidean or spherical geodesic distances measure the similarity of an image region to an object class prototype. In this work, we study whether a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Christopher Lang , Alexander Braun , Abhinav Valada

Deep Learning is mostly responsible for the surge of interest in Artificial Intelligence in the last decade. So far, deep learning researchers have been particularly successful in the domain of image processing, where Convolutional Neural…

Machine Learning · Computer Science 2023-08-31 Andrii Skliar , Maurice Weiler