English
Related papers

Related papers: Minimax Rates for Hyperbolic Hierarchical Learning

200 papers

Hyperbolic representations are effective in modeling knowledge graph data which is prevalently used to facilitate multi-hop reasoning. However, a rigorous and detailed comparison of the two spaces for this task is lacking. In this paper,…

Computation and Language · Computer Science 2025-07-08 Simon Welz , Lucie Flek , Akbar Karimi

Continual learning has traditionally focused on classifying either instances or classes, but real-world applications, such as robotics and self-driving cars, require models to handle both simultaneously. To mirror real-life scenarios, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Melika Ayoughi , Mina Ghadimi Atigh , Mohammad Mahdi Derakhshani , Cees G. M. Snoek , Pascal Mettes , Paul Groth

Hyperbolic-spaces are better suited to represent data with underlying hierarchical relationships, e.g., tree-like data. However, it is often necessary to incorporate, through alignment, different but related representations meaningfully.…

Machine Learning · Statistics 2020-12-03 Andrés Hoyos-Idrobo

Taxonomies are valuable resources for many applications, but the limited coverage due to the expensive manual curation process hinders their general applicability. Prior works attempt to automatically expand existing taxonomies to improve…

Computation and Language · Computer Science 2021-09-23 Mingyu Derek Ma , Muhao Chen , Te-Lin Wu , Nanyun Peng

Hyperbolic embeddings have demonstrated their effectiveness in capturing measures of uncertainty and hierarchical relationships across various deep-learning tasks, including image segmentation and active learning. However, their application…

Machine Learning · Computer Science 2024-08-12 Paolo Mandica , Luca Franco , Konstantinos Kallidromitis , Suzanne Petryk , Fabio Galasso

Recent work has demonstrated that embeddings of tree-like graphs in hyperbolic space surpass their Euclidean counterparts in performance by a large margin. Inspired by these results and scale-free structure in the word co-occurrence graph,…

Computation and Language · Computer Science 2019-05-28 Matthias Leimeister , Benjamin J. Wilson

Scene graph representations enable structured visual understanding by modeling objects and their relationships, and have been widely used for multiview and 3D scene reasoning. Existing methods such as MSG learn scene graph embeddings in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Liyang Wang , Zeyu Zhang , Hao Tang

Recent papers in the graph machine learning literature have introduced a number of approaches for hyperbolic representation learning. The asserted benefits are improved performance on a variety of graph tasks, node classification and link…

Machine Learning · Computer Science 2025-02-26 Isay Katsman , Anna Gilbert

Hyperbolic geometry is gaining traction in machine learning for its effectiveness at capturing hierarchical structures in real-world data. Hyperbolic spaces, where neighborhoods grow exponentially, offer substantial advantages and…

Machine Learning · Computer Science 2024-03-06 Philippe Chlenski , Ethan Turok , Antonio Moretti , Itsik Pe'er

Object detection, for the most part, has been formulated in the euclidean space, where euclidean or spherical geodesic distances measure the similarity of an image region to an object class prototype. In this work, we study whether a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Christopher Lang , Alexander Braun , Abhinav Valada

In this paper, we present a method of embedding physics data manifolds with metric structure into lower dimensional spaces with simpler metrics, such as Euclidean and Hyperbolic spaces. We then demonstrate that it can be a powerful step in…

High Energy Physics - Phenomenology · Physics 2023-08-02 Sang Eon Park , Philip Harris , Bryan Ostdiek

Hierarchical data arise in countless domains, from biological taxonomies and organizational charts to legal codes and knowledge graphs. Residual Quantization (RQ) is widely used to generate discrete, multitoken representations for such data…

Machine Learning · Computer Science 2025-05-20 Piotr Piękos , Subhradeep Kayal , Alexandros Karatzoglou

Foundation models pre-trained on massive datasets, including large language models (LLMs), vision-language models (VLMs), and large multimodal models, have demonstrated remarkable success in diverse downstream tasks. However, recent studies…

Machine Learning · Computer Science 2025-07-25 Neil He , Hiren Madhu , Ngoc Bui , Menglin Yang , Rex Ying

Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior…

Machine Learning · Computer Science 2018-06-08 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

Learning embeddings of entities and relations existing in knowledge bases allows the discovery of hidden patterns in data. In this work, we examine the geometrical space's contribution to the task of knowledge base completion. We focus on…

Computation and Language · Computer Science 2019-08-20 Prodromos Kolyvakis , Alexandros Kalousis , Dimitris Kiritsis

Hyperbolic space has become a popular choice of manifold for representation learning of various datatypes from tree-like structures and text to graphs. Building on the success of deep learning with prototypes in Euclidean and hyperspherical…

Machine Learning · Computer Science 2021-11-25 Mina Ghadimi Atigh , Martin Keller-Ressel , Pascal Mettes

Retrieval-augmented generation (RAG) for biomedical knowledge faces a hierarchy-aware ontology grounding challenge: resources like HPO, DO, and MeSH use deep ``is-a" taxonomies, yet production stacks rely on Euclidean embeddings and ANN…

Information Retrieval · Computer Science 2026-04-14 Ou Deng , Shoji Nishimura , Atsushi Ogihara , Qun Jin

Graph representation learning in Euclidean space, despite its widespread adoption and proven utility in many domains, often struggles to effectively capture the inherent hierarchical and complex relational structures prevalent in real-world…

Machine Learning · Computer Science 2025-08-26 Menglin Yang , Min Zhou , Tong Zhang , Jiahong Liu , Zhihao Li , Lujia Pan , Hui Xiong , Irwin King

Representing graphs as sets of node embeddings in certain curved Riemannian manifolds has recently gained momentum in machine learning due to their desirable geometric inductive biases, e.g., hierarchical structures benefit from hyperbolic…

Machine Learning · Computer Science 2020-06-09 Calin Cruceru , Gary Bécigneul , Octavian-Eugen Ganea

Machine unlearning methods have become increasingly important for selective concept removal in large pre-trained models. While recent work has explored unlearning in Euclidean contrastive vision-language models, the effectiveness of concept…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Àlex Pujol Vidal , Sergio Escalera , Kamal Nasrollahi , Thomas B. Moeslund