English
Related papers

Related papers: Minimax Rates for Hyperbolic Hierarchical Learning

200 papers

Recent research in representation learning has shown that hierarchical data lends itself to low-dimensional and highly informative representations in hyperbolic space. However, even if hyperbolic embeddings have gathered attention in image…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Gabriel Moreira , Manuel Marques , João Paulo Costeira , Alexander Hauptmann

Recently, there has been a surge of interest in representation learning in hyperbolic spaces, driven by their ability to represent hierarchical data with significantly fewer dimensions than standard Euclidean spaces. However, the viability…

Machine Learning · Computer Science 2022-11-02 Melanie Weber , Manzil Zaheer , Ankit Singh Rawat , Aditya Menon , Sanjiv Kumar

Learning the representation of data with hierarchical structures in the hyperbolic space attracts increasing attention in recent years. Due to the constant negative curvature, the hyperbolic space resembles tree metrics and captures the…

Machine Learning · Computer Science 2022-02-21 Huiru Xiao , Caigao Jiang , Yangqiu Song , James Zhang , Junwu Xiong

Learning generalizable self-supervised graph representations for downstream tasks is challenging. To this end, Contrastive Learning (CL) has emerged as a leading approach. The embeddings of CL are arranged on a hypersphere where similarity…

Machine Learning · Computer Science 2025-02-25 Yifei Zhang , Hao Zhu , Menglin Yang , Jiahong Liu , Rex Ying , Irwin King , Piotr Koniusz

Hyperbolic representation learning is well known for its ability to capture hierarchical information. However, the distance between samples from different levels of hierarchical classes can be required large. We reveal that the hyperbolic…

Machine Learning · Computer Science 2024-10-30 Kun Song , Ruben Solozabal , Li hao , Lu Ren , Moloud Abdar , Qing Li , Fakhri Karray , Martin Takac

Representation learning has become an invaluable approach for learning from symbolic data such as text and graphs. However, while complex symbolic datasets often exhibit a latent hierarchical structure, state-of-the-art methods typically…

Artificial Intelligence · Computer Science 2017-05-29 Maximilian Nickel , Douwe Kiela

Most real-world datasets consist of a natural hierarchy between classes or an inherent label structure that is either already available or can be constructed cheaply. However, most existing representation learning methods ignore this…

Machine Learning · Computer Science 2024-12-03 Aditya Sinha , Siqi Zeng , Makoto Yamada , Han Zhao

Many high-dimensional and large-volume data sets of practical relevance have hierarchical structures induced by trees, graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional…

Machine Learning · Computer Science 2021-09-16 Eli Chien , Chao Pan , Puoya Tabaghi , Olgica Milenkovic

Natural language text exhibits hierarchical structure in a variety of respects. Ideally, we could incorporate our prior knowledge of this hierarchical structure into unsupervised learning algorithms that work on text data. Recent work by…

Computation and Language · Computer Science 2018-06-13 Bhuwan Dhingra , Christopher J. Shallue , Mohammad Norouzi , Andrew M. Dai , George E. Dahl

Due to its geometric properties, hyperbolic space can support high-fidelity embeddings of tree- and graph-structured data, upon which various hyperbolic networks have been developed. Existing hyperbolic networks encode geometric priors not…

Machine Learning · Computer Science 2023-03-14 Tao Yu , Christopher De Sa

Given the exponential growth of the volume of the ball w.r.t. its radius, the hyperbolic space is capable of embedding trees with arbitrarily small distortion and hence has received wide attention for representing hierarchical datasets.…

Machine Learning · Computer Science 2024-12-25 Gal Mishne , Zhengchao Wan , Yusu Wang , Sheng Yang

Finding meaningful representations and distances of hierarchical data is important in many fields. This paper presents a new method for hierarchical data embedding and distance. Our method relies on combining diffusion geometry, a central…

Machine Learning · Computer Science 2023-05-31 Ya-Wei Eileen Lin , Ronald R. Coifman , Gal Mishne , Ronen Talmon

Hyperbolic spaces have recently gained momentum in the context of machine learning due to their high capacity and tree-likeliness properties. However, the representational power of hyperbolic geometry is not yet on par with Euclidean…

Machine Learning · Computer Science 2018-06-29 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

We are concerned with the discovery of hierarchical relationships from large-scale unstructured similarity scores. For this purpose, we study different models of hyperbolic space and find that learning embeddings in the Lorentz model is…

Artificial Intelligence · Computer Science 2018-07-10 Maximilian Nickel , Douwe Kiela

Hyperbolic embeddings are a class of representation learning methods that offer competitive performances when data can be abstracted as a tree-like graph. However, in practice, learning hyperbolic embeddings of hierarchical data is…

Machine Learning · Computer Science 2024-07-24 Zhangyu Wang , Lantian Xu , Zhifeng Kong , Weilong Wang , Xuyu Peng , Enyang Zheng

Many high-dimensional practical data sets have hierarchical structures induced by graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional embeddings in other space forms to perform…

Machine Learning · Computer Science 2022-04-13 Chao Pan , Eli Chien , Puoya Tabaghi , Jianhao Peng , Olgica Milenkovic

Slot attention has emerged as a powerful framework for unsupervised object-centric learning, decomposing visual scenes into a small set of compact vector representations called \emph{slots}, each capturing a distinct region or object.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Neelu Madan , Àlex Pujol , Andreas Møgelmose , Sergio Escalera , Kamal Nasrollahi , Graham W. Taylor , Thomas B. Moeslund

In large-scale recommender systems, the user-item networks are generally scale-free or expand exponentially. The latent features (also known as embeddings) used to describe the user and item are determined by how well the embedding space…

Information Retrieval · Computer Science 2022-05-31 Menglin Yang , Min Zhou , Jiahong Liu , Defu Lian , Irwin King

Hierarchical data is common in many domains like life sciences and e-commerce, and its embeddings often play a critical role. While hyperbolic embeddings offer a theoretically grounded approach to representing hierarchies in low-dimensional…

Machine Learning · Computer Science 2026-04-15 Hui Yang , Jiaoyan Chen

The hyperbolic manifold is a smooth manifold of negative constant curvature. While the hyperbolic manifold is well-studied in the literature, it has gained interest in the machine learning and natural language processing communities lately…

Machine Learning · Computer Science 2019-03-19 Pratik Jawanpuria , Mayank Meghwanshi , Bamdev Mishra
‹ Prev 1 2 3 10 Next ›