English
Related papers

Related papers: HMSN: Hyperbolic Self-Supervised Learning by Clust…

200 papers

Hyperbolic Neural Networks (HNNs), operating in hyperbolic space, have been widely applied in recent years, motivated by the existence of an optimal embedding in hyperbolic space that can preserve data hierarchical relationships (termed…

Machine Learning · Computer Science 2024-02-06 Shicheng Tan , Huanjing Zhao , Shu Zhao , Yanping Zhang

Recently, there has been a surge of interest in representation learning in hyperbolic spaces, driven by their ability to represent hierarchical data with significantly fewer dimensions than standard Euclidean spaces. However, the viability…

Machine Learning · Computer Science 2022-11-02 Melanie Weber , Manzil Zaheer , Ankit Singh Rawat , Aditya Menon , Sanjiv Kumar

Although self-/un-supervised methods have led to rapid progress in visual representation learning, these methods generally treat objects and scenes using the same lens. In this paper, we focus on learning representations for objects and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Songwei Ge , Shlok Mishra , Simon Kornblith , Chun-Liang Li , David Jacobs

Hyperbolic neural networks have been popular in the recent past due to their ability to represent hierarchical data sets effectively and efficiently. The challenge in developing these networks lies in the nonlinearity of the embedding space…

Machine Learning · Computer Science 2021-12-08 Xiran Fan , Chun-Hao Yang , Baba C. Vemuri

We are concerned with the discovery of hierarchical relationships from large-scale unstructured similarity scores. For this purpose, we study different models of hyperbolic space and find that learning embeddings in the Lorentz model is…

Artificial Intelligence · Computer Science 2018-07-10 Maximilian Nickel , Douwe Kiela

We propose a method for representing malignant lymphoma pathology images, from high-resolution cell nuclei to low-resolution tissue images, within a single hyperbolic space using self-supervised learning. To capture morphological changes…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Kei Taguchi , Kazumasa Ohara , Tatsuya Yokota , Hiroaki Miyoshi , Noriaki Hashimoto , Ichiro Takeuchi , Hidekata Hontani

Hierarchical reinforcement learning deals with the problem of breaking down large tasks into meaningful sub-tasks. Autonomous discovery of these sub-tasks has remained a challenging problem. We propose a novel method of learning sub-tasks…

Machine Learning · Computer Science 2019-02-19 Saket Tiwari , M. Prannoy

Incorporating heterogeneous representations from different architectures has facilitated various vision tasks, e.g., some hybrid networks combine transformers and convolutions. However, complementarity between such heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Zhong-Yu Li , Bo-Wen Yin , Yongxiang Liu , Li Liu , Ming-Ming Cheng

Visual and semantic concepts are often structured in a hierarchical manner. For instance, textual concept `cat' entails all images of cats. A recent study, MERU, successfully adapts multimodal learning techniques from Euclidean space to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Changli Wang , Fang Yin , Jiafeng Liu , Rui Wu

The non-Euclidean geometry of hyperbolic spaces has recently garnered considerable attention in the realm of representation learning. Current endeavors in hyperbolic representation largely presuppose that the underlying hierarchies can be…

Machine Learning · Computer Science 2023-06-16 Menglin Yang , Min Zhou , Rex Ying , Yankai Chen , Irwin King

Hyperbolic-spaces are better suited to represent data with underlying hierarchical relationships, e.g., tree-like data. However, it is often necessary to incorporate, through alignment, different but related representations meaningfully.…

Machine Learning · Statistics 2020-12-03 Andrés Hoyos-Idrobo

This work presents a reformulation of the recently proposed Wasserstein autoencoder framework on a non-Euclidean manifold, the Poincar\'e ball model of the hyperbolic space. By assuming the latent space to be hyperbolic, we can use its…

Machine Learning · Computer Science 2020-03-18 Ivan Ovinnikov

Taxonomic classification in biodiversity research involves organizing biological specimens into structured hierarchies based on evidence, which can come from multiple modalities such as images and genetic information. We investigate whether…

Taxonomies are valuable resources for many applications, but the limited coverage due to the expensive manual curation process hinders their general applicability. Prior works attempt to automatically expand existing taxonomies to improve…

Computation and Language · Computer Science 2021-09-23 Mingyu Derek Ma , Muhao Chen , Te-Lin Wu , Nanyun Peng

In practice, many medical datasets have an underlying taxonomy defined over the disease label space. However, existing classification algorithms for medical diagnoses often assume semantically independent labels. In this study, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Zhen Yu , Toan Nguyen , Yaniv Gal , Lie Ju , Shekhar S. Chandra , Lei Zhang , Paul Bonnington , Victoria Mar , Zhiyong Wang , Zongyuan Ge

Continual learning has traditionally focused on classifying either instances or classes, but real-world applications, such as robotics and self-driving cars, require models to handle both simultaneously. To mirror real-life scenarios, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Melika Ayoughi , Mina Ghadimi Atigh , Mohammad Mahdi Derakhshani , Cees G. M. Snoek , Pascal Mettes , Paul Groth

Learning representations according to the underlying geometry is of vital importance for non-Euclidean data. Studies have revealed that the hyperbolic space can effectively embed hierarchical or tree-like data. In particular, the few past…

Machine Learning · Computer Science 2023-06-16 Eric Qu , Dongmian Zou

Metric learning aims to learn a highly discriminative model encouraging the embeddings of similar classes to be close in the chosen metrics and pushed apart for dissimilar ones. The common recipe is to use an encoder to extract embeddings…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Aleksandr Ermolov , Leyla Mirvakhabova , Valentin Khrulkov , Nicu Sebe , Ivan Oseledets

Words are not created equal. In fact, they form an aristocratic graph with a latent hierarchical structure that the next generation of unsupervised learned word embeddings should reveal. In this paper, justified by the notion of…

Computation and Language · Computer Science 2018-11-26 Alexandru Tifrea , Gary Bécigneul , Octavian-Eugen Ganea

Foundation models pre-trained on massive datasets, including large language models (LLMs), vision-language models (VLMs), and large multimodal models, have demonstrated remarkable success in diverse downstream tasks. However, recent studies…

Machine Learning · Computer Science 2025-07-25 Neil He , Hiren Madhu , Ngoc Bui , Menglin Yang , Rex Ying