English
Related papers

Related papers: THG: Transformer with Hyperbolic Geometry

200 papers

Hyperbolic geometry have shown significant potential in modeling complex structured data, particularly those with underlying tree-like and hierarchical structures. Despite the impressive performance of various hyperbolic neural networks…

Machine Learning · Computer Science 2025-08-26 Menglin Yang , Harshit Verma , Delvin Ce Zhang , Jiahong Liu , Irwin King , Rex Ying

In heterogeneous graphs, we can observe complex structures such as tree-like or hierarchical structures. Recently, the hyperbolic space has been widely adopted in many studies to effectively learn these complex structures. Although these…

Machine Learning · Computer Science 2026-01-14 Jongmin Park , Seunghoon Han , Hyewon Lee , Won-Yong Shin , Sungsu Lim

Data representation in non-Euclidean spaces has proven effective for capturing hierarchical and complex relationships in real-world datasets. Hyperbolic spaces, in particular, provide efficient embeddings for hierarchical structures. This…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Jacob Fein-Ashley , Ethan Feng , Minh Pham

The choice of geometric space for knowledge graph (KG) embeddings can have significant effects on the performance of KG completion tasks. The hyperbolic geometry has been shown to capture the hierarchical patterns due to its tree-like…

Machine Learning · Computer Science 2022-11-08 Huiru Xiao , Xin Liu , Yangqiu Song , Ginny Y. Wong , Simon See

Temporal knowledge graph (TKG) reasoning predicts future events based on historical data, but it's challenging due to the complex semantic and hierarchical information involved. Existing Euclidean models excel at capturing semantics but…

Machine Learning · Computer Science 2024-09-04 Siling Feng , Zhisheng Qi , Cong Lin

Hyperbolic geometry has emerged as a powerful tool for modeling complex, structured data, particularly where hierarchical or tree-like relationships are present. By enabling embeddings with lower distortion, hyperbolic neural networks offer…

Machine Learning · Computer Science 2025-06-18 Pol Arévalo , Alexis Molina , Álvaro Ciudad

Hyperbolic networks have shown prominent improvements over their Euclidean counterparts in several areas involving hierarchical datasets in various domains such as computer vision, graph analysis, and natural language processing. However,…

Machine Learning · Computer Science 2022-06-09 Nurendra Choudhary , Chandan K. Reddy

Most previous heterogeneous graph embedding models represent elements in a heterogeneous graph as vector representations in a low-dimensional Euclidean space. However, because heterogeneous graphs inherently possess complex structures, such…

Machine Learning · Computer Science 2024-04-16 Jongmin Park , Seunghoon Han , Soohwan Jeong , Sungsu Lim

Hyperbolic spaces have recently gained momentum in the context of machine learning due to their high capacity and tree-likeliness properties. However, the representational power of hyperbolic geometry is not yet on par with Euclidean…

Machine Learning · Computer Science 2018-06-29 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

Metric learning aims to learn a highly discriminative model encouraging the embeddings of similar classes to be close in the chosen metrics and pushed apart for dissimilar ones. The common recipe is to use an encoder to extract embeddings…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Aleksandr Ermolov , Leyla Mirvakhabova , Valentin Khrulkov , Nicu Sebe , Ivan Oseledets

Transformers have demonstrated remarkable performance in skeleton-based human action recognition, yet their quadratic computational complexity remains a bottleneck for real-world applications. To mitigate this, linear attention mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yue Li , Haoxuan Qu , Mengyuan Liu , Jun Liu , Yujun Cai

Scene graph representations enable structured visual understanding by modeling objects and their relationships, and have been widely used for multiview and 3D scene reasoning. Existing methods such as MSG learn scene graph embeddings in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Liyang Wang , Zeyu Zhang , Hao Tang

In this work, we propose a fashion item recommendation model that incorporates hyperbolic geometry into user and item representations. Using hyperbolic space, our model aims to capture implicit hierarchies among items based on their visual…

Information Retrieval · Computer Science 2024-09-05 Ryotaro Shimizu , Yu Wang , Masanari Kimura , Yuki Hirakawa , Takashi Wada , Yuki Saito , Julian McAuley

Recent studies have demonstrated the potential of hyperbolic geometry for capturing complex patterns from interaction data in recommender systems. In this work, we introduce a novel hyperbolic recommendation model that uses geometrical…

Information Retrieval · Computer Science 2025-08-19 Viacheslav Yusupov , Maxim Rakhuba , Evgeny Frolov

The main objective of Knowledge Graph (KG) embeddings is to learn low-dimensional representations of entities and relations, enabling the prediction of missing facts. A significant challenge in achieving better KG embeddings lies in…

Computation and Language · Computer Science 2024-02-06 Yihua Zhu , Hidetoshi Shimodaira

This paper investigates the notion of learning user and item representations in non-Euclidean space. Specifically, we study the connection between metric learning in hyperbolic space and collaborative filtering by exploring Mobius…

Information Retrieval · Computer Science 2019-12-02 Lucas Vinh Tran , Yi Tay , Shuai Zhang , Gao Cong , Xiaoli Li

Graph-structured data are widespread in real-world applications, such as social networks, recommender systems, knowledge graphs, chemical molecules etc. Despite the success of Euclidean space for graph-related learning tasks, its ability to…

Machine Learning · Computer Science 2022-11-09 Min Zhou , Menglin Yang , Lujia Pan , Irwin King

Recently, there has been a rising surge of momentum for deep representation learning in hyperbolic spaces due to theirhigh capacity of modeling data like knowledge graphs or synonym hierarchies, possessing hierarchical structure. We refer…

Machine Learning · Computer Science 2021-02-18 Wei Peng , Tuomas Varanka , Abdelrahman Mostafa , Henglin Shi , Guoying Zhao

Learning embeddings of entities and relations existing in knowledge bases allows the discovery of hidden patterns in data. In this work, we examine the geometrical space's contribution to the task of knowledge base completion. We focus on…

Computation and Language · Computer Science 2019-08-20 Prodromos Kolyvakis , Alexandros Kalousis , Dimitris Kiritsis

We introduce hyperbolic attention networks to endow neural networks with enough capacity to match the complexity of data with hierarchical and power-law structure. A few recent approaches have successfully demonstrated the benefits of…

‹ Prev 1 2 3 10 Next ›