English
Related papers

Related papers: Hyperbolic Vision Transformers: Combining Improvem…

200 papers

Natural language text exhibits hierarchical structure in a variety of respects. Ideally, we could incorporate our prior knowledge of this hierarchical structure into unsupervised learning algorithms that work on text data. Recent work by…

Computation and Language · Computer Science 2018-06-13 Bhuwan Dhingra , Christopher J. Shallue , Mohammad Norouzi , Andrew M. Dai , George E. Dahl

Hyperbolic spaces have recently gained momentum in the context of machine learning due to their high capacity and tree-likeliness properties. However, the representational power of hyperbolic geometry is not yet on par with Euclidean…

Machine Learning · Computer Science 2018-06-29 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

Metric-based meta-learning has attracted a lot of attention due to its effectiveness and efficiency in few-shot learning. Recent studies show that metric scaling plays a crucial role in the performance of metric-based meta-learning…

Machine Learning · Computer Science 2020-08-27 Jiaxin Chen , Li-Ming Zhan , Xiao-Ming Wu , Fu-lai Chung

Network embedding is a fervid topic in current networks science and observes that most real complex systems can be embedded in hidden metrics space and emerge as the geometrical property, where the geometric distance between nodes…

Physics and Society · Physics 2020-04-28 Zongning Wu , Zengru Di , Ying Fan

Deep metric learning is often used to learn an embedding function that captures the semantic differences within a dataset. A key factor in many problem domains is how this embedding generalizes to new classes of data. In observing many…

Machine Learning · Computer Science 2019-09-18 Xiaotong Liu , Hong Xuan , Zeyu Zhang , Abby Stylianou , Robert Pless

Learning graph representations via low-dimensional embeddings that preserve relevant network properties is an important class of problems in machine learning. We here present a novel method to embed directed acyclic graphs. Following prior…

Machine Learning · Computer Science 2018-06-08 Octavian-Eugen Ganea , Gary Bécigneul , Thomas Hofmann

Data across modalities such as images, text, and graphs often contains hierarchical and relational structures, which are challenging to model within Euclidean geometry. Hyperbolic geometry provides a natural framework for representing such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Haya Alyoussef , Ahmad Bdeir , Diego Coello de Portugal Mecke , Tom Hanika , Niels Landwehr , Lars Schmidt-Thieme

Representation learning has become an invaluable approach for learning from symbolic data such as text and graphs. However, while complex symbolic datasets often exhibit a latent hierarchical structure, state-of-the-art methods typically…

Artificial Intelligence · Computer Science 2017-05-29 Maximilian Nickel , Douwe Kiela

In large-scale recommender systems, the user-item networks are generally scale-free or expand exponentially. The latent features (also known as embeddings) used to describe the user and item are determined by how well the embedding space…

Information Retrieval · Computer Science 2022-05-31 Menglin Yang , Min Zhou , Jiahong Liu , Defu Lian , Irwin King

Deep Learning is mostly responsible for the surge of interest in Artificial Intelligence in the last decade. So far, deep learning researchers have been particularly successful in the domain of image processing, where Convolutional Neural…

Machine Learning · Computer Science 2023-08-31 Andrii Skliar , Maurice Weiler

Recently, there has been a surge of interest in representation learning in hyperbolic spaces, driven by their ability to represent hierarchical data with significantly fewer dimensions than standard Euclidean spaces. However, the viability…

Machine Learning · Computer Science 2022-11-02 Melanie Weber , Manzil Zaheer , Ankit Singh Rawat , Aditya Menon , Sanjiv Kumar

Geometric representation learning has recently shown great promise in several machine learning settings, ranging from relational learning to language processing and generative models. In this work, we consider the problem of performing…

Machine Learning · Statistics 2020-05-29 Gian Maria Marconi , Lorenzo Rosasco , Carlo Ciliberto

Metric learning has the aim to improve classification accuracy by learning a distance measure which brings data points from the same class closer together and pushes data points from different classes further apart. Recent research has…

Machine Learning · Computer Science 2018-07-17 Benjamin Paaßen , Claudio Gallicchio , Alessio Micheli , Barbara Hammer

Deep metric learning aims to learn embeddings that contain semantic similarity information among data points. To learn better embeddings, methods to generate synthetic hard samples have been proposed. Existing methods of synthetic hard…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Geonmo Gu , Byungsoo Ko

Graph representation learning in Euclidean space, despite its widespread adoption and proven utility in many domains, often struggles to effectively capture the inherent hierarchical and complex relational structures prevalent in real-world…

Machine Learning · Computer Science 2025-08-26 Menglin Yang , Min Zhou , Tong Zhang , Jiahong Liu , Zhihao Li , Lujia Pan , Hui Xiong , Irwin King

Hyperbolic geometry has emerged as a powerful tool for modeling complex, structured data, particularly where hierarchical or tree-like relationships are present. By enabling embeddings with lower distortion, hyperbolic neural networks offer…

Machine Learning · Computer Science 2025-06-18 Pol Arévalo , Alexis Molina , Álvaro Ciudad

Recent papers in the graph machine learning literature have introduced a number of approaches for hyperbolic representation learning. The asserted benefits are improved performance on a variety of graph tasks, node classification and link…

Machine Learning · Computer Science 2025-02-26 Isay Katsman , Anna Gilbert

Network data is ubiquitous in various scientific disciplines, including sociology, economics, and neuroscience. Latent space models are often employed in network data analysis, but the geometric effect of latent space curvature remains a…

Methodology · Statistics 2026-02-11 Jinming Li , Gongjun Xu , Ji Zhu

Graph-structured data are widespread in real-world applications, such as social networks, recommender systems, knowledge graphs, chemical molecules etc. Despite the success of Euclidean space for graph-related learning tasks, its ability to…

Machine Learning · Computer Science 2022-11-09 Min Zhou , Menglin Yang , Lujia Pan , Irwin King

Detecting events and their evolution through time is a crucial task in natural language understanding. Recent neural approaches to event temporal relation extraction typically map events to embeddings in the Euclidean space and train a…

Computation and Language · Computer Science 2024-06-11 Xingwei Tan , Gabriele Pergola , Yulan He