English
Related papers

Related papers: Poincar\'e Embeddings for Learning Hierarchical Re…

200 papers

Recent papers in the graph machine learning literature have introduced a number of approaches for hyperbolic representation learning. The asserted benefits are improved performance on a variety of graph tasks, node classification and link…

Machine Learning · Computer Science 2025-02-26 Isay Katsman , Anna Gilbert

Most mathematical distortions used in ML are fundamentally integral in nature: $f$-divergences, Bregman divergences, (regularized) optimal transport distances, integral probability metrics, geodesic distances, etc. In this paper, we unveil…

Machine Learning · Computer Science 2024-10-01 Richard Nock , Ehsan Amid , Frank Nielsen , Alexander Soen , Manfred K. Warmuth

High-dimensional multiplex graphs are characterized by their high number of complementary and divergent dimensions. The existence of multiple hierarchical latent relations between the graph dimensions poses significant challenges to…

Machine Learning · Computer Science 2025-01-30 Kamel Abdous , Nairouz Mrabah , Mohamed Bouguessa

Hyperbolic neural networks can effectively capture the inherent hierarchy of graph datasets, and consequently a powerful choice of GNNs. However, they entangle multiple incongruent (gyro-)vector spaces within a layer, which makes them…

Machine Learning · Computer Science 2023-06-07 Mehrdad Khatir , Nurendra Choudhary , Sutanay Choudhury , Khushbu Agarwal , Chandan K. Reddy

Geometric representation learning has recently shown great promise in several machine learning settings, ranging from relational learning to language processing and generative models. In this work, we consider the problem of performing…

Machine Learning · Statistics 2020-05-29 Gian Maria Marconi , Lorenzo Rosasco , Carlo Ciliberto

The exponential volume growth of hyperbolic geometry can embed the hierarchical relationships between states in reinforcement learning (RL) with far less distortion than Euclidean space. However, hyperbolic deep RL faces severe optimization…

Pre-trained deep image representations are useful for post-training tasks such as classification through transfer learning, image retrieval, and object detection. Data augmentations are a crucial aspect of pre-training robust…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Sangnie Bhardwaj , Willie McClinton , Tongzhou Wang , Guillaume Lajoie , Chen Sun , Phillip Isola , Dilip Krishnan

Embedding learning, a.k.a. representation learning, has been shown to be able to model large-scale semantic knowledge graphs. A key concept is a mapping of the knowledge graph to a tensor representation whose entries are predicted by models…

Artificial Intelligence · Computer Science 2016-05-10 Volker Tresp , Cristóbal Esteban , Yinchong Yang , Stephan Baier , Denis Krompaß

This survey reviews hyperbolic graph embedding models, and evaluate them on anomaly detection, highlighting their advantages over Euclidean methods in capturing complex structures. Evaluating models like \textit{HGCAE},…

We introduce a framework for learning from unlabeled video what is predictable in the future. Instead of committing up front to features to predict, our approach learns from data which features are predictable. Based on the observation that…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Dídac Surís , Ruoshi Liu , Carl Vondrick

Hyperbolic representation learning is well known for its ability to capture hierarchical information. However, the distance between samples from different levels of hierarchical classes can be required large. We reveal that the hyperbolic…

Machine Learning · Computer Science 2024-10-30 Kun Song , Ruben Solozabal , Li hao , Lu Ren , Moloud Abdar , Qing Li , Fakhri Karray , Martin Takac

Detecting events and their evolution through time is a crucial task in natural language understanding. Recent neural approaches to event temporal relation extraction typically map events to embeddings in the Euclidean space and train a…

Computation and Language · Computer Science 2024-06-11 Xingwei Tan , Gabriele Pergola , Yulan He

Trajectory similarity is a cornerstone of trajectory data management and analysis. Traditional similarity functions often suffer from high computational complexity and a reliance on specific distance metrics, prompting a shift towards deep…

Databases · Computer Science 2025-04-16 Jianing Si , Haitao Yuan , Nan Jiang , Minxiao Chen , Xiao Ma , Shangguang Wang

A key technique of machine learning and computer vision is to embed discrete weighted graphs into continuous spaces for further downstream processing. Embedding discrete hierarchical structures in hyperbolic geometry has proven very…

Machine Learning · Computer Science 2023-08-17 Frank Nielsen , Ke Sun

Learned visual representations often capture large amounts of semantic information for accurate downstream applications. Human understanding of the world is fundamentally grounded in hierarchy. To mimic this and further improve…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Ethan Shen , Ali Farhadi , Aditya Kusupati

Deep learning methods, which exploit auto-differentiation to compute derivatives without dispersion or dissipation errors, have recently emerged as a compelling alternative to classical mesh-based numerical schemes for solving hyperbolic…

Numerical Analysis · Mathematics 2025-03-18 Qi Sun , Zhenjiang Liu , Lili Ju , Xuejun Xu

Recently, a variety of probing tasks are proposed to discover linguistic properties learned in contextualized word embeddings. Many of these works implicitly assume these embeddings lay in certain metric spaces, typically the Euclidean…

Computation and Language · Computer Science 2021-04-09 Boli Chen , Yao Fu , Guangwei Xu , Pengjun Xie , Chuanqi Tan , Mosha Chen , Liping Jing

The black-box nature of deep learning models in NLP hinders their widespread application. The research focus has shifted to Hierarchical Attribution (HA) for its ability to model feature interactions. Recent works model non-contiguous…

Computation and Language · Computer Science 2024-06-13 Qian Chen , Dongyang Li , Xiaofeng He , Hongzhao Li , Hongyu Yi

Recent research has shown that alignment between the structure of graph data and the geometry of an embedding space is crucial for learning high-quality representations of the data. The uniform geometry of Euclidean and hyperbolic spaces…

Machine Learning · Computer Science 2023-06-27 Wei Zhao , Federico Lopez , J. Maxwell Riestenberg , Michael Strube , Diaaeldin Taha , Steve Trettel

3D-aware visual pretraining has proven effective in improving the performance of downstream robotic manipulation tasks. However, existing methods are constrained to Euclidean embedding spaces, whose flat geometry limits their ability to…

Robotics · Computer Science 2026-03-13 Jin Yang , Ping Wei , Yixin Chen , Nanning Zheng