English
Related papers

Related papers: Towards Non-Euclidean Foundation Models: Advancing…

200 papers

Learning from graph-structured data is an important task in machine learning and artificial intelligence, for which Graph Neural Networks (GNNs) have shown great promise. Motivated by recent advances in geometric representation learning, we…

Machine Learning · Computer Science 2019-10-30 Qi Liu , Maximilian Nickel , Douwe Kiela

While numerous approaches have been developed to embed graphs into either Euclidean or hyperbolic spaces, they do not fully utilize the information available in graphs, or lack the flexibility to model intrinsic complex graph geometry. To…

Machine Learning · Computer Science 2020-10-26 Shichao Zhu , Shirui Pan , Chuan Zhou , Jia Wu , Yanan Cao , Bin Wang

Large pre-trained models, or foundation models, have shown impressive performance when adapted to a variety of downstream tasks, often out-performing specialized models. Hypernetworks, neural networks that generate some or all of the…

Machine Learning · Computer Science 2025-03-04 Jeffrey Gu , Serena Yeung-Levy

Learning faithful graph representations as sets of vertex embeddings has become a fundamental intermediary step in a wide range of machine learning applications. The quality of the embeddings is usually determined by how well the geometry…

Machine Learning · Computer Science 2021-05-13 Federico López , Beatrice Pozzetti , Steve Trettel , Anna Wienhard

Graphs are a widely used paradigm for representing non-Euclidean data, with applications ranging from social network analysis to biomolecular prediction. While graph learning has achieved remarkable progress, real-world graph data presents…

This paper revisits building machine learning algorithms that involve interactions between entities, such as those between financial assets in an actively managed portfolio, or interactions between users in a social network. Our goal is to…

Machine Learning · Computer Science 2022-12-05 Qiong Wu , Jian Li , Zhenming Liu , Yanhua Li , Mihai Cucuringu

Non-Euclidean constraints are inherent in many kinds of data in computer vision and machine learning, typically as a result of specific invariance requirements that need to be respected during high-level inference. Often, these geometric…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Suhas Lohit , Pavan Turaga

Given data, deep generative models, such as variational autoencoders (VAE) and generative adversarial networks (GAN), train a lower dimensional latent representation of the data space. The linear Euclidean geometry of data space pulls back…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Line Kuhnel , Tom Fletcher , Sarang Joshi , Stefan Sommer

Detecting events and their evolution through time is a crucial task in natural language understanding. Recent neural approaches to event temporal relation extraction typically map events to embeddings in the Euclidean space and train a…

Computation and Language · Computer Science 2024-06-11 Xingwei Tan , Gabriele Pergola , Yulan He

Many of the tools available for robot learning were designed for Euclidean data. However, many applications in robotics involve manifold-valued data. A common example is orientation; this can be represented as a 3-by-3 rotation matrix or a…

Robotics · Computer Science 2024-05-15 P. C. Lopez-Custodio , K. Bharath , A. Kucukyilmaz , S. P. Preston

Although Deep Learning (DL) has achieved success in complex Artificial Intelligence (AI) tasks, it suffers from various notorious problems (e.g., feature redundancy, and vanishing or exploding gradients), since updating parameters in…

Machine Learning · Computer Science 2023-02-17 Yanhong Fei , Xian Wei , Yingjie Liu , Zhengyu Li , Mingsong Chen

This paper deals with various topics in analysis on hyperbolic spaces. It surveys some recent progress in non-Euclidean Fourier Analysis and proves some new results for the geodesic Radon transform on hyperbolic spaces.

Differential Geometry · Mathematics 2007-05-23 Sigurdur Helgason

Recently, Hyperbolic Spaces in the context of Non-Euclidean Deep Learning have gained popularity because of their ability to represent hierarchical data. We propose that it is possible to take advantage of the hierarchical characteristic…

Machine Learning · Computer Science 2021-02-11 Diego Lazcano , Nicolás Fredes , Werner Creixell

We describe our initial explorations in simulating non-euclidean geometries in virtual reality. Our simulation of the product of two-dimensional hyperbolic space with one-dimensional euclidean space is available at http://h2xe.hypernom.com.

History and Overview · Mathematics 2017-02-17 Vi Hart , Andrea Hawksley , Elisabetta A. Matsumoto , Henry Segerman

How can we convince students, who have mainly learned to follow given mathematical rules, that mathematics can also be fascinating, creative, and beautiful? In this paper I discuss different ways of introducing non-Euclidean geometry to…

History and Overview · Mathematics 2021-06-01 Hanne Kekkonen

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ramzan Basheer , Deepak Mishra

Learning embeddings of entities and relations existing in knowledge bases allows the discovery of hidden patterns in data. In this work, we examine the geometrical space's contribution to the task of knowledge base completion. We focus on…

Computation and Language · Computer Science 2019-08-20 Prodromos Kolyvakis , Alexandros Kalousis , Dimitris Kiritsis

Hyperbolic geometry has emerged as an effective latent space for representing complex networks, owing to its ability to capture hierarchical organization and heterogeneous connectivity patterns using low-dimensional embeddings. As a result,…

Machine Learning · Computer Science 2026-05-01 Sofía Pérez Casulo , Marcelo Fiori , Bernardo Marenco , Federico Larroca

The development of data-dependent heuristics and representations for biological sequences that reflect their evolutionary distance is critical for large-scale biological research. However, popular machine learning approaches, based on…

Quantitative Methods · Quantitative Biology 2021-10-13 Gabriele Corso , Rex Ying , Michal Pándy , Petar Veličković , Jure Leskovec , Pietro Liò

Interfacial reconstruction between two-dimensional (2D) materials and metal substrates fundamentally governs heterostructure properties, yet conventional flat substrates fail to capture the continuous crystallographic landscape. Here, we…

Mesoscale and Nanoscale Physics · Physics 2026-01-01 Li-Qun Shen , Hao-Jin Wang , Mengzhao Sun , Yang Xiang , Xin-Ning Tian , Yue Chai , Yue Yang , Feng Ding , Xiao Kong , Marc-Georg Willinger , Zhu-Jun Wang