English
Related papers

Related papers: Minimax Rates for Hyperbolic Hierarchical Learning

200 papers

Hyperbolic spaces have proven to be suitable for modeling data of hierarchical nature. As such we use the Poincare ball to embed sentences with the goal of proving how hyperbolic spaces can be used for solving Textual Entailment. To this…

Computation and Language · Computer Science 2024-06-25 Igor Petrovski

Deep representation learning is a ubiquitous part of modern computer vision. While Euclidean space has been the de facto standard manifold for learning visual representations, hyperbolic space has recently gained rapid traction for learning…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Pascal Mettes , Mina Ghadimi Atigh , Martin Keller-Ressel , Jeffrey Gu , Serena Yeung

Hyperbolic geometry have shown significant potential in modeling complex structured data, particularly those with underlying tree-like and hierarchical structures. Despite the impressive performance of various hyperbolic neural networks…

Machine Learning · Computer Science 2025-08-26 Menglin Yang , Harshit Verma , Delvin Ce Zhang , Jiahong Liu , Irwin King , Rex Ying

A fundamental question in the theory of reinforcement learning is: suppose the optimal $Q$-function lies in the linear span of a given $d$ dimensional feature mapping, is sample-efficient reinforcement learning (RL) possible? The recent and…

Machine Learning · Computer Science 2021-10-22 Yuanhao Wang , Ruosong Wang , Sham M. Kakade

With the daily influx of 3D data on the internet, text-3D retrieval has gained increasing attention. However, current methods face two major challenges: Hierarchy Representation Collapse (HRC) and Redundancy-Induced Saliency Dilution…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Wenrui Li , Yidan Lu , Yeyu Chai , Rui Zhao , Hengyu Man , Xiaopeng Fan

Most mathematical distortions used in ML are fundamentally integral in nature: $f$-divergences, Bregman divergences, (regularized) optimal transport distances, integral probability metrics, geodesic distances, etc. In this paper, we unveil…

Machine Learning · Computer Science 2024-10-01 Richard Nock , Ehsan Amid , Frank Nielsen , Alexander Soen , Manfred K. Warmuth

In this paper, we systematically study the regularity theory of the linear system of nearly incompressible elasticity. In the setting of stochastic homogenization, we develop new techniques to establish the large-scale estimates of…

Analysis of PDEs · Mathematics 2021-04-02 Shu Gu , Jinping Zhuge

Let $n$ be a positive integer. We provide an explicit geometrically motivated $1$-Lipschitz map from the space of persistence diagrams on $n$ points (equipped with the Bottleneck distance) into the Hilbert space $\ell^2$. Such maps are a…

Metric Geometry · Mathematics 2025-10-28 Atish Mitra , Ziga Virk

To minimize or upper-bound the value of a function "robustly", we might instead minimize or upper-bound the "epsilon-robust regularization", defined as the map from a point to the maximum value of the function within an epsilon-radius. This…

Optimization and Control · Mathematics 2010-06-10 Adrian S. Lewis , C. H. Jeffrey Pang

The problem of ensuring constraints satisfaction on the output of machine learning models is critical for many applications, especially in safety-critical domains. Modern approaches rely on penalty-based methods at training time, which do…

Machine Learning · Computer Science 2025-04-14 Gaetano Signorelli , Michele Lombardi

For the parabolic obstacle-problem-like equation $$\Delta u - \partial_t u = \lambda_+ \chi_{\{u>0\}} - \lambda_- \chi_{\{u<0\}} ,$$ where $\lambda_+$ and $\lambda_-$ are positive Lipschitz functions, we prove in arbitrary finite dimension…

Analysis of PDEs · Mathematics 2007-12-21 Henrik Shahgholian , Nina Uraltseva , Georg S. Weiss

In this work, we propose a fashion item recommendation model that incorporates hyperbolic geometry into user and item representations. Using hyperbolic space, our model aims to capture implicit hierarchies among items based on their visual…

Information Retrieval · Computer Science 2024-09-05 Ryotaro Shimizu , Yu Wang , Masanari Kimura , Yuki Hirakawa , Takashi Wada , Yuki Saito , Julian McAuley

A matrix $M: A \times X \rightarrow \{-1,1\}$ corresponds to the following learning problem: An unknown element $x \in X$ is chosen uniformly at random. A learner tries to learn $x$ from a stream of samples, $(a_1, b_1), (a_2, b_2) \ldots$,…

Machine Learning · Computer Science 2017-08-10 Sumegha Garg , Ran Raz , Avishay Tal

Let $S$ be a punctured Riemann surface with Euler characteristic $\chi(S)<0$. For any unitary representation $\rho: \pi_1(S) \to U(N)$, we introduce its renormalized energy and its harmonic representatives, which are equivariant harmonic…

Differential Geometry · Mathematics 2025-08-29 Antoine Song

Neural embeddings have been used with great success in Natural Language Processing (NLP). They provide compact representations that encapsulate word similarity and attain state-of-the-art performance in a range of linguistic tasks. The…

Machine Learning · Statistics 2018-09-20 Benjamin Paul Chamberlain , James Clough , Marc Peter Deisenroth

Learning unbiased node representations for imbalanced samples in the graph has become a more remarkable and important topic. For the graph, a significant challenge is that the topological properties of the nodes (e.g., locations, roles) are…

Machine Learning · Computer Science 2023-04-12 Xingcheng Fu , Yuecen Wei , Qingyun Sun , Haonan Yuan , Jia Wu , Hao Peng , Jianxin Li

Hierarchy is a natural representation of semantic taxonomies, including the ones routinely used in image segmentation. Indeed, recent work on semantic segmentation reports improved accuracy from supervised training leveraging hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Simon Weber , Barış Zöngür , Nikita Araslanov , Daniel Cremers

In recent years, there has been a growing trend of incorporating hyperbolic geometry methods into computer vision. While these methods have achieved state-of-the-art performance on various metric learning tasks using hyperbolic distance…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Yun Yue , Fangzhou Lin , Guanyi Mou , Ziming Zhang

Recently, Hyperbolic Spaces in the context of Non-Euclidean Deep Learning have gained popularity because of their ability to represent hierarchical data. We propose that it is possible to take advantage of the hierarchical characteristic…

Machine Learning · Computer Science 2021-02-11 Diego Lazcano , Nicolás Fredes , Werner Creixell

Recent knowledge graph embedding (KGE) models based on hyperbolic geometry have shown great potential in a low-dimensional embedding space. However, the necessity of hyperbolic space in KGE is still questionable, because the calculation…

Artificial Intelligence · Computer Science 2021-10-26 Kai Wang , Yu Liu , Dan Lin , Quan Z. Sheng