English
Related papers

Related papers: Low-rank approximations of hyperbolic embeddings

200 papers

Finding a low dimensional representation of hierarchical, structured data described by a network remains a challenging problem in the machine learning community. An emerging approach is embedding these networks into hyperbolic space because…

Social and Information Networks · Computer Science 2019-05-03 David McDonald , Shan He

Multidimensional scaling (MDS) is a widely used approach to representing high-dimensional, dependent data. MDS works by assigning each observation a location on a low-dimensional geometric manifold, with distance on the manifold…

Methodology · Statistics 2023-08-16 Bolun Liu , Shane Lubold , Adrian E. Raftery , Tyler H. McCormick

Embeddings mapping high-dimensional discrete input to lower-dimensional continuous vector spaces have been widely adopted in machine learning applications as a way to capture domain semantics. Interviewing 13 embedding users across…

Human-Computer Interaction · Computer Science 2022-03-07 Angie Boggust , Brandon Carter , Arvind Satyanarayan

We consider the task of inferring is-a relationships from large text corpora. For this purpose, we propose a new method combining hyperbolic embeddings and Hearst patterns. This approach allows us to set appropriate constraints for…

Computation and Language · Computer Science 2019-02-05 Matt Le , Stephen Roller , Laetitia Papaxanthos , Douwe Kiela , Maximilian Nickel

This paper addresses the problem of low-rank distance matrix completion. This problem amounts to recover the missing entries of a distance matrix when the dimension of the data embedding space is possibly unknown but small compared to the…

Optimization and Control · Mathematics 2013-04-26 B. Mishra , G. Meyer , R. Sepulchre

Network embedding is a fervid topic in current networks science and observes that most real complex systems can be embedded in hidden metrics space and emerge as the geometrical property, where the geometric distance between nodes…

Physics and Society · Physics 2020-04-28 Zongning Wu , Zengru Di , Ying Fan

We propose a new class of deep reinforcement learning (RL) algorithms that model latent representations in hyperbolic space. Sequential decision-making requires reasoning about the possible future consequences of current behavior.…

Machine Learning · Computer Science 2022-10-05 Edoardo Cetin , Benjamin Chamberlain , Michael Bronstein , Jonathan J Hunt

The recovery of the intrinsic geometric structures of data collections is an important problem in data analysis. Supervised extensions of several manifold learning approaches have been proposed in the recent years. Meanwhile, existing…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Cem Ornek , Elif Vural

We use pinched smooth hyperbolization to show that every closed, nonpositively curved $n$-dimensional manifold $M$ can be embedded as a totally geodesic submanifold of a closed, nonpositively curved $(n+1)$-dimensional manifold $\hat{M}$ of…

Differential Geometry · Mathematics 2012-06-15 T. Tam Nguyen Phan

We consider the problem of embedding entities and relations of knowledge bases in low-dimensional vector spaces. Unlike most existing approaches, which are primarily efficient for modeling equivalence relations, our approach is designed to…

Machine Learning · Computer Science 2013-04-29 Antoine Bordes , Nicolas Usunier , Alberto Garcia-Duran , Jason Weston , Oksana Yakhnenko

We consider dynamical low-rank approximations to parabolic problems on higher-order tensor manifolds in Hilbert spaces. In addition to existence of solutions and their stability with respect to perturbations to the problem data, we show…

Numerical Analysis · Mathematics 2025-05-19 Markus Bachmayr , Henrik Eisenmann , André Uschmajew

Many modern multiclass and multilabel problems are characterized by increasingly large output spaces. For these problems, label embeddings have been shown to be a useful primitive that can improve computational and statistical efficiency.…

Machine Learning · Computer Science 2015-07-07 Paul Mineiro , Nikos Karampatziakis

Natural language definitions possess a recursive, self-explanatory semantic structure that can support representation learning methods able to preserve explicit conceptual relations and constraints in the latent space. This paper presents a…

Computation and Language · Computer Science 2024-02-19 Marco Valentino , Danilo S. Carvalho , André Freitas

Hyperbolic programming is the problem of computing the infimum of a linear function when restricted to the hyperbolicity cone of a hyperbolic polynomial, a generalization of semidefinite programming. We propose an approach based on symbolic…

Optimization and Control · Mathematics 2018-02-07 Simone Naldi , Daniel Plaumann

Neural language models learn word representations, or embeddings, that capture rich linguistic and conceptual information. Here we investigate the embeddings learned by neural machine translation models, a recently-developed class of neural…

Computation and Language · Computer Science 2015-04-06 Felix Hill , Kyunghyun Cho , Sebastien Jean , Coline Devin , Yoshua Bengio

In graph representation learning, it is important that the complex geometric structure of the input graph, e.g. hidden relations among nodes, is well captured in embedding space. However, standard Euclidean embedding spaces have a limited…

Machine Learning · Computer Science 2023-07-11 Tuc Nguyen-Van , Dung D. Le , The-Anh Ta

Matrix factorization is a popular framework for modeling low-rank data matrices. Motivated by manifold learning problems, this paper proposes a quadratic matrix factorization (QMF) framework to learn the curved manifold on which the dataset…

Machine Learning · Computer Science 2023-01-31 Zheng Zhai , Hengchao Chen , Qiang Sun

This work proposes an algorithm for explicitly constructing a pair of neural networks that linearize and reconstruct an embedded submanifold, from finite samples of this manifold. Our such-generated neural networks, called Flattening…

Machine Learning · Computer Science 2023-09-11 Michael Psenka , Druv Pai , Vishal Raman , Shankar Sastry , Yi Ma

Hyperbolic representation learning is well known for its ability to capture hierarchical information. However, the distance between samples from different levels of hierarchical classes can be required large. We reveal that the hyperbolic…

Machine Learning · Computer Science 2024-10-30 Kun Song , Ruben Solozabal , Li hao , Lu Ren , Moloud Abdar , Qing Li , Fakhri Karray , Martin Takac

Low-rank metric learning aims to learn better discrimination of data subject to low-rank constraints. It keeps the intrinsic low-rank structure of datasets and reduces the time cost and memory usage in metric learning. However, it is still…

Machine Learning · Computer Science 2019-09-16 Han Liu , Zhizhong Han , Yu-Shen Liu , Ming Gu