English
Related papers

Related papers: From Hyperbolic Geometry Back to Word Embeddings

200 papers

Representing data in hyperbolic space can effectively capture latent hierarchical relationships. With the goal of enabling accurate classification of points in hyperbolic space while respecting their hyperbolic geometry, we introduce…

Machine Learning · Computer Science 2018-06-04 Hyunghoon Cho , Benjamin DeMeo , Jian Peng , Bonnie Berger

As an ubiquitous method in natural language processing, word embeddings are extensively employed to map semantic properties of words into a dense vector representation. They capture semantic and syntactic relations among words but the…

Computation and Language · Computer Science 2020-07-03 Lutfi Kerem Senel , Ihsan Utlu , Furkan Şahinuç , Haldun M. Ozaktas , Aykut Koç

Integrating visual and linguistic information into a single multimodal representation is an unsolved problem with wide-reaching applications to both natural language processing and computer vision. In this paper, we present a simple method…

Machine Learning · Statistics 2017-03-28 Guillem Collell , Teddy Zhang , Marie-Francine Moens

Hyperbolic spaces have proven to be suitable for modeling data of hierarchical nature. As such we use the Poincare ball to embed sentences with the goal of proving how hyperbolic spaces can be used for solving Textual Entailment. To this…

Computation and Language · Computer Science 2024-06-25 Igor Petrovski

Word Embeddings are used widely in multiple Natural Language Processing (NLP) applications. They are coordinates associated with each word in a dictionary, inferred from statistical properties of these words in a large corpus. In this paper…

Computation and Language · Computer Science 2020-06-18 Adam Sutton , Nello Cristianini

Human proximity networks are temporal networks representing the close-range proximity among humans in a physical space. They have been extensively studied in the past 15 years as they are critical for understanding the spreading of diseases…

Physics and Society · Physics 2020-11-24 Marco A. Rodríguez-Flores , Fragkiskos Papadopoulos

We consider the task of inferring is-a relationships from large text corpora. For this purpose, we propose a new method combining hyperbolic embeddings and Hearst patterns. This approach allows us to set appropriate constraints for…

Computation and Language · Computer Science 2019-02-05 Matt Le , Stephen Roller , Laetitia Papaxanthos , Douwe Kiela , Maximilian Nickel

Geometric relational embeddings map relational data as geometric objects that combine vector information suitable for machine learning and structured/relational information for structured/relational reasoning, typically in low dimensions.…

Artificial Intelligence · Computer Science 2023-04-25 Bo Xiong , Mojtaba Nayyeri , Ming Jin , Yunjie He , Michael Cochez , Shirui Pan , Steffen Staab

Word embedding is designed to represent the semantic meaning of a word with low dimensional vectors. The state-of-the-art methods of learning word embeddings (word2vec and GloVe) only use the word co-occurrence information. The learned…

Computation and Language · Computer Science 2018-09-11 Ruixuan Luo

Consider the Poincare disc model for hyperbolic geometry. In this paper, a convenient computational formula is developed along with an aesthetic geometric interpretation. Two proofs, one geometric and one analytical, of each result are…

Metric Geometry · Mathematics 2007-05-23 Benjamin Aaron Bailey

Metric learning aims to learn a highly discriminative model encouraging the embeddings of similar classes to be close in the chosen metrics and pushed apart for dissimilar ones. The common recipe is to use an encoder to extract embeddings…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Aleksandr Ermolov , Leyla Mirvakhabova , Valentin Khrulkov , Nicu Sebe , Ivan Oseledets

Advances in natural language processing have resulted in increased capabilities with respect to multiple tasks. One of the possible causes of the observed performance gains is the introduction of increasingly sophisticated text…

Computation and Language · Computer Science 2020-11-19 Sarah Tymochko , Zachary New , Lucius Bynum , Emilie Purvine , Timothy Doster , Julien Chaput , Tegan Emerson

The hyperbolic manifold is a smooth manifold of negative constant curvature. While the hyperbolic manifold is well-studied in the literature, it has gained interest in the machine learning and natural language processing communities lately…

Machine Learning · Computer Science 2019-03-19 Pratik Jawanpuria , Mayank Meghwanshi , Bamdev Mishra

A challenging task for word embeddings is to capture the emergent meaning or polarity of a combination of individual words. For example, existing approaches in word embeddings will assign high probabilities to the words "Penguin" and "Fly"…

Computation and Language · Computer Science 2018-05-30 Qiuchi Li , Sagar Uprety , Benyou Wang , Dawei Song

A hyperbolic reflection group is a discrete group generated by reflections in the faces of an $n$-dimensional hyperbolic polyhedron. This survey article is dedicated to the study of arithmetic hyperbolic reflection groups with an emphasis…

Geometric Topology · Mathematics 2016-07-06 Mikhail Belolipetsky

In this note we explicitly compute the resonances on hyperbolic cones. These are hyperbolic manifolds with a conic singularity equipped with a warped product metric. The calculation is based on separation of variables and Kummer's…

Analysis of PDEs · Mathematics 2017-10-18 Dean Baskin , Jeremy L. Marzuola

This work presents a novel methodology for calculating the phonetic similarity between words taking motivation from the human perception of sounds. This metric is employed to learn a continuous vector embedding space that groups similar…

Computation and Language · Computer Science 2021-10-01 Rahul Sharma , Kunal Dhawan , Balakrishna Pailla

This paper studies decision problems for semigroups that are word-hyperbolic in the sense of Duncan & Gilman. A fundamental investigation reveals that the natural definition of a `word-hyperbolic structure' has to be strengthened slightly…

Group Theory · Mathematics 2015-05-27 Alan J. Cain , Markus Pfeiffer

Word evolution refers to the changing meanings and associations of words throughout time, as a byproduct of human language evolution. By studying word evolution, we can infer social trends and language constructs over different periods of…

Computation and Language · Computer Science 2018-02-14 Zijun Yao , Yifan Sun , Weicong Ding , Nikhil Rao , Hui Xiong

Open-vocabulary semantic segmentation requires adapting image-level vision-language models such as CLIP to dense pixel-level prediction, which is challenging due to the mismatch between hierarchical structure and semantic alignment in the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Hoang M. Truong , Hai Nguyen-Truong , Dang Huynh