English

A Critique of the Smooth Inverse Frequency Sentence Embeddings

Computation and Language 2019-10-01 v1
Authors: Aidana Karipbayeva , Alena Sorokina , Zhenisbek Assylbekov
View on arXiv ↗ PDF ↗

Abstract

We critically review the smooth inverse frequency sentence embedding method of Arora, Liang, and Ma (2017), and show inconsistencies in its setup, derivation, and evaluation.

Keywords

sentence embeddings smooth inverse frequency critique evaluation

Cite

@article{arxiv.1909.13494,
  title  = {A Critique of the Smooth Inverse Frequency Sentence Embeddings},
  author = {Aidana Karipbayeva and Alena Sorokina and Zhenisbek Assylbekov},
  journal= {arXiv preprint arXiv:1909.13494},
  year   = {2019}
}

Comments

2 pages, 2 figures, Abstract

Related papers

View all related →
Computation and Language · Computer Science
Instance Smoothed Contrastive Learning for Unsupervised Sentence Embedding
Hongliang He, Junlei Zhang, Zhenzhong Lan, Yue Zhang
2023-05-19
Computation and Language · Computer Science
Sentence Meta-Embeddings for Unsupervised Semantic Textual Similarity
Nina Poerner, Ulli Waltinger, Hinrich Schütze
2020-06-25
Computation and Language · Computer Science
Towards Lossless Encoding of Sentences
Gabriele Prato, Mathieu Duchesneau, Sarath Chandar, Alain Tapp
2019-08-05
Computation and Language · Computer Science
Encouraging Paragraph Embeddings to Remember Sentence Identity Improves Classification
Tu Vu, Mohit Iyyer
2019-06-11
Computation and Language · Computer Science
Investigating the Frequency Distortion of Word Embeddings and Its Impact on Bias Metrics
Francisco Valentini, Juan Cruz Sosa, Diego Fernandez Slezak, Edgar Altszyler
2023-10-23
Computer Vision and Pattern Recognition · Computer Science
Compositional Inversion for Stable Diffusion Models
Xulu Zhang, Xiao-Yong Wei, Jinlin Wu, Tianyi Zhang +3
2024-01-12
Computation and Language · Computer Science
Concatenated Power Mean Word Embeddings as Universal Cross-Lingual Sentence Representations
Andreas Rücklé, Steffen Eger, Maxime Peyrard, Iryna Gurevych
2018-09-13
Computation and Language · Computer Science
Relational Sentence Embedding for Flexible Semantic Matching
Bin Wang, Haizhou Li
2023-06-09
Computation and Language · Computer Science
Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Features
Matteo Pagliardini, Prakhar Gupta, Martin Jaggi
2018-12-31
Computation and Language · Computer Science
Factors Influencing the Surprising Instability of Word Embeddings
Laura Wendlandt, Jonathan K. Kummerfeld, Rada Mihalcea
2020-06-05
Computation and Language · Computer Science
Static Word Embeddings for Sentence Semantic Representation
Takashi Wada, Yuki Hirakawa, Ryotaro Shimizu, Takahiro Kawashima +1
2025-10-01
Computation and Language · Computer Science
MCSE: Multimodal Contrastive Learning of Sentence Embeddings
Miaoran Zhang, Marius Mosbach, David Ifeoluwa Adelani, Michael A. Hedderich +1
2022-04-26
Audio and Speech Processing · Electrical Eng. & Systems
Evaluating the reliability of acoustic speech embeddings
Robin Algayres, Mohamed Salah Zaiem, Benoit Sagot, Emmanuel Dupoux
2020-11-09
Computation and Language · Computer Science
A Comparative Study of Sentence Embedding Models for Assessing Semantic Variation
Deven M. Mistry, Ali A. Minai
2023-08-10
Computation and Language · Computer Science
Pitfalls in the Evaluation of Sentence Embeddings
Steffen Eger, Andreas Rücklé, Iryna Gurevych
2019-06-05
Computation and Language · Computer Science
Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representation
Deng Cai, Xin Li, Jackie Chun-Sing Ho, Lidong Bing +1
2022-10-19
Computation and Language · Computer Science
Sentence Embeddings by Ensemble Distillation
Fredrik Carlsson Magnus Sahlgren
2021-04-15
Computation and Language · Computer Science
Revisiting Recurrent Networks for Paraphrastic Sentence Embeddings
John Wieting, Kevin Gimpel
2017-05-02
Analysis of PDEs · Mathematics
Extended Sampling Method in Inverse Scattering
Juan Liu, Jiguang Sun
2018-08-01
Computation and Language · Computer Science
DebCSE: Rethinking Unsupervised Contrastive Sentence Embedding Learning in the Debiasing Perspective
Pu Miao, Zeyao Du, Junlin Zhang
2023-09-15
Computation and Language · Computer Science
Unsupervised Sentence Representations as Word Information Series: Revisiting TF--IDF
Ignacio Arroyo-Fernández, Carlos-Francisco Méndez-Cruz, Gerardo Sierra, Juan-Manuel Torres-Moreno +1
2017-10-23
Computation and Language · Computer Science
Text Simplification with Sentence Embeddings
Matthew Shardlow
2025-10-29
Computation and Language · Computer Science
Comparison and Combination of Sentence Embeddings Derived from Different Supervision Signals
Hayato Tsukagoshi, Ryohei Sasano, Koichi Takeda
2022-06-13
Computation and Language · Computer Science
Return of the RNN: Residual Recurrent Networks for Invertible Sentence Embeddings
Jeremy Wilkerson
2023-04-07
Computation and Language · Computer Science
An Analysis of Semantically-Aligned Speech-Text Embeddings
Muhammad Huzaifah, Ivan Kukanov
2023-01-20