English
Related papers

Related papers: Lossless Prioritized Embeddings

200 papers

Learning the distance metric between pairs of samples has been studied for image retrieval and clustering. With the remarkable success of pair-based metric learning losses, recent works have proposed the use of generated synthetic points on…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Byungsoo Ko , Geonmo Gu

There is recent interest in compressing data sets for non-sequential settings, where lack of obvious orderings on their data space, require notions of data equivalences to be considered. For example, Varshney & Goyal (DCC, 2006) considered…

Data Structures and Algorithms · Computer Science 2012-10-16 Fabian Lim

We formalize and study the natural approach of designing convex surrogate loss functions via embeddings, for problems such as classification, ranking, or structured prediction. In this approach, one embeds each of the finitely many…

Machine Learning · Computer Science 2022-01-12 Jessie Finocchiaro , Rafael Frongillo , Bo Waggoner

Why do we forget? Why do we remember things that never happened? The conventional answer points to biological hardware. We propose a different one: geometry. Here we show that high-dimensional embedding spaces, subjected to noise,…

Neurons and Cognition · Quantitative Biology 2026-04-09 Sambartha Ray Barman , Andrey Starenky , Sophia Bodnar , Nikhil Narasimhan , Ashwin Gopinath

In the context of pose-invariant object recognition and retrieval, we demonstrate that it is possible to achieve significant improvements in performance if both the category-based and the object-identity-based embeddings are learned…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Rohan Sarkar , Avinash Kak

We study general properties of holomorphic isometric embeddings of complex unit balls $\mathbb B^n$ into bounded symmetric domains of rank $\ge 2$. In the first part, we study holomorphic isometries from $(\mathbb B^n,kg_{\mathbb B^n})$ to…

Complex Variables · Mathematics 2018-04-25 Shan Tai Chan

Edit distance is a fundamental measure of distance between strings and has been widely studied in computer science. While the problem of estimating edit distance has been studied extensively, the equally important question of actually…

Data Structures and Algorithms · Computer Science 2018-05-08 Moses Charikar , Ofir Geri , Michael P. Kim , William Kuszmaul

Learning the embedding space, where semantically similar objects are located close together and dissimilar objects far apart, is a cornerstone of many computer vision applications. Existing approaches usually learn a single metric in the…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Artsiom Sanakoyeu , Vadim Tschernezki , Uta Büchler , Björn Ommer

The main goal of this paper is to develop a new embedding method which we use to show that some finite metric spaces admit low-distortion embeddings into all non-superreflexive spaces. This method is based on the theory of…

Functional Analysis · Mathematics 2018-11-13 Mikhail I. Ostrovskii , Beata Randrianantoanina

Cohen-Addad, Filtser, Klein and Le [FOCS'20] constructed a stochastic embedding of minor-free graphs of diameter $D$ into graphs of treewidth $O_{\epsilon}(\log n)$ with expected additive distortion $+\epsilon D$. Cohen-Addad et al. then…

Data Structures and Algorithms · Computer Science 2022-03-30 Arnold Filtser , Hung Le

We study the complexity with respect to Borel reducibility of the relations of isometry and isometric embeddability between ultrametric Polish spaces for which a set $D$ of possible distances is fixed in advance. These are, respectively, an…

Logic · Mathematics 2018-12-06 Riccardo Camerlo , Alberto Marcone , Luca Motto Ros

We introduce a randomized iterative fragmentation procedure for finite metric spaces, which is guaranteed to result in a polynomially large subset that is $D$-equivalent to an ultrametric, where $D\in (2,\infty)$ is a prescribed target…

Metric Geometry · Mathematics 2010-03-23 Assaf Naor , Terence Tao

The embedding of finite metrics in $\ell_1$ has become a fundamental tool for both combinatorial optimization and large-scale data analysis. One important application is to network flow problems in which there is close relation between…

Metric Geometry · Mathematics 2014-04-21 David Bryant , Paul F. Tupper

We study embeddings of Besov-Morrey spaces ${\cal N}^{s}_{u,p,q}}({\mathbb R}^d)$ and of Triebel-Lizorkin-Morrey spaces ${\cal E}^{s}_{u,p,q}}({\mathbb R}^d)$ in the limiting cases when the smoothness $s$ equals $s_0=d\max(1/u-p/u,0)$ or…

Functional Analysis · Mathematics 2019-05-24 Dorothee D. Haroske , Susana D. Moura , Leszek Skrzypczak

Large pre-trained sentence encoders like BERT start a new chapter in natural language processing. A common practice to apply pre-trained BERT to sequence classification tasks (e.g., classification of sentences or sentence pairs) is by…

Computation and Language · Computer Science 2020-02-26 Wenxuan Zhou , Junyi Du , Xiang Ren

We present a novel online algorithm that learns the essence of each dimension in word embeddings by minimizing the within-group distance of contextualized embedding groups. Three state-of-the-art neural-based language models are used,…

Computation and Language · Computer Science 2020-05-26 Xinyi Jiang , Zhengzhe Yang , Jinho D. Choi

This paper deals with two related problems, namely distance-preserving binary embeddings and quantization for compressed sensing . First, we propose fast methods to replace points from a subset $\mathcal{X} \subset \mathbb{R}^n$, associated…

Information Theory · Computer Science 2018-07-19 Thang Huynh , Rayan Saab

In this paper, we introduce the Fixed Topology Minimum-Length Tree with Neighborhood Problem, which aims to embed a rooted tree-shaped graph into a $d$-dimensional metric space while minimizing its total length provided that the nodes must…

Optimization and Control · Mathematics 2024-09-09 Víctor Blanco , Gabriel González , Justo Puerto

This paper investigates the theoretical foundations of metric learning, focused on three key questions that are not fully addressed in prior work: 1) we consider learning general low-dimensional (low-rank) metrics as well as sparse metrics;…

Machine Learning · Statistics 2018-02-07 Lalit Jain , Blake Mason , Robert Nowak

Deep metric learning objectives (e.g., triplet loss) require storing and comparing high-dimensional embeddings, making the per-batch loss buffer scale as $O(S\cdot D)$, where $S$ is the number of samples in a batch and $D$ is the feature…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Alif Elham Khan , Mohammad Junayed Hasan , Humayra Anjum , Nabeel Mohammed