English
Related papers

Related papers: Single-shot Embedding Dimension Search in Recommen…

200 papers

Spectral embedding based on the Singular Value Decomposition (SVD) is a widely used "preprocessing" step in many learning tasks, typically leading to dimensionality reduction by projecting onto a number of dominant singular vectors and…

Machine Learning · Statistics 2015-09-29 Dinesh Ramasamy , Upamanyu Madhow

In recent years, deep metric learning has achieved promising results in learning high dimensional semantic feature embeddings where the spatial relationships of the feature vectors match the visual similarities of the images. Similarity…

Machine Learning · Computer Science 2019-09-25 Konstantin Schall , Kai Uwe Barthel , Nico Hezel , Klaus Jung

An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few…

Methodology · Statistics 2021-09-28 Di Bo , Hoon Hwangbo , Vinit Sharma , Corey Arndt , Stephanie C. TerMaath

Dense retrieval represents queries and documents as high-dimensional embeddings, but these representations can be redundant at the query level: for a given information need, only a subset of dimensions is consistently helpful for ranking.…

Information Retrieval · Computer Science 2026-02-10 Zhanyu Wu , Richong Zhang , Zhijie Nie

Signal dimension, defined here as the number of copies with different delays or angular shifts, is a prerequisite for many high-resolution delay estimation and direction-finding algorithms in sensing and communication systems. Thus,…

Signal Processing · Electrical Eng. & Systems 2025-08-15 Yugang Ma , Yonghong Zeng , Sumei Sun , Gary Lee , Ernest Kurniawan , Francois Chin Po Shin

Time-series data in application areas such as motion capture and activity recognition is often multi-dimension. In these application areas data typically comes from wearable sensors or is extracted from video. There is a lot of redundancy…

Machine Learning · Computer Science 2021-04-23 Bahavathy Kathirgamanathan , Padraig Cunningham

Gradient-based dimension reduction decreases the cost of Bayesian inference and probabilistic modeling by identifying maximally informative (and informed) low-dimensional projections of the data and parameters, allowing high-dimensional…

Computation · Statistics 2025-06-02 Ricardo Baptista , Michael Brennan , Youssef Marzouk

Embedding image features into a binary Hamming space can improve both the speed and accuracy of large-scale query-by-example image retrieval systems. Supervised hashing aims to map the original features to compact binary codes in a manner…

Machine Learning · Computer Science 2016-11-17 Guosheng Lin , Chunhua Shen , Anton van den Hengel

At Pinterest, we utilize image embeddings throughout our search and recommendation systems to help our users navigate through visual content by powering experiences like browsing of related content and searching for exact products for…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Andrew Zhai , Hao-Yu Wu , Eric Tzeng , Dong Huk Park , Charles Rosenberg

Metric embeddings are a widely used method in algorithm design, where generally a ``complex'' metric is embedded into a simpler, lower-dimensional one. Historically, the theoretical computer science community has focused on bi-Lipschitz…

Data Structures and Algorithms · Computer Science 2025-05-19 Ainesh Bakshi , Vincent Cohen-Addad , Samuel B. Hopkins , Rajesh Jayaram , Silvio Lattanzi

Feature selection, dimension selection, and embedding compression are fundamental techniques for improving efficiency and generalization in deep recommender systems. Although conceptually related, these problems are typically studied in…

Machine Learning · Computer Science 2026-04-10 Yihong Huang , Chen Chu , Fan Zhang , Liping Wang Fei Chen , Yu Lin , Ruiduan Li , Zhihao Li

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

A key characteristic of deep recommendation models is the immense memory requirements of their embedding tables. These embedding tables can often reach hundreds of gigabytes which increases hardware requirements and training cost. A common…

Modern DNN-based recommendation systems rely on training-derived embeddings of sparse features. Input sparsity makes obtaining high-quality embeddings for rarely-occurring categories harder as their representations are updated infrequently.…

Machine Learning · Computer Science 2023-09-29 Zihao Deng , Benjamin Ghaemmaghami , Ashish Kumar Singh , Benjamin Cho , Leo Orshansky , Mattan Erez , Michael Orshansky

Training recommender systems for next-item recommendation often requires unique embeddings to be learned for each item, which may take up most of the trainable parameters for a model. Shared embeddings, such as using content information,…

Information Retrieval · Computer Science 2025-07-28 M. Jeffrey Mei , Florian Henkel , Samuel E. Sandberg , Oliver Bembom , Andreas F. Ehmann

In this paper, we address a similarity search problem for spatial trajectories in road networks. In particular, we focus on the subtrajectory similarity search problem, which involves finding in a database the subtrajectories similar to a…

Databases · Computer Science 2020-07-13 Satoshi Koide , Chuan Xiao , Yoshiharu Ishikawa

Federated learning has become a popular tool in the big data era nowadays. It trains a centralized model based on data from different clients while keeping data decentralized. In this paper, we propose a federated sparse sliced inverse…

Machine Learning · Statistics 2023-01-24 Wenquan Cui , Yue Zhao , Jianjun Xu , Haoyang Cheng

Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance…

Information Retrieval · Computer Science 2024-05-24 Yuting Liu , Enneng Yang , Yizhou Dang , Guibing Guo , Qiang Liu , Yuliang Liang , Linying Jiang , Xingwei Wang

We address the problem of sufficient dimension reduction for feature matrices, which arises often in sensor network localization, brain neuroimaging, and electroencephalography analysis. In general, feature matrices have both row- and…

Methodology · Statistics 2023-03-09 Chanwoo Lee

Despite the prominence of neural network approaches in the field of recommender systems, simple methods such as matrix factorization with quadratic loss are still used in industry for several reasons. These models can be trained with…

Information Retrieval · Computer Science 2022-05-24 Dmitrii Beloborodov , Andrei Zimovnov , Petr Molodyk , Dmitrii Kirillov