English
Related papers

Related papers: Single-shot Embedding Dimension Search in Recommen…

200 papers

Embedding representations power machine intelligence in many applications, including recommendation systems, but they are space intensive -- potentially occupying hundreds of gigabytes in large-scale settings. To help manage this outsized…

Machine Learning · Computer Science 2021-02-09 Antonio Ginart , Maxim Naumov , Dheevatsa Mudigere , Jiyan Yang , James Zou

Content-based Recommender Systems (CRSs) play a crucial role in shaping user experiences in e-commerce, online advertising, and personalized recommendations. However, due to the vast amount of categorical features, the embedding tables used…

Information Retrieval · Computer Science 2025-02-04 Hung Vinh Tran , Tong Chen , Guanhua Ye , Quoc Viet Hung Nguyen , Kai Zheng , Hongzhi Yin

At the heart of contemporary recommender systems (RSs) are latent factor models that provide quality recommendation experience to users. These models use embedding vectors, which are typically of a uniform and fixed size, to represent users…

Information Retrieval · Computer Science 2026-02-05 Yunke Qu , Tong Chen , Quoc Viet Hung Nguyen , Hongzhi Yin

Deep learning based recommender systems (DLRSs) often have embedding layers, which are utilized to lessen the dimensionality of categorical variables (e.g. user/item identifiers) and meaningfully transform them in the low-dimensional space.…

Information Retrieval · Computer Science 2020-03-03 Xiangyu Zhao , Chong Wang , Ming Chen , Xudong Zheng , Xiaobing Liu , Jiliang Tang

Dense retrieval, which encodes queries and documents into a single dense vector, has become the dominant neural retrieval approach due to its simplicity and compatibility with fast approximate nearest neighbor algorithms. As the tasks dense…

Information Retrieval · Computer Science 2026-02-06 Julian Killingback , Mahta Rafiee , Madine Manas , Hamed Zamani

The applications of traditional statistical feature selection methods to high-dimension, low sample-size data often struggle and encounter challenging problems, such as overfitting, curse of dimensionality, computational infeasibility, and…

Machine Learning · Statistics 2023-12-19 Kexuan Li , Fangfang Wang , Lingli Yang , Ruiqi Liu

Unsupervised dimension selection is an important problem that seeks to reduce dimensionality of data, while preserving the most useful characteristics. While dimensionality reduction is commonly utilized to construct low-dimensional…

Machine Learning · Statistics 2018-11-01 Jayaraman J. Thiagarajan , Rushil Anirudh , Rahul Sridhar , Peer-Timo Bremer

Current recommender systems employ large-sized embedding tables with uniform dimensions for all features, leading to overfitting, high computational cost, and suboptimal generalizing performance. Many techniques aim to solve this issue by…

Information Retrieval · Computer Science 2023-09-18 Yakun Yu , Shi-ang Qi , Jiuding Yang , Liyao Jiang , Di Niu

Modern deep learning-based recommendation systems exploit hundreds to thousands of different categorical features, each with millions of different categories ranging from clicks to posts. To respect the natural diversity within the…

Machine Learning · Computer Science 2020-06-30 Hao-Jun Michael Shi , Dheevatsa Mudigere , Maxim Naumov , Jiyan Yang

We address the problem of tuning word embeddings for specific use cases and domains. We propose a new method that automatically combines multiple domain-specific embeddings, selected from a wide range of pre-trained domain-specific…

Computation and Language · Computer Science 2019-09-06 Laura Rettig , Julien Audiffren , Philippe Cudré-Mauroux

We present a novel view of nonlinear manifold learning using derivative-free optimization techniques. Specifically, we propose an extension of the classical multi-dimensional scaling (MDS) method, where instead of performing gradient…

Node embedding methods find latent lower-dimensional representations which are used as features in machine learning models. In the last few years, these methods have become extremely popular as a replacement for manual feature engineering.…

Social and Information Networks · Computer Science 2020-06-01 Christoph Martin , Meike Riebeling

Input features play a crucial role in DNN-based recommender systems with thousands of categorical and continuous fields from users, items, contexts, and interactions. Noisy features and inappropriate embedding dimension assignments can…

Information Retrieval · Computer Science 2023-11-14 Yao Yao , Bin Liu , Haoxun He , Dakui Sheng , Ke Wang , Li Xiao , Huanhuan Cao

Background: Embedded feature selection in high-dimensional data with very small sample sizes requires optimized hyperparameters for the model building process. For this hyperparameter optimization, nested cross-validation must be applied to…

Machine Learning · Computer Science 2022-09-13 Sigrun May , Sven Hartmann , Frank Klawonn

Feature selection is a crucial step in machine learning, especially for high-dimensional datasets, where irrelevant and redundant features can degrade model performance and increase computational costs. This paper proposes a novel…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Azam Asilian Bidgoli , Shahryar Rahnamayan

The embedding-based architecture has become the dominant approach in modern recommender systems, mapping users and items into a compact vector space. It then employs predefined similarity metrics, such as the inner product, to calculate…

Information Retrieval · Computer Science 2024-04-19 Liang Qu , Yun Lin , Wei Yuan , Xiaojun Wan , Yuhui Shi , Hongzhi Yin

Feature subset selection, as a special case of the general subset selection problem, has been the topic of a considerable number of studies due to the growing importance of data-mining applications. In the feature subset selection problem…

Machine Learning · Computer Science 2014-11-13 Tofigh Naghibi , Sarah Hoffmann , Beat Pfister

Explainable recommendation is far from being well solved partly due to three challenges. The first is the personalization of preference learning, which requires that different items/users have different contributions to the learning of user…

Information Retrieval · Computer Science 2020-01-29 Huanrui Luo , Ning Yang , Philip S. Yu

The objective of this paper is to design an embedding method that maps local features describing an image (e.g. SIFT) to a higher dimensional representation useful for the image retrieval problem. First, motivated by the relationship…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Thanh-Toan Do , Ngai-Man Cheung

Personalized size and fit recommendations bear crucial significance for any fashion e-commerce platform. Predicting the correct fit drives customer satisfaction and benefits the business by reducing costs incurred due to size-related…