English
Related papers

Related papers: Learning to Embed Categorical Features without Emb…

200 papers

Recently, the growing memory demands of embedding tables in Deep Learning Recommendation Models (DLRMs) pose great challenges for model training and deployment. Existing embedding compression solutions cannot simultaneously meet three key…

Machine Learning · Computer Science 2024-03-28 Hailin Zhang , Zirui Liu , Boxuan Chen , Yikai Zhao , Tong Zhao , Tong Yang , Bin Cui

Deep learning-based recommendation systems (e.g., DLRMs) are widely used AI models to provide high-quality personalized recommendations. Training data used for modern recommendation systems commonly includes categorical features taking on…

Information Retrieval · Computer Science 2026-01-06 Gopi Krishna Jha , Anthony Thomas , Nilesh Jain , Sameh Gobriel , Tajana Rosing , Ravi Iyer

Deep learning has revolutionized many industries by enabling models to automatically learn complex patterns from raw data, reducing dependence on manual feature engineering. However, deep learning algorithms are sensitive to input data, and…

Machine Learning · Computer Science 2025-07-21 Mert Sehri , Zehui Hua , Francisco de Assis Boldt , Patrick Dumond

Network embedding has proved extremely useful in a variety of network analysis tasks such as node classification, link prediction, and network visualization. Almost all the existing network embedding methods learn to map the node IDs to…

Machine Learning · Computer Science 2019-08-14 Tianshu Lyu , Fei Sun , Peng Jiang , Wenwu Ou , Yan Zhang

Recently, neural network based methods have shown their power in learning more expressive features on the task of knowledge graph embedding (KGE). However, the performance of deep methods often falls behind the shallow ones on simple…

Computation and Language · Computer Science 2022-11-10 Zhu Danhao , Shen Si , Huang Shujian , Yin Chang , Ding Ziqi

Category information plays a crucial role in enhancing the quality and personalization of recommender systems. Nevertheless, the availability of item category information is not consistently present, particularly in the context of ID-based…

Information Retrieval · Computer Science 2024-03-18 Qijiong Liu , Lu Fan , Jiaren Xiao , Jieming Zhu , Xiao-Ming Wu

Recent recommender systems started to use rating elicitation, which asks new users to rate a small seed itemset for inferring their preferences, to improve the quality of initial recommendations. The key challenge of the rating elicitation…

Information Retrieval · Computer Science 2024-02-27 Wonbin Kweon , SeongKu Kang , Junyoung Hwang , Hwanjo Yu

Embedding learning for categorical features is crucial for the deep learning-based recommendation models (DLRMs). Each feature value is mapped to an embedding vector via an embedding learning process. Conventional methods configure a fixed…

Machine Learning · Computer Science 2021-08-27 Bencheng Yan , Pengjie Wang , Kai Zhang , Wei Lin , Kuang-Chih Lee , Jian Xu , Bo Zheng

Recommendation has been a long-standing problem in many areas ranging from e-commerce to social websites. Most current studies focus only on traditional approaches such as content-based or collaborative filtering while there are relatively…

Machine Learning · Computer Science 2020-09-22 Muhammet cakir , sule gunduz oguducu , resul tugay

Network embedding is the process of learning low-dimensional representations for nodes in a network, while preserving node features. Existing studies only leverage network structure information and focus on preserving structural features.…

Machine Learning · Computer Science 2019-03-29 Conghui Zheng , Li Pan , Peng Wu

Extracting demographic features from hidden factors is an innovative concept that provides multiple and relevant applications. The matrix factorization model generates factors which do not incorporate semantic knowledge. This paper provides…

Information Retrieval · Computer Science 2020-12-22 Jesús Bobadilla , Ángel González-Prieto , Fernando Ortega , Raúl Lara-Cabrera

Deep clustering against self-supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Weijie Chen , Shiliang Pu , Di Xie , Shicai Yang , Yilu Guo , Luojun Lin

Networks are ubiquitous structure that describes complex relationships between different entities in the real world. As a critical component of prediction task over nodes in networks, learning the feature representation of nodes has become…

Machine Learning · Computer Science 2018-09-10 Hansheng Xue , Jiajie Peng , Xuequn Shang

A hallmark of the deep learning era for computer vision is the successful use of large-scale labeled datasets to train feature representations for tasks ranging from object recognition and semantic segmentation to optical flow estimation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Stefan Stojanov , Anh Thai , Zixuan Huang , James M. Rehg

Spectral Embedding (SE) has often been used to map data points from non-linear manifolds to linear subspaces for the purpose of classification and clustering. Despite significant advantages, the subspace structure of data in the original…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Hira Yaseen , Arif Mahmood

We tackle the challenge of feature embedding for the purposes of improving the click-through rate prediction process. We select three models: logistic regression, factorization machines and deep factorization machines, as our baselines and…

Machine Learning · Computer Science 2022-09-21 Samo Pahor , Davorin Kopič , Jure Demšar

Learning features from data is one of the defining characteristics of deep learning, but our theoretical understanding of the role features play in deep learning is still rudimentary. To address this gap, we introduce a new tool, the…

Machine Learning · Computer Science 2023-06-09 Yiding Jiang , Christina Baek , J. Zico Kolter

Learning discriminative image feature embeddings is of great importance to visual recognition. To achieve better feature embeddings, most current methods focus on designing different network structures or loss functions, and the estimated…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Suichan Li , Dapeng Chen , Bin Liu , Nenghai Yu , Rui Zhao

Learning based hashing plays a pivotal role in large-scale visual search. However, most existing hashing algorithms tend to learn shallow models that do not seek representative binary codes. In this paper, we propose a novel hashing…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Zhaoqiang Xia , Xiaoyi Feng , Jinye Peng , Abdenour Hadid

This paper investigates the problem of network embedding, which aims at learning low-dimensional vector representation of nodes in networks. Most existing network embedding methods rely solely on the network structure, i.e., the linkage…

Social and Information Networks · Computer Science 2016-10-19 Xiaofei Sun , Jiang Guo , Xiao Ding , Ting Liu