English

Review of compressed embedding layers and their applications for recommender systems

Machine Learning 2023-11-27 v3
Authors: Tamas Hajgato
View on arXiv ↗ PDF ↗

Abstract

We review the literature on trainable, compressed embedding layers and discuss their applicability for compressing gigantic neural recommender systems. We also report the results we measured with our compressed embedding layers.

Keywords

compressed embedding layers neural recommender systems model compression trainable embeddings literature review

Cite

@article{arxiv.2306.13724,
  title  = {Review of compressed embedding layers and their applications for recommender systems},
  author = {Tamas Hajgato},
  journal= {arXiv preprint arXiv:2306.13724},
  year   = {2023}
}

Comments

10 pages, 2 figures

Related papers

View all related →
Information Retrieval · Computer Science
Embedding Compression in Recommender Systems: A Survey
Shiwei Li, Huifeng Guo, Xing Tang, Ruiming Tang +3
2024-08-07
Machine Learning · Computer Science
Experimental Analysis of Large-scale Learnable Vector Storage Compression
Hailin Zhang, Penghao Zhao, Xupeng Miao, Yingxia Shao +3
2024-02-14
Computation and Language · Computer Science
Tensorized Embedding Layers for Efficient Model Compression
Oleksii Hrinchuk, Valentin Khrulkov, Leyla Mirvakhabova, Elena Orlova +1
2020-02-20
Information Retrieval · Computer Science
The Future is Sparse: Embedding Compression for Scalable Retrieval in Recommender Systems
Petr Kasalický, Martin Spišák, Vojtěch Vančura, Daniel Bohuněk +2
2025-05-19
Information Retrieval · Computer Science
Embedding in Recommender Systems: A Survey
Maolin Wang, Xinjian Zhao, Wanyu Wang, Sheng Zhang +8
2025-10-23
Computation and Language · Computer Science
A Survey on Model Compression for Large Language Models
Xunyu Zhu, Jian Li, Yong Liu, Can Ma +1
2024-07-31
Information Theory · Computer Science
Distributed Compression in the Era of Machine Learning: A Review of Recent Advances
Ezgi Ozyilkan, Elza Erkip
2024-02-14
Machine Learning · Computer Science
Compression of Deep Neural Networks on the Fly
Guillaume Soulié, Vincent Gripon, Maëlys Robert
2016-03-21
Computer Vision and Pattern Recognition · Computer Science
Model Compression Techniques in Biometrics Applications: A Survey
Eduarda Caldeira, Pedro C. Neto, Marco Huber, Naser Damer +1
2024-01-19
Computer Vision and Pattern Recognition · Computer Science
Compression-aware Training of Deep Networks
Jose M. Alvarez, Mathieu Salzmann
2018-10-12
Machine Learning · Computer Science
Neural network compression via learnable wavelet transforms
Moritz Wolter, Shaohui Lin, Angela Yao
2020-08-21
Machine Learning · Computer Science
To Compress, or Not to Compress: Characterizing Deep Learning Model Compression for Embedded Inference
Qing Qin, Jie Ren, Jialong Yu, Ling Gao +5
2018-10-23
Computation and Language · Computer Science
EncodeRec: An Embedding Backbone for Recommendation Systems
Guy Hadad, Neomi Rabaev, Bracha Shapira
2026-01-19
Machine Learning · Computer Science
Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics
Soo Min Kwon, Zekai Zhang, Dogyoon Song, Laura Balzano +1
2024-03-13
Machine Learning · Computer Science
Tensor Decompositions in Deep Learning
Davide Bacciu, Danilo P. Mandic
2020-02-28
Computer Vision and Pattern Recognition · Computer Science
Scalable Compression of Deep Neural Networks
Xing Wang, Jie Liang
2016-08-29
Information Retrieval · Computer Science
A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender Systems
Hung Vinh Tran, Tong Chen, Quoc Viet Hung Nguyen, Zi Huang +2
2025-01-22
Computer Vision and Pattern Recognition · Computer Science
A Benchmark Study of Neural Network Compression Methods for Hyperspectral Image Classification
Sai Shi
2026-03-06
Computer Vision and Pattern Recognition · Computer Science
Exploring Compressed Image Representation as a Perceptual Proxy: A Study
Chen-Hsiu Huang, Ja-Ling Wu
2024-01-17
Machine Learning · Computer Science
An Introduction to Neural Data Compression
Yibo Yang, Stephan Mandt, Lucas Theis
2023-08-22
Databases · Computer Science
Learned Data Compression: Challenges and Opportunities for the Future
Qiyu Liu, Siyuan Han, Jianwei Liao, Jin Li +3
2024-12-17
Image and Video Processing · Electrical Eng. & Systems
Learning-Based Image Compression for Machines
Kartik Gupta, Kimberley Faria, Vikas Mehta
2024-10-01
Information Retrieval · Computer Science
Where are we in embedding spaces? A Comprehensive Analysis on Network Embedding Approaches for Recommender Systems
Sixiao Zhang, Hongxu Chen, Xiao Ming, Lizhen Cui +2
2022-01-26
Information Theory · Computer Science
Unveil Compressed Sensing
Xiteng Liu
2013-12-03
Machine Learning · Computer Science
Model Preserving Compression for Neural Networks
Jerry Chee, Megan Renz, Anil Damle, Christopher De Sa
2022-10-18