English
Related papers

Related papers: Efficient Mixed Dimension Embeddings for Matrix Fa…

200 papers

A few iterations of alternating least squares with a random starting point provably suffice to produce nearly optimal spectral- and Frobenius-norm accuracies of low-rank approximations to a matrix; iterating to convergence is unnecessary.…

Numerical Analysis · Mathematics 2017-06-02 Arthur Szlam , Andrew Tulloch , Mark Tygert

As a crucial component of most modern deep recommender systems, feature embedding maps high-dimensional sparse user/item features into low-dimensional dense embeddings. However, these embeddings are usually assigned a unified dimension,…

Information Retrieval · Computer Science 2022-04-18 Liang Qu , Yonghong Ye , Ningzhi Tang , Lixin Zhang , Yuhui Shi , Hongzhi Yin

The increasing complexity of deep learning recommendation models (DLRM) has led to a growing need for large-scale distributed systems that can efficiently train vast amounts of data. In DLRM, the sparse embedding table is a crucial…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-07 Xin Zhang , Quanyu Zhu , Liangbei Xu , Zain Huda , Wang Zhou , Jin Fang , Dennis van der Staay , Yuxi Hu , Jade Nie , Jiyan Yang , Chunzhi Yang

We propose a flexible and theoretically supported framework for scalable nonnegative matrix factorization. The goal is to find nonnegative low-rank components directly from compressed measurements, accessing the original data only once or…

Optimization and Control · Mathematics 2026-02-17 Abraar Chaudhry , Elizaveta Rebrova

The analysis of multidimensional data is becoming a more and more relevant topic in statistical and machine learning research. Given their complexity, such data objects are usually reshaped into matrices or vectors and then analysed.…

Machine Learning · Statistics 2021-04-09 Giuseppe Brandi , T. Di Matteo

Large collections of high-dimensional data have become nearly ubiquitous across many academic fields and application domains, ranging from biology to the humanities. Since working directly with high-dimensional data poses challenges, the…

Increasing the size of embedding layers has shown to be effective in improving the performance of recommendation models, yet gradually causing their sizes to exceed terabytes in industrial recommender systems, and hence the increase of…

Information Retrieval · Computer Science 2023-08-21 Beichuan Zhang , Chenggen Sun , Jianchao Tan , Xinjun Cai , Jun Zhao , Mengqi Miao , Kang Yin , Chengru Song , Na Mou , Yang Song

The graphical representation of the correlation matrix by means of different multivariate statistical methods is reviewed, a comparison of the different procedures is presented with the use of an example data set, and an improved…

Computation · Statistics 2024-01-24 Jan Graffelman , Jan de Leeuw

We develop a Bayesian Poisson matrix factorization model for forming recommendations from sparse user behavior data. These data are large user/item matrices where each user has provided feedback on only a small subset of items, either…

Information Retrieval · Computer Science 2014-05-21 Prem Gopalan , Jake M. Hofman , David M. Blei

Embedding based models have been the state of the art in collaborative filtering for over a decade. Traditionally, the dot product or higher order equivalents have been used to combine two or more embeddings, e.g., most notably in matrix…

Information Retrieval · Computer Science 2020-06-03 Steffen Rendle , Walid Krichene , Li Zhang , John Anderson

Nonnegative matrix factorization (NMF) is a popular method used to reduce dimensionality in data sets whose elements are nonnegative. It does so by decomposing the data set of interest, $\mathbf{X}$, into two lower rank nonnegative matrices…

Methodology · Statistics 2021-07-05 Phillip Shreeves , Jeffrey L. Andrews , Xinchen Deng , Ramie Ali-Adeeb , Andrew Jirasek

Although Recommender Systems have been comprehensively studied in the past decade both in industry and academia, most of current recommender systems suffer from the following issues: 1) The data sparsity of the user-item matrix seriously…

Information Retrieval · Computer Science 2018-05-29 Ze Wang , Hong Li

When a user connects to the Internet to fulfill his needs, he often encounters a huge amount of related information. Recommender systems are the techniques for massively filtering information and offering the items that users find them…

Machine Learning · Computer Science 2021-07-15 Mahdi Kherad , Amir Jalaly Bidgoly

At the heart of contemporary recommender systems (RSs) are latent factor models that provide quality recommendation experience to users. These models use embedding vectors, which are typically of a uniform and fixed size, to represent users…

Information Retrieval · Computer Science 2026-02-05 Yunke Qu , Tong Chen , Quoc Viet Hung Nguyen , Hongzhi Yin

Factorization Machines (FM) are powerful class of models that incorporate higher-order interaction among features to add more expressive power to linear models. They have been used successfully in several real-world tasks such as…

Machine Learning · Computer Science 2020-04-30 Parameswaran Raman , S. V. N. Vishwanathan

Using embeddings as representations of products is quite commonplace in recommender systems, either by extracting the semantic embeddings of text descriptions, user sessions, collaborative relationships, or product images. In this paper, we…

Information Retrieval · Computer Science 2019-08-29 Diogo Goncalves , Liweu Liu , Ana Magalhães

Recommender system has been more and more popular and widely used in many applications recently. The increasing information available, not only in quantities but also in types, leads to a big challenge for recommender system that how to…

Artificial Intelligence · Computer Science 2011-12-30 Tianqi Chen , Zhao Zheng , Qiuxia Lu , Weinan Zhang , Yong Yu

When pre-processing observational data via matching, we seek to approximate each unit with maximally similar peers that had an alternative treatment status--essentially replicating a randomized block design. However, as one considers a…

Econometrics · Economics 2019-05-30 Gentry Johnson , Brian Quistorff , Matt Goldman

The least square solution of minimum norm of a rectangular linear system of equations can be found out iteratively by using matrix splittings. However, the convergence of such an iteration scheme arising out of a matrix splitting is…

Numerical Analysis · Mathematics 2025-08-07 Chinmay Kumar Giri , Debasisha Mishra

Multi-task learning, which optimizes performance across multiple tasks, is inherently a multi-objective optimization problem. Various algorithms are developed to provide discrete trade-off solutions on the Pareto front. Recently, continuous…

Machine Learning · Computer Science 2024-07-31 Weiyu Chen , James T. Kwok