English
Related papers

Related papers: Factorization Machines with Regularization for Spa…

200 papers

As a well-established approach, factorization machine (FM) is capable of automatically learning high-order interactions among features to make predictions without the need for manual feature engineering. With the prominent development of…

Information Retrieval · Computer Science 2021-04-13 Tong Chen , Hongzhi Yin , Xiangliang Zhang , Zi Huang , Yang Wang , Meng Wang

In various web applications like targeted advertising and recommender systems, the available categorical features (e.g., product type) are often of great importance but sparse. As a widely adopted solution, models based on Factorization…

Machine Learning · Computer Science 2019-11-19 Tong Chen , Hongzhi Yin , Quoc Viet Hung Nguyen , Wen-Chih Peng , Xue Li , Xiaofang Zhou

In this work, we propose FM-Pair, an adaptation of Factorization Machines with a pairwise loss function, making them effective for datasets with implicit feedback. The optimization model in FM-Pair is based on the BPR (Bayesian Personalized…

Information Retrieval · Computer Science 2018-12-21 Babak Loni , Martha Larson , Alan Hanjalic

In many applications where collecting data is expensive, for example neuroscience or medical imaging, the sample size is typically small compared to the feature dimension. It is challenging in this setting to train expressive, non-linear…

Machine Learning · Computer Science 2019-04-23 Sergul Aydore , Bertrand Thirion , Gael Varoquaux

Matrix factorization (MF) is a simple collaborative filtering technique that achieves superior recommendation accuracy by decomposing the user-item interaction matrix into user and item latent matrices. Because the model typically learns…

Information Retrieval · Computer Science 2024-03-11 Kai Sugahara , Kazushi Okamoto

User and item features of side information are crucial for accurate recommendation. However, the large number of feature dimensions, e.g., usually larger than 10^7, results in expensive storage and computational cost. This prohibits fast…

Information Retrieval · Computer Science 2018-09-20 Han Liu , Xiangnan He , Fuli Feng , Liqiang Nie , Rui Liu , Hanwang Zhang

Deep matrix factorizations (deep MFs) are recent unsupervised data mining techniques inspired by constrained low-rank approximations. They aim to extract complex hierarchies of features within high-dimensional datasets. Most of the loss…

Machine Learning · Computer Science 2023-01-26 Pierre De Handschutter , Nicolas Gillis

The concepts of sparsity, and regularised estimation, have proven useful in many high-dimensional statistical applications. Dynamic factor models (DFMs) provide a parsimonious approach to modelling high-dimensional time series, however, it…

Methodology · Statistics 2023-03-22 Luke Mosley , Tak-Shing T. Chan , Alex Gibberd

Few-shot learning (FSL) based on manifold regularization aims to improve the recognition capacity of novel objects with limited training samples by mixing two samples from different categories with a blending factor. However, this mixing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xingyu Zhu , Shuo Wang , Jinda Lu , Yanbin Hao , Haifeng Liu , Xiangnan He

Training a fine-grained image recognition model with limited data presents a significant challenge, as the subtle differences between categories may not be easily discernible amidst distracting noise patterns. One commonly employed strategy…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Avraham Chapman , Haiming Xu , Lingqiao Liu

We examined the use of the Ising model as an $L_0$ regularization method for field-aware factorization machines (FFM). This approach improves generalization performance and has the advantage of simultaneously determining the best feature…

Machine Learning · Computer Science 2024-03-06 Yasuharu Okamoto

Factorization machine (FM) variants are widely used in recommendation systems that operate under strict throughput and latency requirements, such as online advertising systems. FMs are known both due to their ability to model pairwise…

Information Retrieval · Computer Science 2024-08-05 Alex Shtoff , Michael Viderman , Naama Haramaty-Krasne , Oren Somekh , Ariel Raviv , Tularam Ban

We propose the convex factorization machine (CFM), which is a convex variant of the widely used Factorization Machines (FMs). Specifically, we employ a linear+quadratic model and regularize the linear term with the $\ell_2$-regularizer and…

Factorization machine (FM) variants are widely used for large scale real-time content recommendation systems, since they offer an excellent balance between model accuracy and low computational costs for training and inference. These systems…

Machine Learning · Computer Science 2025-01-03 Alex Shtoff , Elie Abboud , Rotem Stram , Oren Somekh

Matrix factorization (MF) is extensively used to mine the user preference from explicit ratings in recommender systems. However, the reliability of explicit ratings is not always consistent, because many factors may affect the user's final…

Information Retrieval · Computer Science 2018-06-25 Zhipeng Wu , Hui Tian , Xuzhen Zhu , Shuo Wang

Recently, Factorization Machines (FM) has become more and more popular for recommendation systems, due to its effectiveness in finding informative interactions between features. Usually, the weights for the interactions is learnt as a low…

Machine Learning · Computer Science 2018-04-18 Longfei Li , Peilin Zhao , Jun Zhou , Xiaolong Li

Pruning is a model compression method that removes redundant parameters in deep neural networks (DNNs) while maintaining accuracy. Most available filter pruning methods require complex treatments such as iterative pruning, features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yue Wu , Yuan Lan , Luchan Zhang , Yang Xiang

Feature selection is one of the most decisive tools in understanding data and machine learning models. Among other methods, sparsity induced by $L^{1}$ penalty is one of the simplest and best studied approaches to this problem. Although…

Machine Learning · Computer Science 2020-07-09 Andrii Trelin , Aleš Procházka

Rank regularized minimization problem is an ideal model for the low-rank matrix completion/recovery problem. The matrix factorization approach can transform the high-dimensional rank regularized problem to a low-dimensional factorized…

Optimization and Control · Mathematics 2024-05-21 Wenjing Li , Wei Bian , Kim-Chuan Toh

We consider adaptive system identification problems with convex constraints and propose a family of regularized Least-Mean-Square (LMS) algorithms. We show that with a properly selected regularization parameter the regularized LMS provably…

Methodology · Statistics 2010-12-24 Yilun Chen , Yuantao Gu , Alfred O. Hero