English
Related papers

Related papers: Initialization Method for Factorization Machine Ba…

200 papers

We study the problem of approximating the partition function of the ferromagnetic Ising model in graphs and hypergraphs. Our first result is a deterministic approximation scheme (an FPTAS) for the partition function in bounded degree graphs…

Data Structures and Algorithms · Computer Science 2018-12-26 Jingcheng Liu , Alistair Sinclair , Piyush Srivastava

To enhance the performance of quantum annealing machines, several methods have been proposed to reduce the number of spins by fixing spin values through preprocessing. We proposed a hybrid optimization method that combines a simulated…

Statistical Mechanics · Physics 2025-07-22 Shuta Kikuchi , Nozomu Togawa , Shu Tanaka

Quantization is a powerful tool to improve large language model (LLM) inference efficiency by utilizing more energy-efficient low-precision datapaths and reducing memory footprint. However, accurately quantizing LLM weights and activations…

Hardware Architecture · Computer Science 2025-04-22 Coleman Hooper , Charbel Sakr , Ben Keller , Rangharajan Venkatesan , Kurt Keutzer , Sophia Shao , Brucek Khailany

Deep neural networks achieve state-of-the-art performance for a range of classification and inference tasks. However, the use of stochastic gradient descent combined with the nonconvexity of the underlying optimization problems renders…

Machine Learning · Computer Science 2020-01-29 Ramina Ghods , Andrew S. Lan , Tom Goldstein , Christoph Studer

One of the most efficient methods in collaborative filtering is matrix factorization, which finds the latent vector representations of users and items based on the ratings of users to items. However, a matrix factorization based algorithm…

Information Retrieval · Computer Science 2018-05-15 ThaiBinh Nguyen , Atsuhiro Takasu

Integer factorization has been one of the cornerstone applications of the field of quantum computing since the discovery of an efficient algorithm for factoring by Peter Shor. Unfortunately, factoring via Shor's algorithm is well beyond the…

Quantum Physics · Physics 2018-08-28 Eric R. Anschuetz , Jonathan P. Olson , Alán Aspuru-Guzik , Yudong Cao

We present an approach, which we term quantum-enhanced optimization, to accelerate classical optimization algorithms by leveraging quantum sampling. Our method uses quantum-generated samples as warm starts to classical heuristics for…

Quantum Physics · Physics 2025-08-25 Ieva Čepaitė , Niam Vaishnav , Leo Zhou , Ashley Montanaro

Factorization machine (FM) is a popular machine learning model to capture the second order feature interactions. The optimal learning guarantee of FM and its generalized version is not yet developed. For a rank $k$ generalized FM of $d$…

Machine Learning · Statistics 2019-02-01 Ming Lin , Shuang Qiu , Jieping Ye , Xiaomin Song , Qi Qian , Liang Sun , Shenghuo Zhu , Rong Jin

Matrix Factorization is one of the most successful recommender system techniques over the past decade. However, the classic probabilistic theory framework for matrix factorization is modeled using normal distributions. To find better…

Information Retrieval · Computer Science 2022-12-21 Hao Wang

In this work, we propose FM-Pair, an adaptation of Factorization Machines with a pairwise loss function, making them effective for datasets with implicit feedback. The optimization model in FM-Pair is based on the BPR (Bayesian Personalized…

Information Retrieval · Computer Science 2018-12-21 Babak Loni , Martha Larson , Alan Hanjalic

Stochastic variational inference is an established way to carry out approximate Bayesian inference for deep models. While there have been effective proposals for good initializations for loss minimization in deep learning, far less…

Machine Learning · Statistics 2019-01-28 Simone Rossi , Pietro Michiardi , Maurizio Filippone

Combinatorial optimization problems can be mapped onto Ising models, and their ground state is generally difficult to find. A lot of heuristics for these problems have been proposed, and one promising approach is to use continuous…

Statistical Mechanics · Physics 2022-11-03 Shintaro Sato

The increasing size of transformer-based models in NLP makes the question of compressing them important. In this work, we present a comprehensive analysis of factorization based model compression techniques. Specifically, we focus on…

Computation and Language · Computer Science 2024-06-18 Ashim Gupta , Sina Mahdipour Saravani , P. Sadayappan , Vivek Srikumar

Ising Machine is a promising computing approach for solving combinatorial optimization problems. It is naturally suited for energy-saving and compact in-memory computing implementations with emerging memories. A na\"ive in-memory computing…

Hardware Architecture · Computer Science 2024-01-30 George Higgins Hutchinson , Ethan Sifferman , Tinish Bhattacharya , Dmitri B. Strukov

Quantum approximate optimization algorithm (QAOA) is a promising variational quantum algorithm for combinatorial optimization problems. However, the implementation of QAOA is limited due to the requirement that the problems be mapped to…

Quantum Physics · Physics 2023-07-19 Hui-Min Li , Jin-Min Liang , Zhi-Xi Wang , Shao-Ming Fei

The Quantum Approximate Optimization Algorithm (QAOA) is a leading hybrid heuristic for combinatorial optimization, but efficiently handling hard constraints remains a significant challenge. XY-mixers successfully confine quantum state…

There is an increasing interest in quantum algorithms for problems of integer programming and combinatorial optimization. Classical solvers for such problems employ relaxations, which replace binary variables with continuous ones, for…

Quantum Physics · Physics 2021-06-23 Daniel J. Egger , Jakub Marecek , Stefan Woerner

Approximate combinatorial optimization is a promising use case for quantum computers. The quantum optimization algorithms often employ a fixed ansatz that evolves an unbiased initial state towards states with better values of the optimand,…

Quantum Physics · Physics 2026-04-30 Phillip C. Lotshaw , Titus Morris , Stuart Hadfield , Ryan Bennink

Inferential models (IMs) represent a novel possibilistic approach for achieving provably valid statistical inference. This paper introduces a general framework for fusing independent IMs in a "black-box" manner, requiring no knowledge of…

Statistics Theory · Mathematics 2024-05-14 Leonardo Cella

With the popularity of Linked Open Data (LOD) and the associated rise in freely accessible knowledge that can be accessed via LOD, exploiting LOD for recommender systems has been widely studied based on various approaches such as…

Information Retrieval · Computer Science 2017-08-01 Guangyuan Piao , John G. Breslin