中文
相关论文

相关论文: 1-bit Matrix Completion: PAC-Bayesian Analysis of …

200 篇论文

The recovery of a low rank matrix from a subset of noisy low-precision quantized samples arises in several applications such as collaborative filtering, intelligent recommendation and millimeter wave channel estimation with few bit ADCs. In…

信息论 · 计算机科学 2019-11-25 Jiang Zhu , Zhennan Liu , Qi Zhang , Chunyi Song , Zhiwei Xu

This paper introduces a novel algorithm to approximate the matrix with minimum nuclear norm among all matrices obeying a set of convex constraints. This problem may be understood as the convex relaxation of a rank minimization problem, and…

最优化与控制 · 数学 2008-10-21 Jian-Feng Cai , Emmanuel J. Candes , Zuowei Shen

We consider a PAC-Bayes type learning rule for binary classification, balancing the training error of a randomized ''posterior'' predictor with its KL divergence to a pre-specified ''prior''. This can be seen as an extension of a modified…

机器学习 · 统计学 2026-03-25 Xiaohan Zhu , Mesrob I. Ohannessian , Nathan Srebro

Binary optimization is a central problem in mathematical optimization and its applications are abundant. To solve this problem, we propose a new class of continuous optimization techniques which is based on Mathematical Programming with…

最优化与控制 · 数学 2017-12-07 Ganzhao Yuan , Bernard Ghanem

In the Bayesian approach to inverse problems, data are often informative, relative to the prior, only on a low-dimensional subspace of the parameter space. Significant computational savings can be achieved by using this subspace to…

The task of reconstructing a matrix given a sample of observedentries is known as the matrix completion problem. It arises ina wide range of problems, including recommender systems, collaborativefiltering, dimensionality reduction, image…

统计理论 · 数学 2014-12-20 Jean Lafond , Olga Klopp , Eric Moulines , Jospeh Salmon

Matrix completion problem has been investigated under many different conditions since Netflix announced the Netflix Prize problem. Many research work has been done in the field once it has been discovered that many real life dataset could…

机器学习 · 计算机科学 2022-04-06 Jafar Jafarov

Bayesian methods for low-rank matrix completion with noise have been shown to be very efficient computationally. While the behaviour of penalized minimization methods is well understood both from the theoretical and computational points of…

统计理论 · 数学 2015-04-08 The Tien Mai , Pierre Alquier

We derive analytical expression of matrix factorization/completion solution by variational Bayes method, under the assumption that observed matrix is originally the product of low-rank dense and sparse matrices with additive noise. We…

信号处理 · 电气工程与系统科学 2018-05-24 Ryota Kawasumi , Koujin Takeda

In this paper, we consider the matrix completion problem when the observations are one-bit measurements of some underlying matrix M, and in particular the observed samples consist only of ones and no zeros. This problem is motivated by…

机器学习 · 计算机科学 2014-11-25 Cho-Jui Hsieh , Nagarajan Natarajan , Inderjit S. Dhillon

We consider the problem of estimating the uncertainty in statistical inverse problems using Bayesian inference. When the probability density of the noise and the prior are Gaussian, the solution of such a statistical inverse problem is also…

数值分析 · 数学 2018-07-20 Peter Benner , Yue Qiu , Martin Stoll

We apply the PAC-Bayes theory to the setting of learning-to-optimize. To the best of our knowledge, we present the first framework to learn optimization algorithms with provable generalization guarantees (PAC-bounds) and explicit trade-off…

机器学习 · 计算机科学 2023-02-16 Michael Sucker , Peter Ochs

In this paper, we propose an efficient and scalable low rank matrix completion algorithm. The key idea is to extend orthogonal matching pursuit method from the vector case to the matrix case. We further propose an economic version of our…

机器学习 · 计算机科学 2014-04-17 Zheng Wang , Ming-Jun Lai , Zhaosong Lu , Wei Fan , Hasan Davulcu , Jieping Ye

The low-rank matrix completion problem can be succinctly stated as follows: given a subset of the entries of a matrix, find a low-rank matrix consistent with the observations. While several low-complexity algorithms for matrix completion…

信息论 · 计算机科学 2010-06-11 Wei Dai , Ely Kerman , Olgica Milenkovic

We present a novel approach for constrained Bayesian inference. Unlike current methods, our approach does not require convexity of the constraint set. We reduce the constrained variational inference to a parametric optimization over the…

机器学习 · 计算机科学 2013-09-27 Oluwasanmi Koyejo , Joydeep Ghosh

Matrix completion aims to predict missing elements in a partially observed data matrix which in typical applications, such as collaborative filtering, is large and extremely sparsely observed. A standard solution is matrix factorization,…

机器学习 · 计算机科学 2019-08-06 Xiangju Qin , Paul Blomstedt , Samuel Kaski

We study the problem of learning a partially observed matrix under the low rank assumption in the presence of fully observed side information that depends linearly on the true underlying matrix. This problem consists of an important…

机器学习 · 统计学 2026-02-05 Dimitris Bertsimas , Nicholas A. G. Johnson

Nonparametric estimation using uniform-width binning is a standard approach for evaluating the calibration performance of machine learning models. However, existing theoretical analyses of the bias induced by binning are limited to binary…

机器学习 · 计算机科学 2025-07-14 Masahiro Fujisawa , Futoshi Futami

We consider the matrix completion problem where the aim is to esti-mate a large data matrix for which only a relatively small random subset of its entries is observed. Quite popular approaches to matrix completion problem are iterative…

统计理论 · 数学 2015-02-03 Olga Klopp

Matrix completion is a ubiquitous tool in machine learning and data analysis. Most work in this area has focused on the number of observations necessary to obtain an accurate low-rank approximation. In practice, however, the cost of…

机器学习 · 计算机科学 2021-04-19 Dong Hu , Alex Gittens , Malik Magdon-Ismail