English
Related papers

Related papers: Robust Factorization and Completion of Streaming T…

200 papers

Matrix and tensor completion are frameworks for a wide range of problems, including collaborative filtering, missing data, and image reconstruction. Missing entries are estimated by leveraging an assumption that the matrix or tensor is…

Methodology · Statistics 2019-05-29 Daniel E. Gilbert , Martin T. Wells

This paper presents a methodology for creating streaming, distributed inference algorithms for Bayesian nonparametric (BNP) models. In the proposed framework, processing nodes receive a sequence of data minibatches, compute a variational…

Machine Learning · Computer Science 2015-11-02 Trevor Campbell , Julian Straub , John W. Fisher , Jonathan P. How

The lossless data compression algorithm based on Bayesian Attention Networks is derived from first principles. Bayesian Attention Networks are defined by introducing an attention factor per a training sample loss as a function of two sample…

Machine Learning · Computer Science 2021-03-30 Michael Tetelman

We analyse the matrix factorization problem. Given a noisy measurement of a product of two matrices, the problem is to estimate back the original matrices. It arises in many applications such as dictionary learning, blind matrix…

Numerical Analysis · Computer Science 2016-07-19 Yoshiyuki Kabashima , Florent Krzakala , Marc Mézard , Ayaka Sakata , Lenka Zdeborová

We propose a new fast streaming algorithm for the tensor completion problem of imputing missing entries of a low-tubal-rank tensor using the tensor singular value decomposition (t-SVD) algebraic framework. We show the t-SVD is a…

Signal Processing · Electrical Eng. & Systems 2022-04-18 Kyle Gilman , Davoud Ataee Tarzanagh , Laura Balzano

To efficiently express tensor data using the Tucker format, a critical task is to minimize the multilinear rank such that the model would not be over-flexible and lead to overfitting. Due to the lack of rank minimization tools in tensor,…

Signal Processing · Electrical Eng. & Systems 2024-09-11 Xueke Tong , Hancheng Zhu , Lei Cheng , Yik-Chung Wu

Effective non-parametric density estimation is a key challenge in high-dimensional multivariate data analysis. In this paper,we propose a novel approach that builds upon tensor factorization tools. Any multivariate density can be…

Machine Learning · Statistics 2022-10-19 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

Tensor regression is an important tool for tensor data analysis, but existing works have not considered the impact of outliers, making them potentially sensitive to such data points. This paper proposes a low tubal rank robust regression…

Methodology · Statistics 2026-05-11 Zihao Song , Jicai Liu , Heng Lian , Weihua Zhao

In this paper, we show that if the optimization function is restricted-strongly-convex (RSC) and restricted-smooth (RSM) -- a rich subclass of weakly submodular functions -- then a streaming algorithm with constant factor approximation…

Machine Learning · Computer Science 2018-07-24 Karthik S. Gurumoorthy , Amit Dhurandhar

Latent factor models are the canonical statistical tool for exploratory analyses of low-dimensional linear structure for an observation matrix with p features across n samples. We develop a structured Bayesian group factor analysis model…

Methodology · Statistics 2015-11-12 Shiwen Zhao , Chuan Gao , Sayan Mukherjee , Barbara E Engelhardt

In this paper we propose new techniques to sample arbitrary third-order tensors, with an objective of speeding up tensor algorithms that have recently gained popularity in machine learning. Our main contribution is a new way to select, in a…

Machine Learning · Statistics 2015-02-23 Srinadh Bhojanapalli , Sujay Sanghavi

State estimation or filtering serves as a fundamental task to enable intelligent decision-making in applications such as autonomous vehicles, robotics, healthcare monitoring, smart grids, intelligent transportation, and predictive…

Machine Learning · Computer Science 2025-06-16 Aamir Hussain Chughtai

Multi-task and multi-domain learning methods seek to learn multiple tasks/domains, jointly or one after another, using a single unified network. The primary challenge and opportunity lie in leveraging shared information across these tasks…

Machine Learning · Computer Science 2026-02-03 Yash Garg , Nebiyou Yismaw , Rakib Hyder , Ashley Prater-Bennette , M. Salman Asif

This work studies the problem of high-dimensional data (referred to as tensors) completion from partially observed samplings. We consider that a tensor is a superposition of multiple low-rank components. In particular, each component can be…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Chang Nie , Huan Wang , Zhihui Lai

We consider the problem of flexible modeling of higher order Markov chains when an upper bound on the order of the chain is known but the true order and nature of the serial dependence are unknown. We propose Bayesian nonparametric…

Methodology · Statistics 2015-10-21 Abhra Sarkar , David B. Dunson

Principal component regression uses principal components as regressors. It is particularly useful in prediction settings with high-dimensional covariates. The existing literature treating of Bayesian approaches is relatively sparse. We…

Methodology · Statistics 2020-01-28 Philippe Gagnon , Mylène Bédard , Alain Desgagné

Recovery of internet network traffic data from incomplete observed data is an important issue in internet network engineering and management. In this paper, by fully combining the temporal stability and periodicity features in internet…

Numerical Analysis · Mathematics 2020-05-25 Chen Ling , Gaohang Yu , Liqun Qi , Yanwei Xu

Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a…

Computation · Statistics 2018-08-08 Andrea Giovannucci , Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

While Test-Time Scaling (TTS) offers a promising direction to enhance video generation without the surging costs of training, current test-time video generation methods based on diffusion models suffer from exorbitant candidate exploration…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yijing Tu , Shaojin Wu , Mengqi Huang , Wenchuan Wang , Yuxin Wang , Chunxiao Liu , Zhendong Mao

Tuning tensor program generation involves searching for various possible program transformation combinations for a given program on target hardware to optimize the tensor program execution. It is already a complex process because of the…

Programming Languages · Computer Science 2023-12-29 Gaurav Verma , Siddhisanket Raskar , Zhen Xie , Abid M Malik , Murali Emani , Barbara Chapman