中文
相关论文

相关论文: The trace norm constrained matrix-variate Gaussian…

200 篇论文

Gaussian Processes are widely used for regression tasks. A known limitation in the application of Gaussian Processes to regression tasks is that the computation of the solution requires performing a matrix inversion. The solution also…

机器学习 · 计算机科学 2017-08-22 Sourish Das , Sasanka Roy , Rajiv Sambasivan

In this paper, we introduce a novel theoretical framework for multi-task regression, applying random matrix theory to provide precise performance estimations, under high-dimensional, non-Gaussian data distributions. We formulate a…

We propose a set of convex low rank inducing norms for a coupled matrices and tensors (hereafter coupled tensors), which shares information between matrices and tensors through common modes. More specifically, we propose a mixture of the…

机器学习 · 统计学 2018-06-15 Kishan Wimalawarne , Makoto Yamada , Hiroshi Mamitsuka

We consider the problem of estimating high-dimensional covariance matrices of a particular structure, which is a summation of low rank and sparse matrices. This covariance structure has a wide range of applications including factor analysis…

统计方法学 · 统计学 2013-10-17 Lin Zhang , Abhra Sarkar , Bani K. Mallick

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

机器学习 · 计算机科学 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach

In minimum trace (MinT) forecast reconciliation, the covariance matrix of the base forecasts errors plays a crucial role. Typically, this matrix is estimated and then treated as known. This can lead to underestimation of the variance of the…

统计方法学 · 统计学 2026-05-11 Chiara Carrara , Dario Azzimonti , Giorgio Corani , Lorenzo Zambon

We study the generalized trace regression with a near low-rank regression coefficient matrix, which extends notion of sparsity for regression coefficient vectors. Specifically, given a matrix covariate $X$, the probability density function…

统计方法学 · 统计学 2017-10-24 Jianqing Fan , Wenyan Gong , Ziwei Zhu

We study Bayesian inference methods for solving linear inverse problems, focusing on hierarchical formulations where the prior or the likelihood function depend on unspecified hyperparameters. In practice, these hyperparameters are often…

数值分析 · 数学 2018-08-01 Qingping Zhou , Wenqing Liu , Jinglai Li , Youssef M. Marzouk

We study the problem of recovery of matrices that are simultaneously low rank and row and/or column sparse. Such matrices appear in recent applications in cognitive neuroscience, imaging, computer vision, macroeconomics, and genetics. We…

机器学习 · 统计学 2019-04-11 Ming Yu , Varun Gupta , Mladen Kolar

Covariance estimation and selection for multivariate datasets in a high-dimensional regime is a fundamental problem in modern statistics. Gaussian graphical models are a popular class of models used for this purpose. Current Bayesian…

统计方法学 · 统计学 2019-03-06 Xuan Cao , Shaojun Zhang

We introduce a method that uses low-rank approximations of cross-correlation matrices in mixed continuous and categorical Gaussian Process models. This new method -- called Low-Rank Correlation (LRC) -- offers the ability to flexibly adapt…

机器学习 · 统计学 2020-10-07 Dominik Kirchhoff , Sonja Kuhnt

This paper gives two theoretical results on estimating low-rank parameter matrices for linear models with multivariate responses. We first focus on robust parameter estimation of low-rank multi-task learning with heavy-tailed data and…

统计理论 · 数学 2023-05-24 Kangqiang Li , Yuxuan Wang

The aim of reduced rank regression is to connect multiple response variables to multiple predictors. This model is very popular, especially in biostatistics where multiple measurements on individuals can be re-used to predict multiple…

统计方法学 · 统计学 2022-06-20 The Tien Mai , Pierre Alquier

We introduce a novel Bayesian approach for variable selection using Gaussian process regression, which is crucial for enhancing interpretability and model regularization. Our method employs nearest neighbor Gaussian processes, serving as…

Recently, there is a revival of interest in low-rank matrix completion-based unsupervised learning through the lens of dual-graph regularization, which has significantly improved the performance of multidisciplinary machine learning tasks…

机器学习 · 计算机科学 2022-09-07 Yangge Chen , Lei Cheng , Yik-Chung Wu

This paper presents a sequential randomized lowrank matrix factorization approach for incrementally predicting values of an unknown function at test points using the Gaussian Processes framework. It is well-known that in the Gaussian…

机器学习 · 计算机科学 2017-11-21 Shaunak D. Bopardikar , George S. Eskander Ekladious

Learning of matrix-valued data has recently surged in a range of scientific and business applications. Trace regression is a widely used method to model effects of matrix predictors and has shown great success in matrix learning. However,…

机器学习 · 统计学 2021-05-06 Chanwoo Lee , Lexin Li , Hao Helen Zhang , Miaoyan Wang

This paper is devoted to the bipartite ranking problem, a classical statistical learning task, in a high dimensional setting. We propose a scoring and ranking strategy based on the PAC-Bayesian approach. We consider nonlinear additive…

机器学习 · 统计学 2019-05-20 Benjamin Guedj , Sylvain Robbiano

In this paper, we propose three approaches for the estimation of the Tucker decomposition of multi-way arrays (tensors) from partial observations. All approaches are formulated as convex minimization problems. Therefore, the minimum is…

机器学习 · 统计学 2015-03-17 Ryota Tomioka , Kohei Hayashi , Hisashi Kashima

We address the problem of continual learning in multi-task Gaussian process (GP) models for handling sequential input-output observations. Our approach extends the existing prior-posterior recursion of online Bayesian inference, i.e.\ past…

机器学习 · 统计学 2019-11-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez