中文
相关论文

相关论文: Inverse Covariance Estimation for High-Dimensional…

200 篇论文

The Laplacian-constrained Gaussian Markov Random Field (LGMRF) is a common multivariate statistical model for learning a weighted sparse dependency graph from given data. This graph learning problem can be formulated as a maximum likelihood…

机器学习 · 计算机科学 2024-04-15 Yakov Medvedovsky , Eran Treister , Tirza Routtenberg

We introduce Neural Optimal Design of Experiments, a learning-based framework for optimal experimental design in inverse problems that avoids classical bilevel optimization and indirect sparsity regularization. NODE jointly trains a neural…

机器学习 · 计算机科学 2026-01-08 John E. Darges , Babak Maboudi Afkham , Matthias Chung

We propose computationally efficient encoders and decoders for lossy compression using a Sparse Regression Code. The codebook is defined by a design matrix and codewords are structured linear combinations of columns of this matrix. The…

信息论 · 计算机科学 2014-05-20 Ramji Venkataramanan , Tuhin Sarkar , Sekhar Tatikonda

This paper proposes a novel scheme for reduced-rank Gaussian process regression. The method is based on an approximate series expansion of the covariance function in terms of an eigenfunction expansion of the Laplace operator in a compact…

机器学习 · 统计学 2020-06-26 Arno Solin , Simo Särkkä

The pattern of zero entries in the inverse covariance matrix of a multivariate normal distribution corresponds to conditional independence restrictions between variables. Covariance selection aims at estimating those structural zeros from…

统计理论 · 数学 2016-08-16 Nicolai Meinshausen , Peter Bühlmann

We propose to compute a sparse approximate inverse Cholesky factor $L$ of a dense covariance matrix $\Theta$ by minimizing the Kullback-Leibler divergence between the Gaussian distributions $\mathcal{N}(0, \Theta)$ and $\mathcal{N}(0,…

数值分析 · 数学 2021-10-26 Florian Schäfer , Matthias Katzfuss , Houman Owhadi

This paper considers a high-dimensional linear regression problem where there are complex correlation structures among predictors. We propose a graph-constrained regularization procedure, named Sparse Laplacian Shrinkage with the Graphical…

统计方法学 · 统计学 2019-04-10 Yuehan Yang , Siwei Xia , Hu Yang

The problem of obtaining spectral densities from lattice data has been receiving great attention due to its importance in our understanding of scattering processes in Quantum Field Theory, with applications both in the Standard Model and…

高能物理 - 格点 · 物理学 2024-09-09 Luigi Del Debbio , Alessandro Lupo , Marco Panero , Nazario Tantalo

We present an implementation of model-based online reinforcement learning (RL) for continuous domains with deterministic transitions that is specifically designed to achieve low sample complexity. To achieve low sample complexity, since the…

人工智能 · 计算机科学 2012-02-01 Tobias Jung , Peter Stone

We present a planning framework for minimising the deterministic worst-case error in sparse Gaussian process (GP) regression. We first derive a universal worst-case error bound for sparse GP regression with bounded noise using interpolation…

机器人学 · 计算机科学 2023-01-25 Jennifer Wakulicz , Ki Myung Brian Lee , Chanyeol Yoo , Teresa Vidal-Calleja , Robert Fitch

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

统计方法学 · 统计学 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

最优化与控制 · 数学 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

A new algorithm named EXPected Similarity Estimation (EXPoSE) was recently proposed to solve the problem of large-scale anomaly detection. It is a non-parametric and distribution free kernel method based on the Hilbert space embedding of…

机器学习 · 计算机科学 2015-11-18 Markus Schneider , Wolfgang Ertel , Günther Palm

Due to its self-regularizing nature and its ability to quantify uncertainty, the Bayesian approach has achieved excellent recovery performance across a wide range of sparse signal recovery applications. However, most existing methods are…

信号处理 · 电气工程与系统科学 2022-09-07 Zonglong Bai , Liming Shi , Jinwei Sun , Mads Græsbøll Christensen

The kernel function and its hyperparameters are the central model selection choice in a Gaussian proces (Rasmussen and Williams, 2006). Typically, the hyperparameters of the kernel are chosen by maximising the marginal likelihood, an…

机器学习 · 统计学 2022-11-07 Vidhi Lalchand , Wessel P. Bruinsma , David R. Burt , Carl E. Rasmussen

Current methods for stochastic hyperparameter learning in Gaussian Processes (GPs) rely on approximations, such as computing biased stochastic gradients or using inducing points in stochastic variational inference. However, when using such…

机器学习 · 计算机科学 2025-08-29 Neta Shoham , Haim Avron

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

机器学习 · 计算机科学 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

We develop a principled way of identifying probability distributions whose independent and identically distributed (iid) realizations are compressible, i.e., can be well-approximated as sparse. We focus on Gaussian random underdetermined…

统计理论 · 数学 2012-04-27 Rémi Gribonval , Volkan Cevher , Mike E. Davies

We propose a novel quasi-Newton method for solving the sparse inverse covariance estimation problem also known as the graphical least absolute shrinkage and selection operator (GLASSO). This problem is often solved using a second-order…

数值分析 · 数学 2023-10-18 Gal Shalom , Eran Treister , Irad Yavneh

Fitting high-dimensional data involves a delicate tradeoff between faithful representation and the use of sparse models. Too often, sparsity assumptions on the fitted model are too restrictive to provide a faithful representation of the…

机器学习 · 统计学 2013-12-17 Majid Janzamin , Animashree Anandkumar