English
Related papers

Related papers: On Identification of Sparse Multivariable ARX Mode…

200 papers

High dimensional vector autoregressive (VAR) models require a large number of parameters to be estimated and may suffer of inferential problems. We propose a new Bayesian nonparametric (BNP) Lasso prior (BNP-Lasso) for high-dimensional VAR…

Economics · Quantitative Finance 2018-10-30 Monica Billio , Roberto Casarin , Luca Rossini

Variational inference has been widely used in machine learning literature to fit various Bayesian models. In network analysis, this method has been successfully applied to solve the community detection problems. Although these results are…

Machine Learning · Statistics 2024-05-22 Xuezhen Li , Can M. Le

Gaussian graphical models are of great interest in statistical learning. Because the conditional independencies between different nodes correspond to zero entries in the inverse covariance matrix of the Gaussian distribution, one can learn…

Machine Learning · Computer Science 2010-11-02 Katya Scheinberg , Shiqian Ma , Donald Goldfarb

This paper is about variable selection, clustering and estimation in an unsupervised high-dimensional setting. Our approach is based on fitting constrained Gaussian mixture models, where we learn the number of clusters $K$ and the set of…

Machine Learning · Statistics 2014-02-03 Stephane Gaiffas , Bertrand Michel

Mixtures of matrix Gaussian distributions provide a probabilistic framework for clustering continuous matrix-variate data, which are becoming increasingly prevalent in various fields. Despite its widespread adoption and successful…

Computation · Statistics 2023-07-21 Andrea Cappozzo , Alessandro Casa , Michael Fop

In this paper, we are interested in learning the underlying graph structure behind training data. Solving this basic problem is essential to carry out any graph signal processing or machine learning task. To realize this, we assume that the…

Machine Learning · Computer Science 2018-05-08 Sundeep Prabhakar Chepuri , Sijia Liu , Geert Leus , Alfred O. Hero

In this work, we propose an adaptive sparse learning algorithm that can be applied to learn the physical processes and obtain a sparse representation of the solution given a large snapshot space. Assume that there is a rich class of…

Machine Learning · Computer Science 2022-07-26 Yating Wang , Wing Tat Leung , Guang Lin

In this paper, a sparsity-aware adaptive algorithm for distributed learning in diffusion networks is developed. The algorithm follows the set-theoretic estimation rationale. At each time instance and at each node of the network, a closed…

Information Theory · Computer Science 2015-06-03 Symeon Chouvardas , Konstantinos Slavakis , Yannis Kopsinis , Sergios Theodoridis

Received signal strength (RSS) based source localization method is popular due to its simplicity and low cost. However, this method is highly dependent on the propagation model which is not easy to be captured in practice. Moreover, most…

Signal Processing · Electrical Eng. & Systems 2020-08-26 Kangyong You , Wenbin Guo , Tao Peng , Yueliang Liu , Peiliang Zuo , Wenbo Wang

Learning the directed acyclic graph (DAG) structure of a Bayesian network from observational data is a notoriously difficult problem for which many hardness results are known. In this paper we propose a provably polynomial-time algorithm…

Machine Learning · Computer Science 2019-06-04 Asish Ghoshal , Jean Honorio

Many problems of low-level computer vision and image processing, such as denoising, deconvolution, tomographic reconstruction or super-resolution, can be addressed by maximizing the posterior distribution of a sparse linear model (SLM). We…

Machine Learning · Statistics 2010-08-16 Matthias W. Seeger , Hannes Nickisch

In order to improve the performance of least mean square (LMS)-based adaptive filtering for identifying block-sparse systems, a new adaptive algorithm called block-sparse LMS (BS-LMS) is proposed in this paper. The basis of the proposed…

Information Theory · Computer Science 2015-10-28 Shuyang Jiang , Yuantao Gu

Efficiently quantifying predictive uncertainty in medical images remains a challenge. While Bayesian neural networks (BNN) offer predictive uncertainty, they require substantial computational resources to train. Although Bayesian…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Zeinab Abboud , Herve Lombaert , Samuel Kadoury

The theory of network identification, namely identifying the (weighted) interaction topology among a known number of agents, has been widely developed for linear agents. However, the theory for nonlinear agents using probing inputs is far…

Systems and Control · Computer Science 2025-01-29 Miel Sharf , Daniel Zelazo

Deep latent generative models have attracted increasing attention due to the capacity of combining the strengths of deep learning and probabilistic models in an elegant way. The data representations learned with the models are often…

Machine Learning · Computer Science 2023-04-04 Zhao Xu , Daniel Onoro Rubio , Giuseppe Serra , Mathias Niepert

This paper proposes a Bayesian downlink channel estimation algorithm for time-varying massive MIMO networks. In particular, the quantization effects at the receiver are considered. In order to fully exploit the sparsity and time…

Information Theory · Computer Science 2019-05-16 Jianpeng Ma , Shun Zhang , Hongyan Li , Feifei Gao , Zhu Han

Bayesian networks are basic graphical models, used widely both in statistics and artificial intelligence. These statistical models of conditional independence structure are described by acyclic directed graphs whose nodes correspond to…

Optimization and Control · Mathematics 2010-12-01 Raymond Hemmecke , Silvia Lindner , Milan Studený

The iterations of many first-order algorithms, when applied to minimizing common regularized regression functions, often resemble neural network layers with pre-specified weights. This observation has prompted the development of…

Machine Learning · Computer Science 2017-08-03 Hao He , Bo Xin , David Wipf

Searching the complete space of possible Bayesian networks is intractable for problems of interesting size, so Bayesian network structure learning algorithms, such as the commonly used Sparse Candidate algorithm, employ heuristics. However,…

Artificial Intelligence · Computer Science 2012-06-26 Eric Lantz , Soumya Ray , David Page

In this paper, we consider the mixture of sparse linear regressions model. Let ${\beta}^{(1)},\ldots,{\beta}^{(L)}\in\mathbb{C}^n$ be $ L $ unknown sparse parameter vectors with a total of $ K $ non-zero coefficients. Noisy linear…

Information Theory · Computer Science 2018-08-03 Dong Yin , Ramtin Pedarsani , Yudong Chen , Kannan Ramchandran