English
Related papers

Related papers: Replica Analysis for Generalized Linear Regression…

200 papers

We study the Electrical Impedance Tomography Bayesian inverse problem for recovering the conductivity given noisy measurements of the voltage on some boundary surface electrodes. The uncertain conductivity depends linearly on a countable…

Numerical Analysis · Mathematics 2023-06-16 Quang Huy Pham , Viet Ha Hoang

The article develops a hybrid Variational Bayes algorithm that combines the mean-field and fixed-form Variational Bayes methods. The new estimation algorithm can be used to approximate any posterior without relying on conjugate priors. We…

Methodology · Statistics 2013-08-09 David J Nott , Minh-Ngoc Tran , Anthony Y. C. Kuk , Robert Kohn

Generalized linear mixed models are useful in studying hierarchical data with possibly non-Gaussian responses. However, the intractability of likelihood functions poses challenges for estimation. We develop a new method suitable for this…

Methodology · Statistics 2022-01-26 Zexi Song , Zhiqiang Tan

In this work, we consider the problem of regularization in the design of minimum mean square error (MMSE) linear filters. Using the relationship with statistical machine learning methods, using a Bayesian approach, the regularization…

Information Theory · Computer Science 2024-07-01 Daniel Gomes de Pinho Zanco , Leszek Szczecinski , Jacob Benesty

In the setting of entangled single-sample distributions, the goal is to estimate some common parameter shared by a family of distributions, given one \emph{single} sample from each distribution. We study mean estimation and linear…

Machine Learning · Computer Science 2020-07-08 Hui Yuan , Yingyu Liang

Online sparse linear regression is an online problem where an algorithm repeatedly chooses a subset of coordinates to observe in an adversarially chosen feature vector, makes a real-valued prediction, receives the true label, and incurs the…

Machine Learning · Computer Science 2020-07-27 Satyen Kale , Zohar Karnin , Tengyuan Liang , Dávid Pál

In this paper, we consider a general distributed estimation problem in relay-assisted sensor networks by taking into account time-varying asymmetric communications, fading channels and intermittent measurements. Motivated by centralized…

Information Theory · Computer Science 2016-04-20 Shanying Zhu , Yeng Chai Soh , Lihua Xie

We study sample efficient reinforcement learning (RL) under the general framework of interactive decision making, which includes Markov decision process (MDP), partially observable Markov decision process (POMDP), and predictive state…

Machine Learning · Computer Science 2023-07-03 Han Zhong , Wei Xiong , Sirui Zheng , Liwei Wang , Zhaoran Wang , Zhuoran Yang , Tong Zhang

Compressed sensing (CS) demonstrates that sparse signals can be recovered from underdetermined linear measurements. We focus on the joint sparse recovery problem where multiple signals share the same common sparse support sets, and they are…

Information Theory · Computer Science 2011-02-17 Jongmin Kim , Woohyuk Chang , Bangchul Jung , Dror Baron , Jong Chul Ye

This letter proposes a novel adaptive reduced-rank filtering scheme based on joint iterative optimization of adaptive filters. The novel scheme consists of a joint iterative optimization of a bank of full-rank adaptive filters that forms…

Information Theory · Computer Science 2012-05-22 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

A hierarchical Bayesian approach that permits simultaneous inference for the regression coefficient matrix and the error precision (inverse covariance) matrix in the multivariate linear model is proposed. Assuming a natural ordering of the…

Methodology · Statistics 2024-10-29 Christina Zhao , Ding Xiang , Galin L. Jones , Adam J. Rothman

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the…

Machine Learning · Statistics 2013-03-26 Rajarshi Guhaniyogi , David B. Dunson

Data privacy has increasingly become a daunting challenge because it limits data availability, which is essential in estimating statistical models such as generalized linear mixed models. Access to personal data often involves considerable…

Methodology · Statistics 2026-05-05 Marie Analiz April Limpoco , Christel Faes , Niel Hens

Multi-view data have been routinely collected in various fields of science and engineering. A general problem is to study the predictive association between multivariate responses and multi-view predictor sets, all of which can be of high…

Methodology · Statistics 2018-07-30 Gen Li , Xiaokang Liu , Kun Chen

For noisy compressive sensing systems, the asymptotic distortion with respect to an arbitrary distortion function is determined when a general class of least-square based reconstruction schemes is employed. The sampling matrix is considered…

Information Theory · Computer Science 2017-04-27 Ali Bereyhi , Ralf Müller , Hermann Schulz-Baldes

For many practical applications in wireless communications, we need to recover a structured sparse signal from a linear observation model with dynamic grid parameters in the sensing matrix. Conventional expectation maximization (EM)-based…

Signal Processing · Electrical Eng. & Systems 2023-11-14 Wenkang Xu , An Liu , Bingpeng Zhou , Minjian Zhao

We introduce a framework that enables efficient sampling from learned probability distributions for MRI reconstruction. Different from conventional deep learning-based MRI reconstruction techniques, samples are drawn from the posterior…

Machine Learning · Computer Science 2023-07-21 Guanxiong Luo , Moritz Blumenthal , Martin Heide , Martin Uecker

This paper considers a low-complexity Gaussian Message Passing Iterative Detection (GMPID) method over a pairwise graph for a massive Multiuser Multiple-Input Multiple-Output (MU-MIMO) system, in which a base station with M antennas serves…

Information Theory · Computer Science 2016-11-17 Lei Liu , Chau Yuen , Yong Liang Guan , Ying Li , Yuping Su

We develop a framework that we call compressive rate estimation. We assume that the composite channel gain matrix (i.e. the matrix of all channel gains between all network nodes) is compressible which means it can be approximated by a…

Information Theory · Computer Science 2015-04-29 Jan Schreck , Peter Jung , Sławomir Stańczak

This article deals with random projections applied as a data reduction technique for Bayesian regression analysis. We show sufficient conditions under which the entire $d$-dimensional distribution is approximately preserved under random…