English
Related papers

Related papers: High-dimensional Adaptive MCMC with Reduced Comput…

200 papers

Given the high degree of computational complexity of the channel estimation technique based on the conventional one-dimensional (1-D) compressive sensing (CS) framework employed in the hybrid beamforming architecture, this study proposes…

Signal Processing · Electrical Eng. & Systems 2022-07-29 Songjie Yang , Chenfei Xie , Dongli Wang , Zhongpei Zhang

The preconditioned Crank-Nicolson (pCN) method is a Markov Chain Monte Carlo (MCMC) scheme, specifically designed to perform Bayesian inferences in function spaces. Unlike many standard MCMC algorithms, the pCN method can preserve the…

Computation · Statistics 2016-07-07 Qingping Zhou , Zixi Hu , Zhewei Yao , Jinglai Li

We give a stochastic optimization algorithm that solves a dense $n\times n$ real-valued linear system $Ax=b$, returning $\tilde x$ such that $\|A\tilde x-b\|\leq \epsilon\|b\|$ in time: $$\tilde O((n^2+nk^{\omega-1})\log1/\epsilon),$$ where…

Data Structures and Algorithms · Computer Science 2024-06-10 Michał Dereziński , Jiaming Yang

We propose a generic Markov Chain Monte Carlo (MCMC) algorithm to speed up computations for datasets with many observations. A key feature of our approach is the use of the highly efficient difference estimator from the survey sampling…

Methodology · Statistics 2017-08-03 Matias Quiroz , Mattias Villani , Robert Kohn

Modeling high-order feature interactions efficiently is a central challenge in click-through rate and conversion rate prediction. Modern industrial recommender systems are predominantly built upon deep learning recommendation models, where…

Information Retrieval · Computer Science 2026-02-13 Heng Yu , Xiangjun Zhou , Jie Xia , Heng Zhao , Anxin Wu , Yu Zhao , Dongying Kong

Gaussian processes are valuable tools for non-parametric modelling, where typically an assumption of stationarity is employed. While removing this assumption can improve prediction, fitting such models is challenging. In this work,…

Computation · Statistics 2019-05-02 Karla Monterrubio-Gómez , Lassi Roininen , Sara Wade , Theo Damoulas , Mark Girolami

We study Bayesian inversion for a model elliptic PDE with unknown diffusion coefficient. We provide complexity analyses of several Markov Chain-Monte Carlo (MCMC) methods for the efficient numerical evaluation of expectations under the…

Numerical Analysis · Mathematics 2013-05-01 Viet Ha Hoang , Christoph Schwab , Andrew M. Stuart

Since most components of sparse multi-path channel (SMPC) are zero, impulse response of SMPC can be recovered from a short training sequence. Though the ordinary orthogonal matching pursuit (OMP) algorithm provides a very fast…

Information Theory · Computer Science 2010-05-24 Ruiming Yang , Qun Wan , Yipeng Liu , Wanlin Yang

Stochastic optimization in learning and inference often relies on Markov chain Monte Carlo (MCMC) to approximate gradients when exact computation is intractable. However, finite-time MCMC estimators are biased, and reducing this bias…

Statistics Theory · Mathematics 2026-02-02 Antoine Godichon-Baggioni , Gabriel Lang , Sylvain Le Corff , Julien Stoehr , Sobihan Surendran

Human-centric perception plays a vital role in vision and graphics. But their data annotations are prohibitively expensive. Therefore, it is desirable to have a versatile pre-train model that serves as a foundation for data-efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Fangzhou Hong , Liang Pan , Zhongang Cai , Ziwei Liu

Neural preconditioners for real-time physics simulation offer promising data-driven priors, but they often fail to capture long-range couplings efficiently because they inherit local message passing or sparse-operator access patterns. We…

Graphics · Computer Science 2026-05-15 Carl Osborne , Minghao Guo , Crystal Owens , Wojciech Matusik

In this work, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trained using an…

Numerical Analysis · Mathematics 2021-03-17 Yating Wang , Wei Deng , Lin Guang

Identifying the key microstructure representations is crucial for Computational Materials Design (CMD). However, existing microstructure characterization and reconstruction (MCR) techniques have limitations to be applied for materials…

Materials Science · Physics 2019-01-07 Zijiang Yang , Xiaolin Li , L. Catherine Brinson , Alok N. Choudhary , Wei Chen , Ankit Agrawal

This paper presents a robust adaptive learning Model Predictive Control (MPC) framework for linear systems with parametric uncertainties and additive disturbances performing iterative tasks. The approach refines the parameter estimates…

Systems and Control · Electrical Eng. & Systems 2025-09-04 Hannes Petrenz , Johannes Köhler , Francesco Borrelli

Existing Markov Chain Monte Carlo (MCMC) methods are either based on general-purpose and domain-agnostic schemes which can lead to slow convergence, or hand-crafting of problem-specific proposals by an expert. We propose A-NICE-MC, a novel…

Machine Learning · Statistics 2018-03-16 Jiaming Song , Shengjia Zhao , Stefano Ermon

The optical response of two-dimensional (2D) materials has been customarily calculated ab initio using plane waves and without separating the most important orbitals contributions. In the family of transition metal dichalcogenides (TMDC)…

Mesoscale and Nanoscale Physics · Physics 2025-12-30 Angiolo Huamán

We propose a novel adaptive empirical Bayesian method for sparse deep learning, where the sparsity is ensured via a class of self-adaptive spike-and-slab priors. The proposed method works by alternatively sampling from an adaptive…

Machine Learning · Statistics 2020-04-15 Wei Deng , Xiao Zhang , Faming Liang , Guang Lin

This paper proposes and analyzes a mmWave sparse channel estimation technique for OFDM systems that uses the Orthogonal Matching Pursuit (OMP) algorithm. This greedy algorithm retrieves one additional multipath component (MPC) per iteration…

Information Theory · Computer Science 2018-12-19 Felipe Gomez-Cuba , Andrea J. Goldsmith

In this paper, we investigate power-constrained sensing matrix design in a sparse Gaussian linear dimensionality reduction framework. Our study is carried out in a single--terminal setup as well as in a multi--terminal setup consisting of…

Information Theory · Computer Science 2015-10-28 Amirpasha Shirazinia , Subhrakanti Dey

A majorized accelerated block coordinate descent (mABCD) method in Hilbert space is analyzed to solve a sparse PDE-constrained optimization problem via its dual. The finite element approximation method is investigated. The attractive…

Optimization and Control · Mathematics 2020-01-08 Xiaoliang Song , Defeng Sun , Kim-Chuan Toh