English
Related papers

Related papers: Generalized Approximate Survey Propagation for Hig…

200 papers

Inferring the posterior distribution in SLAM is critical for evaluating the uncertainty in localization and mapping, as well as supporting subsequent planning tasks aiming to reduce uncertainty for safe navigation. However, real-time full…

Robotics · Computer Science 2023-08-11 Qiangqiang Huang , John J. Leonard

It is well known that in the presence of heteroscedasticity ordinary least squares estimator is not efficient. I propose a generalized automatic least squares estimator (GALS) that makes partial correction of heteroscedasticity based on a…

Econometrics · Economics 2023-04-18 Bulat Gafarov

We propose the AdaPtive Noise Augmentation (PANDA) procedure to regularize the estimation and inference of generalized linear models (GLMs). PANDA iteratively optimizes the objective function given noise augmented data until convergence to…

Machine Learning · Statistics 2022-04-20 Yinan Li , Fang Liu

In recent years, Multimodal Large Language Models (MLLMs) have made significant progress in visual question answering tasks. However, directly applying existing fine-tuning methods to remote sensing (RS) images often leads to issues such as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Qigan Sun , Chaoning Zhang , Jianwei Zhang , Xudong Wang , Jiehui Xie , Pengcheng Zheng , Haoyu Wang , Sungyoung Lee , Chi-lok Andy Tai , Yang Yang , Heng Tao Shen

We consider the problem of phase retrieval, namely, recovery of a signal from the magnitude of its Fourier transform, or of any other linear transform. Due to the loss of the Fourier phase information, this problem is ill-posed. Therefore,…

Information Theory · Computer Science 2023-07-19 Yoav Shechtman , Amir Beck , Yonina C. Eldar

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

We propose a theoretical framework that generalizes simple and fast algorithms for hierarchical agglomerative clustering to weighted graphs with both attractive and repulsive interactions between the nodes. This framework defines GASP, a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Alberto Bailoni , Constantin Pape , Nathan Hütsch , Steffen Wolf , Thorsten Beier , Anna Kreshuk , Fred A. Hamprecht

We consider the problem of learning high-dimensional Gaussian graphical models. The graphical lasso is one of the most popular methods for estimating Gaussian graphical models. However, it does not achieve the oracle rate of convergence. In…

Machine Learning · Statistics 2017-06-06 Qiang Sun , Kean Ming Tan , Han Liu , Tong Zhang

Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state…

Information Theory · Computer Science 2022-06-24 Lei Liu , Shunqi Huang , Brian M. Kurkoski

We study algorithms for solving quadratic systems of equations based on optimization methods over polytopes. Our work is inspired by a recently proposed convex formulation of the phase retrieval problem, which estimates the unknown signal…

Information Theory · Computer Science 2018-05-25 Oussama Dhifallah , Christos Thrampoulidis , Yue M. Lu

We develop a fast variational approximation scheme for Gaussian process (GP) regression, where the spectrum of the covariance function is subjected to a sparse approximation. Our approach enables uncertainty in covariance function…

Computation · Statistics 2019-04-24 Linda S. L. Tan , Victor M. H. Ong , David J. Nott , Ajay Jasra

Sparse generalized eigenvalue problem (GEP) plays a pivotal role in a large family of high-dimensional statistical models, including sparse Fisher's discriminant analysis, canonical correlation analysis, and sufficient dimension reduction.…

Machine Learning · Statistics 2018-09-05 Kean Ming Tan , Zhaoran Wang , Han Liu , Tong Zhang

Many traditional signal recovery approaches can behave well basing on the penalized likelihood. However, they have to meet with the difficulty in the selection of hyperparameters or tuning parameters in the penalties. In this article, we…

Machine Learning · Statistics 2022-11-17 Bin Wang , Xiaofei Wang , Jianhua Guo

This paper presents a novel approach for approximate integration over the uncertainty of noise and signal variances in Gaussian process (GP) regression. Our efficient and straightforward approach can also be applied to integration over…

Machine Learning · Statistics 2017-12-18 Ville Tolvanen , Pasi Jylänki , Aki Vehtari

A common goal in many research areas is to reconstruct an unknown signal x from noisy linear measurements. Approximate message passing (AMP) is a class of low-complexity algorithms that can be used for efficiently solving such…

Signal Processing · Electrical Eng. & Systems 2020-03-27 Hangjin Liu , Cynthia Rush , Dror Baron

Purpose: Undersampling is used to reduce the scan time for high-resolution 3D magnetic resonance imaging. In order to achieve better image quality and avoid manual parameter tuning, we propose a probabilistic Bayesian approach to recover…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Shuai Huang , James J. Lah , Jason W. Allen , Deqiang Qiu

A fundamental task in machine learning and related fields is to perform inference on Bayesian networks. Since exact inference takes exponential time in general, a variety of approximate methods are used. Gibbs sampling is one of the most…

Machine Learning · Computer Science 2015-11-23 Daniel Seita , Haoyu Chen , John Canny

Logistic Gaussian process (LGP) priors provide a flexible alternative for modelling unknown densities. The smoothness properties of the density estimates can be controlled through the prior covariance structure of the LGP, but the challenge…

Computation · Statistics 2016-11-01 Jaakko Riihimäki , Aki Vehtari

We provide faster algorithms for the problem of Gaussian summation, which occurs in many machine learning methods. We develop two new extensions - an O(Dp) Taylor expansion for the Gaussian kernel with rigorous error bounds and a new error…

Machine Learning · Computer Science 2012-07-02 Dongryeol Lee , Alexander G. Gray

We propose a new recursive estimator for linear dynamical systems under Gaussian process noise and non-Gaussian measurement noise. Specifically, we develop an approximate maximum a posteriori (MAP) estimator using dynamic programming and…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Mohammad Hussein Yoosefian Nooshabadi , Laurent Lessard